Last Job Title
I have background in Computer Science! I have previous work experience of ~3.5 years, as Software Engineer / Data Engineer ! Major part of my previous work experience includes Data model designing and Writing Spark (Scala, Python) Glue jobs for preparing and standardizing data warehouse. Designing AWS Infrastructure (i.e. AWS Glue, AWS Batch, AWS SQS, AWS IAM, CloudWatch, CloudFormation and AWS Lambda) for daily Batch Jobs, using Python Boto3 & AWS-CLI. designed CI/CD pipeline for faster development / integration/ testing and deployment iteration of data pipelines on Glue, using AWS CodePipeline, AWS Lambda and Cloud formation. Writing Athena (presto), Hive, SQL, Snowflake queries for some complex scenarios of daily reporting. My most recent project includes developing Stream data pipeline using Apache Beam and Kafka for computing latency faced by end users who visit the product website. I am passionate to explore more in deploying ML/RNN models in Data pipeline at scale.
San Francisco, California