Big Data/Machine Learning Engineer
Locations allowed:
• Fully onsite in NYC. NY
• Hybrid Richmond, VA
• Hybrid in Mclean, VA
Pay rate: 78+/hr
Job Description:
• Design, develop, and maintain scalable data pipelines and ETL processes to handle large datasets.
• Build and optimize machine learning models using various algorithms and frameworks.
• Collaborate with cross-functional teams to identify business requirements and translate them into technical specifications.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Implement real-time data processing solutions using big data technologies (e.g., Apache Spark, Hadoop).
• Monitor and troubleshoot system performance and scalability issues.
• Conduct data analysis to extract actionable insights and support decision-making processes.
• Stay up-to-date with the latest developments in big data technologies and machine learning techniques.
Skills:
• Familiarity with PySpark, AWS EMR, Snowflake and Databricks
preferred.• Pursue understanding & documentation of existing data pipelines to prepare for migration to new platforms.
