Title: Data Engineer Location: San Francisco, CA (1-2 Days onsite/Week) Duration: 12 Month Contract Key Responsibilities: • Design and implement scalable data pipelines using Databricks and Spark. • Develop and maintain data processing applications in Scala and Python. • Integrate and manage data streams using Kafka. • Build and maintain microservices using Spring Boot. • Collaborate with data scientists and analysts to understand data requirements and deliver solutions. • Optimize and troubleshoot data workflows to ensure high performance and reliability. • Ensure data quality and integrity across various data sources. Required Skills and Qualifications: • Bachelor’s degree in Computer Science, Engineering, or a related field. • Proven experience as a Data Engineer or in a similar role. • Proficiency in Databricks, Spark, Scala, Kafka, Python, and Spring Boot. • Strong understanding of microservices architecture. • Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus. • Excellent problem-solving skills and attention to detail. • Strong communication and teamwork abilities.
