Job Description
Roles and Responsibilities :
- Retrieve data from an SQL database in real-time to support various business applications.
- Develop and maintain batch data pipelines to transfer data between databases.
- Collaborate with IT members to discuss and implement NCS (Network Control Systems) requirements.
- Ensure data quality, integrity, and security across all data processes.
- Lead and mentor a team of data engineers, providing guidance and support.
- Stay updated with the latest industry trends and technologies to continuously improve our data infrastructure.
Requirements
Requirements :
10-12 years of experience with cloud platforms such as AzureExperience working with offshore membersKnowledge of data warehousing solutions and ETL processes.Experience with big data technologies such as Hadoop, Spark, or Kafka.Bilingual (English and Japanese). Good verbal and written communication.Proven experience as a Data Engineer or similar role.Strong proficiency in SQL and experience with real-time data retrieval.Experience in developing batch data pipelines from database to database.Strong problem-solving skills and attention to detail.Ability to work in a fast-paced, dynamic environment.Requirements
Roles and Responsibilities :
Retrieve data from an SQL database in real-time to support various business applications.Develop and maintain batch data pipelines to transfer data between databases.Collaborate with IT members to discuss and implement NCS (Network Control Systems) requirements.Ensure data quality, integrity, and security across all data processes.Lead and mentor a team of data engineers, providing guidance and support.Stay updated with the latest industry trends and technologies to continuously improve our data infrastructure.Requirements
Requirements :
10-12 years of experience with cloud platforms such as AzureExperience working with offshore membersKnowledge of data warehousing solutions and ETL processes.Experience with big data technologies such as Hadoop, Spark, or Kafka.Bilingual (English and Japanese). Good verbal and written communication.Proven experience as a Data Engineer or similar role.Strong proficiency in SQL and experience with real-time data retrieval.Experience in developing batch data pipelines from database to database.Strong problem-solving skills and attention to detail.Ability to work in a fast-paced, dynamic environment.