Student assistant:
Interpersonal Synchrony Analysis Project

The Max Planck Institute for Intelligent Systems (MPI-IS) conducts research to understand the principles of perception, action, and learning in natural and artificial systems that successfully interact with complex environments.

The Optics and Sensing Laboratory at the Max Planck Institute for Intelligent Systems in Tübingen has an open position for a student assistant (HiWi) to support the ongoing research efforts in the Interpersonal Synchrony Analysis (ISA) Project.

We support the development of highly realistic human and animal avatars for use in research, film, virtual reality, biology and medicine. Using unique 3D & 4D capture facilities, machine learning, computer vision, and advanced graphics, we are modeling humans and animals shape and behavior.

    About the project:

    In the ISA project, we develop algorithms to estimate human motion in videos to better understand the interactions and communications that take place between two people. We are planning to capture a new dataset on human-to-human communication and to use these algorithms to guide and support large-scale data annotation of this dataset.

    Optics and Sensing Laboratory website: https://is.mpg.de/en/optics-sensing-laboratory

    Examples of detections predicted by Computer Vision algorithms for gaze and human body pose.

    Your tasks:

    • Support our ongoing efforts of implementing a Computer Vision based detection-tool by using and testing the tool’s beta-version.
    • Implement an interface/application for the detection-tool to integrate its predictions into a well-established annotation tool, e.g., ELAN or NOVA.
    • Support data captures – the technical setup of a multi-camera system, organization and coordination of project participants, as well as data processing.
    • Roll-out a new interface of the detection-tool: it should assist and simplify the annotation process of the newly captured data.
    • Train the annotators in using the new interface, support them during the process, and collect feedback for improvements.
    • Optional: Assist in conducting user studies on the usefulness of the detection-tool and interface.
    • Optional: Write code scripts for building Graphical User Interfaces (GUIs), data wrappers, or visualizations.
    • Work between 10-20 hours per week.

    Your profile:

    • Background in computational psychology, computer science, or a related field.
    • Good programming skills in Python and experience with installing packages/software on Ubuntu/Windows.
    • Currently enrolled at a German university and available to come to the lab once a week.
    • Readiness to learn and commit to this project for at least 1 year.
    • Natural team player and a detail-oriented person, capable of methodically solving problems, passion for technology with a research mindset.
    • Good oral and written communication skills in English.

    Good to have:

        • Basic knowledge of cameras, interest in multi-camera data captures.
        • Experience with labeling tool such as ELAN or NOVA.
        • Knowledge in Java or C# is an advantage.
        • Experience in implementation of a Graphical User Interface (GUI)

        We offer:

        In this working environment, you will be exposed to cutting-edge technologies related to computer vision and multi-sensor systems. The MPI for Intelligent Systems is one of the world's leading research institutions for machine learning, computer vision and robotics, and studying the concepts of intelligence and autonomous behavior in artificial systems at different length scales. The position is ideally suited for students looking to extend their scientific and cultural horizons. You will be a part of a young team of international scientists, engineers, and administrative staff.

          Students can earn up to €13.03 per hour, depending on their qualifications. The maximum possible working hours for students per week are 20 hours.

          Contact an application:

          To apply, please submit

          • A CV (1-2 pages)
          • One page answering the following questions:
            - Which part of this job offer is most interesting to you and why?
            - One of your main tasks will be to write code that integrates output from the detection tool into input to the annotation
               tool. In your opinion, what are the important parts or necessary steps (e.g., design, conceptual, code, questions for      discussion)?
            - Why would you be a good fit for this position?
                1. A link to your GitHub account or some example codes that demonstrate your programming skills
                2. References letters (or names of referees)

                                          Please prepare these documents in English and upload them as one PDF file.

                                          Only complete applications can be considered.

                                          The position will be open until filled.

                                            The Max Planck Society is committed to increasing the number of individuals with disabilities in its workforce and therefore encourages applications from such qualified individuals. The Max Planck Society strives for gender equality and diversity. Furthermore, the Max Planck Society seeks to increase the number of women in its workforce in those areas where they are underrepresented and therefore explicitly encourages women to apply.

                                            Any questions regarding the position should be forwarded to Carolin Schmitt (carolin.schmitt@tuebingen.mpg.de) and Keiko Kitagawa (keiko.kitagawa@tuebingen.mpg.de).



                                                  Back to overview Online application