MATLAB Contest

Welcome to the feedback forum for the MATLAB Contest. We want to hear from you!

This is not a place to request product support or to make product suggestions. These will be immediately deleted. Nor is it open at this time to feedback on other areas of MATLAB Central.

I suggest the MATLAB Contest team ...

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the “My feedback” filter and select “My open ideas”.
(thinking…)
Reset

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can vote and comment on it.

If it doesn't exist, you can post your idea so others can vote on it.

Enter your idea and we'll search to see if someone has already suggested it.

  • Hot ideas
  • Top ideas
  • New ideas
    1. Give us a Algorithm day over the weekend.

      There are many more participants in Darkness and Twilight, yet both these fall in the middle of the week. Either extend one of these phases, or shift the entire contest that at least one weekend day can be used for algorithm development.

      26 votes
      Vote 0 votes Vote Vote
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service

        You'll receive a confirmation email with a link to create a password (optional).

        Signed in as (Sign out)
        You have left! (?) (thinking…)
      • Hide code for an hour after submission

        The competition needs to strike a better balance between tweaking and algorithmic improvements. To encourage more of the latter, code for each submission could be hidden (during daylight) for an hour (or more) after submission. This would help on the Big Sunday Push. It would also mean that you could start testing new approaches an hour before a deadline without fear of being "tweak-bumped" (beaten by a tiny last minute tweak of your own code).

        19 votes
        Vote 0 votes Vote Vote
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service

          You'll receive a confirmation email with a link to create a password (optional).

          Signed in as (Sign out)
          You have left! (?) (thinking…)
        • Use a separate test set for the grand prize

          To avoid the problem of tweaking and over-fitting on the test set, every submission could be run on two different test stes - the first is used for all mid-contest competitions and scores are made known immediately, while the second is used for the Grand Prize, and scores are only made known after the queue closes. This would put more emphasis on making general improvements to the code.

          19 votes
          Vote 0 votes Vote Vote
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service

            You'll receive a confirmation email with a link to create a password (optional).

            Signed in as (Sign out)
            You have left! (?) (thinking…)
          • create the ability to schedule submissions.

            The only way to win Daylight is to submit during the final half hour of the contest. For a large part of the world this falls in the dead of night. Others are constrained by the reliability of their connections and a power failure or connectivity issue at a critical time can ruin a contestants chances. Scheduled entries can be scored immediately (or whenever the queue is idle) but effectively be in darkness until their scheduled submission time arrives. This should be much fairer to all involved.

            15 votes
            Vote 0 votes Vote Vote
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service

              You'll receive a confirmation email with a link to create a password (optional).

              Signed in as (Sign out)
              You have left! (?) (thinking…)
            • 8 votes
              Vote 0 votes Vote Vote
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service

                You'll receive a confirmation email with a link to create a password (optional).

                Signed in as (Sign out)
                You have left! (?) (thinking…)
              • more points to inventors of an idea-code

                It would be more fair if everyone who clone somebody else's submission leaved some points of his/her score to the owner of the initial submission. Maybe an hierarchy should be applied about how points will be distributed vertically on the list of "parents" of each cloned code.

                5 votes
                Vote 0 votes Vote Vote
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service

                  You'll receive a confirmation email with a link to create a password (optional).

                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                • Find a way to reward completely novel solution methods

                  One way to do this would be through a minicontest where people could submit their different ideas with some identifying label, and the community could vote for most original/favorite method.

                  4 votes
                  Vote 0 votes Vote Vote
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service

                    You'll receive a confirmation email with a link to create a password (optional).

                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                  • Introduce a short (3-24 hour) daylight period before the start of darkness.

                    The blank canvas will allow collaboration and competition on short simple entries, improving accessibility and appeal for contest newcomers. Code will be relatively easy to follow in this period, in contrast with the end of twilight. If this period is short enough, ambitious players will not have time to develop a contest-winning algorithm, and will be motivated to hold back until darkness/twilight. This early daylight might be a friendly introduction to the contest for new players.

                    3 votes
                    Vote 0 votes Vote Vote
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service

                      You'll receive a confirmation email with a link to create a password (optional).

                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                    • job opportunity

                      Would be nice for matlab contest team to offer to the winner of the prize the opportunity to work for mathworks in a related with the contest project. This would dramatically increased the numper of participants the contest

                      3 votes
                      Vote 0 votes Vote Vote
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service

                        You'll receive a confirmation email with a link to create a password (optional).

                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                      • Make the queue always be in 'darkness'

                        Entries in the queue that haven't be run yet should never have their code viewable by anyone. This is should have a similar result as a twilight/darkness period, without preventing people from viewing previously run code. It would probably help significantly with the 'tweak bombing' that usually occurs right around each prize deadline throughout the entire contest.

                        52 votes
                        Vote 0 votes Vote Vote
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service

                          You'll receive a confirmation email with a link to create a password (optional).

                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                        • Complete a CAPTCHA before submitting an entry.

                          (Only necessary if the contest only processes one entry per contestant, and each contestant is limited to one account name.)

                          53 votes
                          Vote 0 votes Vote Vote
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service

                            You'll receive a confirmation email with a link to create a password (optional).

                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                          • Show pass/fail code indication during darkness

                            Too often at the start of a contest a lot of people's submissions fail for various reasons, unrelated to the main solver routine, even though they run ok on our personal systems. Usually this is because there is some sort of prohibited function in the code that the parser doesn't allow. We don't find this out until after darkness, ruining any chances of those entries seriously competing during that phase.

                            A simple pass/fail indication will help us fix those types of issues without conveying any specific information back to us, and thus still be within the spirit of the darkness… more

                            31 votes
                            Vote 0 votes Vote Vote
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service

                              You'll receive a confirmation email with a link to create a password (optional).

                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                            • 38 votes
                              Vote 0 votes Vote Vote
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service

                                You'll receive a confirmation email with a link to create a password (optional).

                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                              • Evaluate top 10 entries at end of contest phase again several times and use the mean score

                                To get a more meaningful score value to find the winner of a contest phase, the top 10 entries (or all entries inside a certain time interval) could be evaluated again several times to minimize the impact of machine load variations on the runtime.

                                22 votes
                                Vote 0 votes Vote Vote
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service

                                  You'll receive a confirmation email with a link to create a password (optional).

                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                • Reduce the fractional time dependance on the scores

                                  One way to do that is to pick the scoring coefficients more appropriately to 'de-value' minor timing variations. Another way would be to just round the
                                  times to the nearest tenth second. This helps eliminate the 'luck of the draw' due to random load variations on the contest system.

                                  10 votes
                                  Vote 0 votes Vote Vote
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service

                                    You'll receive a confirmation email with a link to create a password (optional).

                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                  • Keep track of who added each line in the winner entries

                                    It would be nice to see if any of your contibutions end in a leading entry. I think something similar was done in the past... i liked it!!

                                    9 votes
                                    Vote 0 votes Vote Vote
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service

                                      You'll receive a confirmation email with a link to create a password (optional).

                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)
                                    • Have a 2nd 'generality' test suite that is run only once a day

                                      An idea for a contest prize for generality is to have a second test suite that the codes are only run against maybe once a day. The test-suite swaps in the past don't seem to reduce the tweaking too much, albeit caused just the opposite. I think the way to test for generality is to reduce, but not eliminate, the feedback you give us on the
                                      solvers against a secondary test suite. One suggestion would be to run at midnight each night the top x (50? 100?) solvers against an alternate test-suite and provide a 'generality' score. This would prevent… more

                                      3 votes
                                      Vote 0 votes Vote Vote
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service

                                        You'll receive a confirmation email with a link to create a password (optional).

                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)
                                      • Process one entry per contestant in the queue at a time.

                                        If the machinery only scored one entry per contestant on each pass through the queue, people who submit lots of entries will only slow down themselves.

                                        44 votes
                                        Vote 0 votes Vote Vote
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service

                                          You'll receive a confirmation email with a link to create a password (optional).

                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                          under review  ·  gulleyAdmingulley (Admin, MATLAB Central) responded

                                          We need to think carefully about the problem of throttling. If we make the temptation to create sock puppets unbearable, then lots of people will certainly do it, and it will defeat the purpose of the rule.

                                        • Break the test suite into pieces and parallelize the scoring process.

                                          If the scoring process took place across several machines, this would allow for the same consistency of timing, yet allow us to increase the test suite size and/or increase queue throughput.

                                          9 votes
                                          Vote 0 votes Vote Vote
                                          Vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service

                                            You'll receive a confirmation email with a link to create a password (optional).

                                            Signed in as (Sign out)
                                            You have left! (?) (thinking…)
                                        • Don’t see your idea?
                                        • Post a new idea…
                                        • MATLAB Contest

                                          Knowledge Base and Helpdesk