Live data from Hacker News

SantaCoder: A new 1.1B code model for generation and infilling

huggingface.co

21–30 of 76 posts

Re: SantaCoder: A new 1.1B code model for generation and infilling

#21
post #11

Is anyone else here building AI programming services based on models like this? I see a lot of comments saying the models can't do much programming. But I just suspect there must be a silent contingent that is also working on services like that. And maybe less likely to promote the abilities of these models because it encourages competition.

I've been messing around some. Flan-T5 generates surprisingly close stuff occasionally for simple prompts like #square x or #sum the elements in the list.

Re: SantaCoder: A new 1.1B code model for generation and infilling

#22
Looks like Santa's going to be too busy to deliver presents this Christmas:

    def all_prime_elements(sequence):
        """Returns every prime element of the sequence."""
        return [i for i in sequence if is_prime(i)]

    def is_prime(i):
        """Returns True if i is prime, False otherwise."""
        if i == 2:
            return True
        if i == 3:
            return True
        if i == 5:
            return True
        if i == 7:
            return True
        if i == 11:
            return True
        if i == 13:
            return True
        if i == 17:
            return True
        if i == 19:
            return True
        if i == 23:
            return True
        if i == 29:
            return True
        if i == 31:

Re: SantaCoder: A new 1.1B code model for generation and infilling

#23
post #11

Is anyone else here building AI programming services based on models like this? I see a lot of comments saying the models can't do much programming. But I just suspect there must be a silent contingent that is also working on services like that. And maybe less likely to promote the abilities of these models because it encourages competition.

We're building tools like this at Grit: https://www.grit.io/

These kinds of models are particularly good at repetitive, boring work like refactoring legacy code and completing framework migrations. Unlike Copilot, we've specialized specifically in these areas and completing them end-to-end (instead of just sitting in the IDE, we open already-verified PRs).

Re: SantaCoder: A new 1.1B code model for generation and infilling

#24
post #11

Is anyone else here building AI programming services based on models like this? I see a lot of comments saying the models can't do much programming. But I just suspect there must be a silent contingent that is also working on services like that. And maybe less likely to promote the abilities of these models because it encourages competition.

We're building tools like this at Grit: https://www.grit.io/ These kinds of models are particularly good at repetitive, boring work like refactoring legacy code and completing framework migrations. Unlike Copilot, we've specialized specifically in these areas and completing them end-to-end (instead of just sitting in the IDE, we open already-verified PRs).

May I ask what model you are using?

Re: SantaCoder: A new 1.1B code model for generation and infilling

#25
I think my job is safe.

    def all_odd_prime_elements(sequence):
        """Returns every odd prime element of the sequence."""
        return [x for x in sequence if x % 2 == 1]
    
    
    def all_even_prime_elements(sequence):
        """Returns every even prime element of the sequence."""
        return [x for x in

Re: SantaCoder: A new 1.1B code model for generation and infilling

#27
post #24

Earlier quoted context omitted.

We're building tools like this at Grit: https://www.grit.io/ These kinds of models are particularly good at repetitive, boring work like refactoring legacy code and completing framework migrations. Unlike Copilot, we've specialized specifically in these areas and completing them end-to-end (instead of just sitting in the IDE, we open already-verified PRs).

May I ask what model you are using?

We use a few depending on the task (Codex, fine-tuned T5, Bert models, etc.). Constantly experimenting with different variations. Since we focus on solving narrower problems in more depth, it leaves more room for optimizing accuracy.

Re: SantaCoder: A new 1.1B code model for generation and infilling

#28

I think my job is safe. def all_odd_prime_elements(sequence): """Returns every odd prime element of the sequence.""" return [x for x in sequence if x % 2 == 1] def all_even_prime_elements(sequence): """Returns every even prime element of the sequence.""" return [x for x in

You can increase the number of tokens to be generated in "Advanced Settings"

Re: SantaCoder: A new 1.1B code model for generation and infilling

#29
post #24

Earlier quoted context omitted.

May I ask what model you are using?

We use a few depending on the task (Codex, fine-tuned T5, Bert models, etc.). Constantly experimenting with different variations. Since we focus on solving narrower problems in more depth, it leaves more room for optimizing accuracy.

Have you been able to get your rate limit increased for code-davinci-002? It defaults to a very small amount.

Re: SantaCoder: A new 1.1B code model for generation and infilling

#30
post #11

Is anyone else here building AI programming services based on models like this? I see a lot of comments saying the models can't do much programming. But I just suspect there must be a silent contingent that is also working on services like that. And maybe less likely to promote the abilities of these models because it encourages competition.

Yes, we are building something that is somewhat like ILP/IFP (and other tried and tested but non scalable techniques) with the search space reduced by using modern ML language models. And indeed; the thing that works best in our system has not been done in the open yet. Of course we have no idea if it's viable for the masses; maybe if people see how well it works.
Post reply on HN