add an option to ignore "Content-Type" for config/source/url ?

[liispon]

some sites may not provide a correct "Content-Type" header.

[Davincible]

Example?

[liispon]

I tried spring config server. It returned "Content-Type: text/plain" for a YAML file.
It made "config/source/url" can't work with it.
So I wonder if we could add an option to work around such cases.

[Davincible]

I see, do you get an error? If so could you paste the full error

[liispon]

Example code:

        enc := yaml.NewEncoder()
	urlSource := url.NewSource(
		url.WithURL(path),
		source.WithEncoder(enc),
	)
	conf, err := config.NewConfig(
		config.WithReader(mjson.NewReader(reader.WithEncoder(enc))),
	)
       conf.Load(urlSource)

error message:

Error creating config: invalid character 'b' looking for beginning of value

And If remove code in url.go dealing with 'content-type', it could parse the YAML correctly.

func (u *urlSource) Read() (*source.ChangeSet, error) {
	rsp, err := http.Get(u.url)
	if err != nil {
		return nil, err
	}
	defer rsp.Body.Close()

	b, err := io.ReadAll(rsp.Body)
	if err != nil {
		return nil, err
	}

	// ft := format(rsp.Header.Get("Content-Type"))
	// if len(ft) == 0 {
	ft := u.opts.Encoder.String()
	//}

	cs := &source.ChangeSet{
		Data:      b,
		Format:    ft,
		Timestamp: time.Now(),
		Source:    u.String(),
	}
	cs.Checksum = cs.Sum()

	return cs, nil
}