Sep 09 23:46:10.278327 ip-10-0-131-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 23:46:10.278344 ip-10-0-131-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 23:46:10.278353 ip-10-0-131-250 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 23:46:10.278682 ip-10-0-131-250 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 23:46:20.424758 ip-10-0-131-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 23:46:20.424780 ip-10-0-131-250 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7bbc35227f0b44038b4df9926fbaedfe -- Sep 09 23:48:12.883547 ip-10-0-131-250 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:48:13.274426 ip-10-0-131-250 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:48:13.274426 ip-10-0-131-250 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:48:13.274426 ip-10-0-131-250 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:48:13.274426 ip-10-0-131-250 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:48:13.274426 ip-10-0-131-250 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:48:13.275064 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.274493 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:48:13.278246 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278229 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:48:13.278246 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278246 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278262 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278267 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278271 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278274 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278277 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278280 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278283 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278287 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278292 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278295 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278298 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278301 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278308 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278311 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278314 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278316 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278319 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278322 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:48:13.278322 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278325 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278328 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278331 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278333 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278337 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278339 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278341 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278344 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278347 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278349 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278352 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278354 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278357 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278359 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278362 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278365 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278367 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278369 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278372 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:48:13.278779 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278374 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278376 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278379 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278382 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278385 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278387 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278390 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278393 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278400 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278403 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278405 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278408 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278411 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278414 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278416 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278419 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278421 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278424 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278427 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278429 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:48:13.279237 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278432 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278434 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278437 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278439 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278442 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278444 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278447 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278449 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278452 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278454 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278457 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278459 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278462 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278464 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278467 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278469 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278472 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278475 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278478 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278481 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278483 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:48:13.279750 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278487 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278490 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278495 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278498 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278500 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278503 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278505 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278508 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278510 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278513 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278515 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278518 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278520 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278523 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278525 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278528 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278530 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278533 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.278537 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:48:13.280271 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279233 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279240 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279243 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279246 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279265 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279270 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279274 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279277 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279281 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279284 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279287 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279291 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279294 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279297 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279300 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279304 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279307 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279310 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279313 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:48:13.280728 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279316 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279318 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279321 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279323 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279326 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279328 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279331 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279333 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279336 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279338 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279341 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279343 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279346 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279348 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279351 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279354 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279356 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279359 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279361 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279364 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:48:13.281265 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279366 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279369 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279372 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279374 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279377 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279379 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279382 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279384 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279388 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279391 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279393 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279396 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279398 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279401 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279403 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279406 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279408 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279411 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279413 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279418 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:48:13.281766 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279421 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279425 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279429 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279432 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279434 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279437 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279440 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279443 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279445 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279448 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279451 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279453 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279456 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279458 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279461 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279464 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279466 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279471 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279475 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279477 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:48:13.282266 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279480 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279483 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279485 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279488 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279490 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279493 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279495 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279498 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279500 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279503 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279505 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279510 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279512 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279515 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279518 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279520 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279523 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279525 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279528 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279530 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:48:13.282763 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279908 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279912 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279915 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279918 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279920 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279923 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279925 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279928 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279930 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279933 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279937 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279940 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279943 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279946 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279949 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279952 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279954 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279957 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279959 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279962 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:48:13.283262 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279965 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279967 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279970 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279974 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279976 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279979 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279982 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279984 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279987 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279989 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279992 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279994 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279997 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.279999 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280002 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280005 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280007 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280010 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280013 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280015 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:48:13.283753 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280018 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280021 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280023 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280026 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280028 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280031 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280034 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280036 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280039 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280041 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280044 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280046 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280048 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280051 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280053 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280057 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280060 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280062 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280065 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280067 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:48:13.284241 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280072 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280076 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280079 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280082 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280086 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280088 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280091 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280094 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280097 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280099 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280103 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280106 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280109 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280112 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280115 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280117 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280120 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280123 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280125 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:48:13.284744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280129 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280131 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280134 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280137 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280139 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280142 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280144 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280147 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280151 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280153 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280155 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280158 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280160 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280163 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280165 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280168 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280170 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280172 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280175 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280178 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:48:13.285227 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280269 2556 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280304 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280311 2556 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280315 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280319 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280322 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280326 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280330 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280334 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280336 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280340 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280344 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280347 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280350 2556 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280353 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280356 2556 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280359 2556 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280362 2556 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280365 2556 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280368 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280372 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280375 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280378 2556 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280381 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:48:13.285736 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280385 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280388 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280391 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280394 2556 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280398 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280400 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280404 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280407 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280410 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280415 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280418 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280420 2556 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280423 2556 flags.go:64] FLAG: --enable-server="true" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280426 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280430 2556 flags.go:64] FLAG: --event-burst="100" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280433 2556 flags.go:64] FLAG: --event-qps="50" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280436 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280440 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280443 2556 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280446 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280449 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280453 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280456 2556 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280459 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280462 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:48:13.286399 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280465 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280468 2556 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280471 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280475 2556 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280478 2556 flags.go:64] FLAG: --feature-gates="" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280482 2556 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280485 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280488 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280491 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280494 2556 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280497 2556 flags.go:64] FLAG: --help="false" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280500 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280503 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280505 2556 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280508 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280512 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280518 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280521 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280524 2556 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280526 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280529 2556 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280532 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280535 2556 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280538 2556 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:48:13.287023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280541 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280544 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280547 2556 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280549 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280552 2556 flags.go:64] FLAG: --lock-file="" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280555 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280558 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280561 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280567 2556 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280569 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280572 2556 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280576 2556 flags.go:64] FLAG: --logging-format="text" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280579 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280582 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280585 2556 flags.go:64] FLAG: --manifest-url="" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280587 2556 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280592 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280595 2556 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280599 2556 flags.go:64] FLAG: --max-pods="110" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280602 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280605 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280607 2556 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280610 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280613 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280617 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:48:13.287632 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280620 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280628 2556 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280630 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280633 2556 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280636 2556 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280639 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280644 2556 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280647 2556 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280650 2556 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280653 2556 flags.go:64] FLAG: --port="10250" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280656 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280658 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05f46493fcdee73b8" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280662 2556 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280664 2556 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280668 2556 flags.go:64] FLAG: --register-node="true" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280671 2556 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280675 2556 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280678 2556 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280682 2556 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280685 2556 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280689 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280692 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280698 2556 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280701 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280704 2556 flags.go:64] FLAG: --runonce="false" Sep 09 23:48:13.288458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280706 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280709 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280713 2556 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280716 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280718 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280721 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280724 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280729 2556 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280732 2556 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280735 2556 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280737 2556 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280740 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280744 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280747 2556 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280749 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280755 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280757 2556 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280760 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280763 2556 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280766 2556 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280769 2556 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280772 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280775 2556 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280778 2556 flags.go:64] FLAG: --v="2" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280782 2556 flags.go:64] FLAG: --version="false" Sep 09 23:48:13.289412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280786 2556 flags.go:64] FLAG: --vmodule="" Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280794 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.280798 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280917 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280921 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280924 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280927 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280930 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280933 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280936 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280938 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280941 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280944 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280947 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280951 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280954 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280956 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280959 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280962 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280964 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:48:13.290045 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280967 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280970 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280972 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280975 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280978 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280980 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280983 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280985 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280988 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280990 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280993 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280996 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.280998 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281002 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281006 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281008 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281011 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281013 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281015 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:48:13.290571 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281018 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281021 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281023 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281026 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281028 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281031 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281033 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281037 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281039 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281042 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281044 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281047 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281049 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281052 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281054 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281056 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281059 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281062 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281064 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:48:13.291048 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281067 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281069 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281072 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281074 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281077 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281082 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281086 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281090 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281093 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281096 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281099 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281102 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281104 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281107 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281109 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281112 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281114 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281117 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281119 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281122 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:48:13.291545 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281125 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281128 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281131 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281133 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281136 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281138 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281141 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281143 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281147 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281150 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281153 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281156 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281158 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281161 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281164 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281166 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281169 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281171 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281175 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:48:13.292042 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281178 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281180 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281183 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281185 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.281189 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.281736 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.291297 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.291313 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.291333 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.291338 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291402 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291407 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291410 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291414 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:48:13.292520 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291417 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291421 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291424 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291426 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291429 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291432 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291435 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291438 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291441 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291444 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291446 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291449 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291452 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291455 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291457 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291460 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291462 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291469 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291472 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:48:13.292881 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291475 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291478 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291480 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291483 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291485 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291488 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291491 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291493 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291496 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291498 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291502 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291506 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291510 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291514 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291518 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291521 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291524 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291526 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291529 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:48:13.293403 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291532 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291534 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291537 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291540 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291543 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291546 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291548 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291551 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291554 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291556 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291559 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291562 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291565 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291567 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291570 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291572 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291575 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291577 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291580 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291582 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291585 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:48:13.293868 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291587 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291590 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291593 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291596 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291598 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291601 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291604 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291607 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291610 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291612 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291615 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291617 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291620 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291623 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291625 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291628 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291632 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291634 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291638 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:48:13.294435 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291641 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291644 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291647 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291650 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291653 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291655 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291658 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291660 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291663 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291666 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291668 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291671 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291674 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291676 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291679 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291682 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:48:13.294906 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291684 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.291689 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291804 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291809 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291812 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291815 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291818 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291820 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291823 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291826 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291829 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291831 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291834 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291837 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291840 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:48:13.295303 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291843 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291846 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291848 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291851 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291853 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291856 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291858 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291862 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291866 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291869 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291872 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291875 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291878 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291881 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291884 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291886 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291889 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291891 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291894 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:48:13.295669 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291897 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291899 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291901 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291905 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291908 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291910 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291913 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291915 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291917 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291920 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291922 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291925 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291927 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291930 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291933 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291935 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291938 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291940 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291943 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:48:13.296128 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291945 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291947 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291950 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291953 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291955 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291960 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291963 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291965 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291968 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291971 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291973 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291976 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291978 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291981 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291983 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291986 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291988 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291991 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291993 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291996 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:48:13.296607 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.291998 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292000 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292003 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292005 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292008 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292010 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292012 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292016 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292020 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292023 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292026 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292029 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292032 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292034 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292037 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292039 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292042 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292046 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292049 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292052 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:48:13.297088 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292055 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292057 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292060 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292063 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292065 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292068 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292070 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:13.292073 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.292078 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.292171 2556 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.295215 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.296159 2556 server.go:1019] "Starting client certificate rotation" Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.296270 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:48:13.297617 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.296301 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:48:13.298660 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.298646 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:48:13.300787 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.300759 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:48:13.312071 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.312055 2556 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:48:13.315297 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.315272 2556 log.go:25] "Validated CRI v1 image API" Sep 09 23:48:13.316989 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.316973 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:48:13.319953 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.319931 2556 fs.go:135] Filesystem UUIDs: map[16ef4b4e-657a-4cfd-9c35-fe2bbfc47768:/dev/nvme0n1p4 27942c4b-cb53-4284-b8a4-92fec7f3f4fc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 09 23:48:13.320021 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.319952 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:48:13.325972 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.325859 2556 manager.go:216] Machine: {Timestamp:2026-09-09 23:48:13.324556908 +0000 UTC m=+0.322924701 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120624 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2477fe5634615f02dddca4a4eace15 SystemUUID:ec2477fe-5634-615f-02dd-dca4a4eace15 BootID:7bbc3522-7f0b-4403-8b4d-f9926fbaedfe Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:48:26:c6:31:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:48:26:c6:31:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:f9:4d:f5:d5:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:48:13.325972 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.325964 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:48:13.326105 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.326038 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:48:13.326576 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.326561 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:48:13.329011 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.328985 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:48:13.329144 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.329014 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:48:13.329648 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.329637 2556 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:48:13.329680 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.329649 2556 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:48:13.329680 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.329656 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:48:13.330205 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.330196 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:48:13.331010 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.331000 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:48:13.334654 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.334642 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:48:13.334772 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.334763 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:48:13.334811 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.334793 2556 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:48:13.334811 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.334806 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:48:13.334864 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.334821 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:48:13.334864 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.334831 2556 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:48:13.334864 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.334839 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:48:13.335177 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.335166 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:48:13.335223 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.335184 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:48:13.337361 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.337343 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:48:13.339458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.339444 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:48:13.339525 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.339474 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:48:13.340020 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340010 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:48:13.340054 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340025 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:48:13.340054 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340032 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:48:13.340054 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340038 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:48:13.340054 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340045 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:48:13.340054 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340051 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:48:13.340220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340189 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:48:13.340220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340197 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:48:13.340220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340203 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:48:13.340220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340208 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:48:13.340220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340221 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:48:13.340363 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340230 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:48:13.340972 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340963 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:48:13.340972 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.340972 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:48:13.342867 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.342849 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n2jwm" Sep 09 23:48:13.344149 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.344124 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:48:13.344843 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.344828 2556 server.go:1268] "Started kubelet" Sep 09 23:48:13.344935 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.344893 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:48:13.344995 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.344913 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:48:13.345058 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.344905 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:48:13.345058 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.345000 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:48:13.345058 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.345027 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:48:13.345774 ip-10-0-131-250 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:48:13.346129 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.346099 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:48:13.346636 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.346621 2556 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:48:13.348151 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.348132 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n2jwm" Sep 09 23:48:13.349749 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.348890 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-250.ec2.internal.18d3cbec6fcf5990 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-250.ec2.internal,UID:ip-10-0-131-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-250.ec2.internal,},FirstTimestamp:2026-09-09 23:48:13.34479912 +0000 UTC m=+0.343166892,LastTimestamp:2026-09-09 23:48:13.34479912 +0000 UTC m=+0.343166892,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-250.ec2.internal,}" Sep 09 23:48:13.352098 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.352073 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:48:13.352839 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.352810 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:48:13.352916 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.352839 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:48:13.353082 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.353061 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:13.353659 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.353641 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:48:13.353768 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.353750 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:48:13.353832 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.353773 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:48:13.353887 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.353833 2556 factory.go:55] Registering systemd factory Sep 09 23:48:13.353887 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.353851 2556 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:48:13.353887 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.353886 2556 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:48:13.354019 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.353894 2556 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:48:13.354198 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.354182 2556 factory.go:153] Registering CRI-O factory Sep 09 23:48:13.354198 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.354198 2556 factory.go:223] Registration of the crio container factory successfully Sep 09 23:48:13.354336 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.354248 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:48:13.354919 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.354904 2556 factory.go:103] Registering Raw factory Sep 09 23:48:13.354968 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.354943 2556 manager.go:1196] Started watching for new ooms in manager Sep 09 23:48:13.355366 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.355351 2556 manager.go:349] Starting recovery of all containers Sep 09 23:48:13.357986 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.357961 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:48:13.360415 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.360391 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-250.ec2.internal\" not found" node="ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.365306 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.365289 2556 manager.go:354] Recovery completed Sep 09 23:48:13.369666 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.369650 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:48:13.372313 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.372149 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:48:13.372313 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.372308 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:48:13.372408 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.372323 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:48:13.372904 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.372890 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:48:13.372965 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.372902 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:48:13.372965 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.372920 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:48:13.372965 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.372952 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:48:13.373675 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.373662 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:48:13.373738 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.373686 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:48:13.373738 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.373696 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:48:13.375026 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.375015 2556 policy_none.go:49] "None policy: Start" Sep 09 23:48:13.375070 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.375031 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:48:13.375070 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.375041 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:48:13.377043 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.377027 2556 policy_none.go:47] "Start" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.409300 2556 manager.go:337] "Starting Device Plugin manager" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.409334 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.409343 2556 server.go:87] "Starting device plugin registration server" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.409654 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.409667 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.409758 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.409837 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.409846 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.410558 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:48:13.431463 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.410631 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:13.486828 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.486787 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:48:13.487965 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.487936 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:48:13.488046 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.488002 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:48:13.488084 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.488078 2556 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:48:13.488198 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.488177 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 23:48:13.490136 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.490117 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:48:13.510751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.510730 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:48:13.511658 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.511643 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:48:13.511745 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.511675 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:48:13.511745 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.511688 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:48:13.511745 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.511718 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.516722 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.516708 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.516784 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.516729 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-250.ec2.internal\": node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:13.530665 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.530593 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:13.589961 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.589279 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal"] Sep 09 23:48:13.590054 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.590005 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:48:13.590937 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.590924 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:48:13.591015 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.590954 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:48:13.591015 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.590969 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:48:13.593312 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.593297 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:48:13.593378 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.593365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.593413 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.593400 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:48:13.594059 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.594039 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:48:13.594141 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.594071 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:48:13.594141 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.594081 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:48:13.594141 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.594047 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:48:13.594141 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.594133 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:48:13.594141 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.594142 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:48:13.596238 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.596226 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.596297 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.596263 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:48:13.596941 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.596916 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:48:13.597031 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.596947 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:48:13.597031 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.596961 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:48:13.612767 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.612743 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-250.ec2.internal\" not found" node="ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.616774 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.616755 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-250.ec2.internal\" not found" node="ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.630931 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.630913 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:13.655746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.655727 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fb08136825eb2ae62fa73ecf8896a9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal\" (UID: \"1fb08136825eb2ae62fa73ecf8896a9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.655807 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.655749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fb08136825eb2ae62fa73ecf8896a9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal\" (UID: \"1fb08136825eb2ae62fa73ecf8896a9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.655807 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.655767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b918f93a5380fe0ffc07a388ced93b00-config\") pod \"kube-apiserver-proxy-ip-10-0-131-250.ec2.internal\" (UID: \"b918f93a5380fe0ffc07a388ced93b00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.731379 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.731354 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:13.756803 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.756779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fb08136825eb2ae62fa73ecf8896a9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal\" (UID: \"1fb08136825eb2ae62fa73ecf8896a9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.756907 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.756808 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fb08136825eb2ae62fa73ecf8896a9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal\" (UID: \"1fb08136825eb2ae62fa73ecf8896a9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.756907 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.756825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b918f93a5380fe0ffc07a388ced93b00-config\") pod \"kube-apiserver-proxy-ip-10-0-131-250.ec2.internal\" (UID: \"b918f93a5380fe0ffc07a388ced93b00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.756907 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.756894 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1fb08136825eb2ae62fa73ecf8896a9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal\" (UID: \"1fb08136825eb2ae62fa73ecf8896a9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.757017 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.756929 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b918f93a5380fe0ffc07a388ced93b00-config\") pod \"kube-apiserver-proxy-ip-10-0-131-250.ec2.internal\" (UID: \"b918f93a5380fe0ffc07a388ced93b00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.757017 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.756961 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fb08136825eb2ae62fa73ecf8896a9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal\" (UID: \"1fb08136825eb2ae62fa73ecf8896a9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.832067 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.832003 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:13.914634 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.914599 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.919458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:13.919441 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" Sep 09 23:48:13.933096 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:13.933078 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:14.033559 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:14.033531 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.149724 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:15.149698 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.250182 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:15.250156 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.312679 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.312655 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:48:15.313114 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.312786 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:48:15.313114 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.312818 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:48:15.350951 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:15.350923 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.369177 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.369109 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:43:14 +0000 UTC" deadline="2028-04-14 06:22:58.114640297 +0000 UTC" Sep 09 23:48:15.369177 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.369144 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13974h34m42.745500893s" Sep 09 23:48:15.451232 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:15.451201 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.484857 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:15.484789 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb08136825eb2ae62fa73ecf8896a9e.slice/crio-921da2cb059606b7646ae1e4976c7d685c9de43d303990f16575167dcc34c94d WatchSource:0}: Error finding container 921da2cb059606b7646ae1e4976c7d685c9de43d303990f16575167dcc34c94d: Status 404 returned error can't find the container with id 921da2cb059606b7646ae1e4976c7d685c9de43d303990f16575167dcc34c94d Sep 09 23:48:15.485594 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:15.485572 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb918f93a5380fe0ffc07a388ced93b00.slice/crio-922959997b6119fd87940a22ead42459c6e6d3f3029250650df44d1736e0f585 WatchSource:0}: Error finding container 922959997b6119fd87940a22ead42459c6e6d3f3029250650df44d1736e0f585: Status 404 returned error can't find the container with id 922959997b6119fd87940a22ead42459c6e6d3f3029250650df44d1736e0f585 Sep 09 23:48:15.490002 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.489987 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:48:15.506867 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.506817 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" event={"ID":"b918f93a5380fe0ffc07a388ced93b00","Type":"ContainerStarted","Data":"922959997b6119fd87940a22ead42459c6e6d3f3029250650df44d1736e0f585"} Sep 09 23:48:15.507980 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.507959 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" event={"ID":"1fb08136825eb2ae62fa73ecf8896a9e","Type":"ContainerStarted","Data":"921da2cb059606b7646ae1e4976c7d685c9de43d303990f16575167dcc34c94d"} Sep 09 23:48:15.552238 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:15.552214 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.652729 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:15.652658 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.753149 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:15.753115 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.771499 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.771471 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:48:15.853657 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:15.853622 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-250.ec2.internal\" not found" Sep 09 23:48:15.935767 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.935694 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:48:15.969686 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.969660 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" Sep 09 23:48:15.982614 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.982585 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:48:15.983658 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.983634 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" Sep 09 23:48:15.991699 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:15.991603 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:48:16.351579 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.351496 2556 apiserver.go:52] "Watching apiserver" Sep 09 23:48:16.357456 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.357433 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:48:16.358566 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.358501 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-957mh","kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl","openshift-cluster-node-tuning-operator/tuned-7h6np","openshift-dns/node-resolver-c6gfn","openshift-image-registry/node-ca-jjs7w","openshift-multus/multus-additional-cni-plugins-hsg52","openshift-network-operator/iptables-alerter-rmgpz","kube-system/global-pull-secret-syncer-766j4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal","openshift-multus/multus-76k75","openshift-multus/network-metrics-daemon-ntvrv","openshift-network-diagnostics/network-check-target-ssd6p","openshift-ovn-kubernetes/ovnkube-node-sgdds"] Sep 09 23:48:16.361042 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.361019 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.363216 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.363177 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:48:16.363369 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.363184 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2dfnb\"" Sep 09 23:48:16.363369 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.363357 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:48:16.363655 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.363629 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:48:16.363743 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.363683 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:48:16.363743 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.363635 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:48:16.363865 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.363777 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:16.363865 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.363832 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:16.365759 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.365741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.369178 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.369106 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:48:16.369282 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.369210 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:48:16.369499 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.369480 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.371289 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.371265 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ggwdm\"" Sep 09 23:48:16.371830 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.371504 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:48:16.371830 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.371606 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:48:16.372008 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.371973 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.372234 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.372161 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:48:16.373023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.372460 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:48:16.373023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.372540 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8m9v2\"" Sep 09 23:48:16.374203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.374185 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:48:16.374203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.374199 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:48:16.374396 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.374189 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k4qng\"" Sep 09 23:48:16.375507 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.374740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.377004 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.376986 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.377096 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.377059 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:16.377158 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.376996 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:48:16.377360 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.377341 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-75hrj\"" Sep 09 23:48:16.377674 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.377656 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:48:16.377963 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.377697 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:48:16.379289 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.379111 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:48:16.379378 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.379324 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:16.382779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.381684 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f9vgb\"" Sep 09 23:48:16.382779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.381728 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:48:16.382779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.381685 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:48:16.382779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.381986 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.382779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.382672 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqsmg\" (UniqueName: \"kubernetes.io/projected/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-kube-api-access-mqsmg\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.382779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.382704 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.382779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.382731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-sys-fs\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.382779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.382756 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-kubernetes\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.382818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-systemd\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.382920 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-var-lib-kubelet\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.382949 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7rg7\" (UniqueName: \"kubernetes.io/projected/d6257ca7-5c53-45da-8525-315f9698cf0a-kube-api-access-q7rg7\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.382983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-etc-selinux\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysctl-d\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysctl-conf\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383051 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383086 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-socket-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383111 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysconfig\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-tmp\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383161 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-registration-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-lib-modules\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383209 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-tuned\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383254 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6257ca7-5c53-45da-8525-315f9698cf0a-hosts-file\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-system-cni-dir\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cnibin\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-modprobe-d\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6257ca7-5c53-45da-8525-315f9698cf0a-tmp-dir\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-device-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-run\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-host\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9g9\" (UniqueName: \"kubernetes.io/projected/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-kube-api-access-7c9g9\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383613 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hffqn\" (UniqueName: \"kubernetes.io/projected/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-kube-api-access-hffqn\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.383751 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.383636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-sys\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.384367 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.384264 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.384367 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.384215 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:48:16.385531 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.385474 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:48:16.386304 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.385906 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:48:16.386304 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.386105 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:48:16.386304 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.386163 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:48:16.386304 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.386252 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:48:16.386502 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.386411 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-75mhr\"" Sep 09 23:48:16.386967 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.386912 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:48:16.386967 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.386918 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:48:16.386967 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.386956 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:48:16.387152 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.387112 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bmsx4\"" Sep 09 23:48:16.387325 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.387283 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-76k75" Sep 09 23:48:16.389905 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.389636 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:16.389905 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.389655 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2zgxn\"" Sep 09 23:48:16.389905 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.389703 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:16.390227 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.390209 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:48:16.403159 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.403131 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpb4h" Sep 09 23:48:16.409866 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.409850 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpb4h" Sep 09 23:48:16.470142 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.470110 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:48:16.484775 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.484744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-etc-selinux\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.484944 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.484779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysctl-d\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.484944 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.484802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.484944 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.484820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-conf-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.484944 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.484849 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-etc-selinux\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.484944 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.484859 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-multus-certs\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.485229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysconfig\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.485229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysctl-d\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.485229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-tmp\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.485229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485123 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-socket-dir-parent\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.485229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485144 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysconfig\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.485229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d726466-e0ff-499c-94bf-0219bf7ba099-dbus\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.485229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3890a48-748e-475b-8739-e2c3f45db416-iptables-alerter-script\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.485229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485211 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-registration-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485269 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-registration-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l48kl\" (UniqueName: \"kubernetes.io/projected/ed104fe1-52de-450d-8d73-3e58d95f0efc-kube-api-access-l48kl\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-systemd-units\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed104fe1-52de-450d-8d73-3e58d95f0efc-cni-binary-copy\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-node-log\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485420 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26ff3f59-387b-47ae-9e72-a9923f65f688-ovn-node-metrics-cert\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485440 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3890a48-748e-475b-8739-e2c3f45db416-host-slash\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485440 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-modprobe-d\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-hostroot\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.485540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-cni-netd\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-modprobe-d\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfcp2\" (UniqueName: \"kubernetes.io/projected/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-kube-api-access-cfcp2\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-device-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485598 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-host\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485554 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/107b0c9c-1d8b-444e-a779-6a7eb2e99815-serviceca\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-var-lib-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-ovnkube-config\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485699 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-ovnkube-script-lib\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hffqn\" (UniqueName: \"kubernetes.io/projected/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-kube-api-access-hffqn\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485696 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-host\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485724 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-device-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-cni-bin\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-kubelet\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-ovn\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485819 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485845 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-systemd\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-var-lib-kubelet\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485938 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-systemd\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-k8s-cni-cncf-io\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l74vz\" (UniqueName: \"kubernetes.io/projected/26ff3f59-387b-47ae-9e72-a9923f65f688-kube-api-access-l74vz\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysctl-conf\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.485997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5719a4b-0bf4-489d-a77a-9181bf0dedb1-konnectivity-ca\") pod \"konnectivity-agent-957mh\" (UID: \"d5719a4b-0bf4-489d-a77a-9181bf0dedb1\") " pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486019 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-slash\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486025 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-var-lib-kubelet\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486061 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhqv\" (UniqueName: \"kubernetes.io/projected/e3890a48-748e-475b-8739-e2c3f45db416-kube-api-access-9jhqv\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-socket-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486082 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-sysctl-conf\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-system-cni-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486125 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-lib-modules\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:16.486855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-cnibin\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486187 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-etc-kubernetes\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486237 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-socket-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486255 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-lib-modules\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d726466-e0ff-499c-94bf-0219bf7ba099-kubelet-config\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-systemd\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-etc-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486328 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-tuned\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486371 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6257ca7-5c53-45da-8525-315f9698cf0a-hosts-file\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-system-cni-dir\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cnibin\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486455 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6257ca7-5c53-45da-8525-315f9698cf0a-hosts-file\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486469 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cnibin\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486502 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5fhl\" (UniqueName: \"kubernetes.io/projected/107b0c9c-1d8b-444e-a779-6a7eb2e99815-kube-api-access-d5fhl\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486511 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-system-cni-dir\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-cni-bin\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.487605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-daemon-config\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6257ca7-5c53-45da-8525-315f9698cf0a-tmp-dir\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-cni-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486628 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-netns\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-kubelet\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486690 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-run-netns\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-run\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486730 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9g9\" (UniqueName: \"kubernetes.io/projected/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-kube-api-access-7c9g9\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/107b0c9c-1d8b-444e-a779-6a7eb2e99815-host\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5719a4b-0bf4-489d-a77a-9181bf0dedb1-agent-certs\") pod \"konnectivity-agent-957mh\" (UID: \"d5719a4b-0bf4-489d-a77a-9181bf0dedb1\") " pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486785 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-log-socket\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-env-overrides\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486876 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.488435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.486931 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-run\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487009 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-sys\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqsmg\" (UniqueName: \"kubernetes.io/projected/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-kube-api-access-mqsmg\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487066 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-sys\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-cni-multus\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-sys-fs\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-kubernetes\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487181 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6257ca7-5c53-45da-8525-315f9698cf0a-tmp-dir\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7rg7\" (UniqueName: \"kubernetes.io/projected/d6257ca7-5c53-45da-8525-315f9698cf0a-kube-api-access-q7rg7\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487273 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-sys-fs\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487343 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-kubernetes\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.489230 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.487614 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.489777 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.489369 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-tmp\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.489777 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.489430 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-etc-tuned\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.491572 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.491545 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:16.491731 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.491579 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:16.491731 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.491595 2556 projected.go:196] Error preparing data for projected volume kube-api-access-k6j2q for pod openshift-network-diagnostics/network-check-target-ssd6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:16.491731 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.491657 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q podName:28b2275d-0a9b-4951-8a24-0de2e9e81490 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:16.991637015 +0000 UTC m=+2.974370688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k6j2q" (UniqueName: "kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q") pod "network-check-target-ssd6p" (UID: "28b2275d-0a9b-4951-8a24-0de2e9e81490") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:16.493986 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.493953 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hffqn\" (UniqueName: \"kubernetes.io/projected/af9a88e9-a1a5-40f8-abe6-ef05a59ce875-kube-api-access-hffqn\") pod \"aws-ebs-csi-driver-node-lqmgl\" (UID: \"af9a88e9-a1a5-40f8-abe6-ef05a59ce875\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.494459 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.494438 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7rg7\" (UniqueName: \"kubernetes.io/projected/d6257ca7-5c53-45da-8525-315f9698cf0a-kube-api-access-q7rg7\") pod \"node-resolver-c6gfn\" (UID: \"d6257ca7-5c53-45da-8525-315f9698cf0a\") " pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.494686 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.494664 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqsmg\" (UniqueName: \"kubernetes.io/projected/56541eb1-521a-40b3-a12a-5b7a69e3a7dd-kube-api-access-mqsmg\") pod \"tuned-7h6np\" (UID: \"56541eb1-521a-40b3-a12a-5b7a69e3a7dd\") " pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.494773 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.494717 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9g9\" (UniqueName: \"kubernetes.io/projected/5fb7d427-1679-4bbd-ab39-f38f8a7d78b5-kube-api-access-7c9g9\") pod \"multus-additional-cni-plugins-hsg52\" (UID: \"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5\") " pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.587862 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.587821 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-socket-dir-parent\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.587862 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.587860 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d726466-e0ff-499c-94bf-0219bf7ba099-dbus\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.587883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3890a48-748e-475b-8739-e2c3f45db416-iptables-alerter-script\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.587921 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l48kl\" (UniqueName: \"kubernetes.io/projected/ed104fe1-52de-450d-8d73-3e58d95f0efc-kube-api-access-l48kl\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.587944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-systemd-units\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.587965 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-socket-dir-parent\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.587966 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588001 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d726466-e0ff-499c-94bf-0219bf7ba099-dbus\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed104fe1-52de-450d-8d73-3e58d95f0efc-cni-binary-copy\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588042 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-systemd-units\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588078 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-node-log\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588101 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-node-log\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588118 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26ff3f59-387b-47ae-9e72-a9923f65f688-ovn-node-metrics-cert\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588051 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3890a48-748e-475b-8739-e2c3f45db416-host-slash\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588174 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-hostroot\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-cni-netd\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588244 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfcp2\" (UniqueName: \"kubernetes.io/projected/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-kube-api-access-cfcp2\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/107b0c9c-1d8b-444e-a779-6a7eb2e99815-serviceca\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588274 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-hostroot\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588293 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-var-lib-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588328 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-ovnkube-config\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588345 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-var-lib-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588357 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-ovnkube-script-lib\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588387 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-cni-netd\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-cni-bin\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-kubelet\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-ovn\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.588510 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-k8s-cni-cncf-io\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588542 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3890a48-748e-475b-8739-e2c3f45db416-iptables-alerter-script\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588560 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l74vz\" (UniqueName: \"kubernetes.io/projected/26ff3f59-387b-47ae-9e72-a9923f65f688-kube-api-access-l74vz\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588605 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5719a4b-0bf4-489d-a77a-9181bf0dedb1-konnectivity-ca\") pod \"konnectivity-agent-957mh\" (UID: \"d5719a4b-0bf4-489d-a77a-9181bf0dedb1\") " pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588598 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed104fe1-52de-450d-8d73-3e58d95f0efc-cni-binary-copy\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588674 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-ovn\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588677 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-kubelet\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588725 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-k8s-cni-cncf-io\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588797 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3890a48-748e-475b-8739-e2c3f45db416-host-slash\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.588943 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-slash\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589060 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/107b0c9c-1d8b-444e-a779-6a7eb2e99815-serviceca\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhqv\" (UniqueName: \"kubernetes.io/projected/e3890a48-748e-475b-8739-e2c3f45db416-kube-api-access-9jhqv\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589120 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-slash\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589138 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-cni-bin\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.589368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-system-cni-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589199 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-system-cni-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589212 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-run-ovn-kubernetes\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589244 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5719a4b-0bf4-489d-a77a-9181bf0dedb1-konnectivity-ca\") pod \"konnectivity-agent-957mh\" (UID: \"d5719a4b-0bf4-489d-a77a-9181bf0dedb1\") " pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-cnibin\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589325 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-ovnkube-config\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-etc-kubernetes\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589374 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-etc-kubernetes\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589386 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-cnibin\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d726466-e0ff-499c-94bf-0219bf7ba099-kubelet-config\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-systemd\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589437 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-etc-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5fhl\" (UniqueName: \"kubernetes.io/projected/107b0c9c-1d8b-444e-a779-6a7eb2e99815-kube-api-access-d5fhl\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-cni-bin\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589488 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d726466-e0ff-499c-94bf-0219bf7ba099-kubelet-config\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589503 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-run-systemd\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-etc-openvswitch\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-cni-bin\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-daemon-config\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-cni-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589582 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-ovnkube-script-lib\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589623 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-netns\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589636 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-cni-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-kubelet\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589675 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-netns\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-run-netns\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589744 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-kubelet\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/107b0c9c-1d8b-444e-a779-6a7eb2e99815-host\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5719a4b-0bf4-489d-a77a-9181bf0dedb1-agent-certs\") pod \"konnectivity-agent-957mh\" (UID: \"d5719a4b-0bf4-489d-a77a-9181bf0dedb1\") " pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589801 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-host-run-netns\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.589812 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589842 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-daemon-config\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589856 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/107b0c9c-1d8b-444e-a779-6a7eb2e99815-host\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-log-socket\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.589879 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret podName:1d726466-e0ff-499c-94bf-0219bf7ba099 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:17.089861784 +0000 UTC m=+3.072595456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret") pod "global-pull-secret-syncer-766j4" (UID: "1d726466-e0ff-499c-94bf-0219bf7ba099") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:16.590934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589917 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26ff3f59-387b-47ae-9e72-a9923f65f688-log-socket\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589923 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-env-overrides\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589962 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.589990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-cni-multus\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.590032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-conf-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.590039 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.590070 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-multus-certs\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.590106 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs podName:7b1da39f-2765-4aa1-88a8-0fcec7475d0d nodeName:}" failed. No retries permitted until 2026-09-09 23:48:17.090082966 +0000 UTC m=+3.072816629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs") pod "network-metrics-daemon-ntvrv" (UID: "7b1da39f-2765-4aa1-88a8-0fcec7475d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.590112 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-run-multus-certs\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.590147 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-multus-conf-dir\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.590189 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed104fe1-52de-450d-8d73-3e58d95f0efc-host-var-lib-cni-multus\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.590325 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26ff3f59-387b-47ae-9e72-a9923f65f688-env-overrides\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.591600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.591044 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26ff3f59-387b-47ae-9e72-a9923f65f688-ovn-node-metrics-cert\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.592478 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.592457 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5719a4b-0bf4-489d-a77a-9181bf0dedb1-agent-certs\") pod \"konnectivity-agent-957mh\" (UID: \"d5719a4b-0bf4-489d-a77a-9181bf0dedb1\") " pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:16.597264 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.597240 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l74vz\" (UniqueName: \"kubernetes.io/projected/26ff3f59-387b-47ae-9e72-a9923f65f688-kube-api-access-l74vz\") pod \"ovnkube-node-sgdds\" (UID: \"26ff3f59-387b-47ae-9e72-a9923f65f688\") " pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.597370 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.597339 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l48kl\" (UniqueName: \"kubernetes.io/projected/ed104fe1-52de-450d-8d73-3e58d95f0efc-kube-api-access-l48kl\") pod \"multus-76k75\" (UID: \"ed104fe1-52de-450d-8d73-3e58d95f0efc\") " pod="openshift-multus/multus-76k75" Sep 09 23:48:16.597786 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.597655 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfcp2\" (UniqueName: \"kubernetes.io/projected/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-kube-api-access-cfcp2\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:16.598566 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.598459 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhqv\" (UniqueName: \"kubernetes.io/projected/e3890a48-748e-475b-8739-e2c3f45db416-kube-api-access-9jhqv\") pod \"iptables-alerter-rmgpz\" (UID: \"e3890a48-748e-475b-8739-e2c3f45db416\") " pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.599193 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.599174 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5fhl\" (UniqueName: \"kubernetes.io/projected/107b0c9c-1d8b-444e-a779-6a7eb2e99815-kube-api-access-d5fhl\") pod \"node-ca-jjs7w\" (UID: \"107b0c9c-1d8b-444e-a779-6a7eb2e99815\") " pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.623382 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.623316 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:48:16.677488 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.677465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hsg52" Sep 09 23:48:16.684966 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.684945 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" Sep 09 23:48:16.694660 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.694640 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7h6np" Sep 09 23:48:16.700200 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.700181 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6gfn" Sep 09 23:48:16.708744 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.708724 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjs7w" Sep 09 23:48:16.714240 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.714215 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:16.720834 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.720816 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:16.726058 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.726039 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:48:16.726184 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.726171 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rmgpz" Sep 09 23:48:16.732949 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.732931 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-76k75" Sep 09 23:48:16.992946 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:16.992854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:16.993081 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.993015 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:16.993081 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.993035 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:16.993081 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.993046 2556 projected.go:196] Error preparing data for projected volume kube-api-access-k6j2q for pod openshift-network-diagnostics/network-check-target-ssd6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:16.993180 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:16.993100 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q podName:28b2275d-0a9b-4951-8a24-0de2e9e81490 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:17.993083968 +0000 UTC m=+3.975817648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6j2q" (UniqueName: "kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q") pod "network-check-target-ssd6p" (UID: "28b2275d-0a9b-4951-8a24-0de2e9e81490") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:17.093713 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.093680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:17.093899 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.093722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:17.093899 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:17.093832 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:17.094031 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:17.093896 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:17.094031 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:17.093906 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret podName:1d726466-e0ff-499c-94bf-0219bf7ba099 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:18.093877822 +0000 UTC m=+4.076611481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret") pod "global-pull-secret-syncer-766j4" (UID: "1d726466-e0ff-499c-94bf-0219bf7ba099") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:17.094031 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:17.093958 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs podName:7b1da39f-2765-4aa1-88a8-0fcec7475d0d nodeName:}" failed. No retries permitted until 2026-09-09 23:48:18.093941799 +0000 UTC m=+4.076675478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs") pod "network-metrics-daemon-ntvrv" (UID: "7b1da39f-2765-4aa1-88a8-0fcec7475d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:17.409453 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.409423 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5719a4b_0bf4_489d_a77a_9181bf0dedb1.slice/crio-df90ade06042eb9e3ad76dc592fa3fcaf839a959dbeb13f494ad685b20f24093 WatchSource:0}: Error finding container df90ade06042eb9e3ad76dc592fa3fcaf839a959dbeb13f494ad685b20f24093: Status 404 returned error can't find the container with id df90ade06042eb9e3ad76dc592fa3fcaf839a959dbeb13f494ad685b20f24093 Sep 09 23:48:17.412750 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.412699 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:43:16 +0000 UTC" deadline="2028-05-30 23:17:58.305516496 +0000 UTC" Sep 09 23:48:17.412861 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.412751 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15095h29m40.89276978s" Sep 09 23:48:17.413264 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.413119 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107b0c9c_1d8b_444e_a779_6a7eb2e99815.slice/crio-9518d0045e1a049d28687a74dcf387688053a9aaf6de6231b0cd162e5a608248 WatchSource:0}: Error finding container 9518d0045e1a049d28687a74dcf387688053a9aaf6de6231b0cd162e5a608248: Status 404 returned error can't find the container with id 9518d0045e1a049d28687a74dcf387688053a9aaf6de6231b0cd162e5a608248 Sep 09 23:48:17.416323 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.416305 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3890a48_748e_475b_8739_e2c3f45db416.slice/crio-65847a4365a23e4af054c70587d9c25de7c51c676f3c6b0f77a14ffc99a5fc91 WatchSource:0}: Error finding container 65847a4365a23e4af054c70587d9c25de7c51c676f3c6b0f77a14ffc99a5fc91: Status 404 returned error can't find the container with id 65847a4365a23e4af054c70587d9c25de7c51c676f3c6b0f77a14ffc99a5fc91 Sep 09 23:48:17.417180 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.417162 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9a88e9_a1a5_40f8_abe6_ef05a59ce875.slice/crio-cf3a3cc7158e50b539e5137bcd624b66b6063e28e4bb19409f06afa96345fce2 WatchSource:0}: Error finding container cf3a3cc7158e50b539e5137bcd624b66b6063e28e4bb19409f06afa96345fce2: Status 404 returned error can't find the container with id cf3a3cc7158e50b539e5137bcd624b66b6063e28e4bb19409f06afa96345fce2 Sep 09 23:48:17.418332 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.418061 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6257ca7_5c53_45da_8525_315f9698cf0a.slice/crio-56be0acb1d93da0ff0bca029401464600a0dc7d1567c20fb1b49613303775836 WatchSource:0}: Error finding container 56be0acb1d93da0ff0bca029401464600a0dc7d1567c20fb1b49613303775836: Status 404 returned error can't find the container with id 56be0acb1d93da0ff0bca029401464600a0dc7d1567c20fb1b49613303775836 Sep 09 23:48:17.419113 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.418696 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56541eb1_521a_40b3_a12a_5b7a69e3a7dd.slice/crio-87b44b0447a5aa96ffb5e499e53c0ee8490b39c20f026014b29b4837956a14b1 WatchSource:0}: Error finding container 87b44b0447a5aa96ffb5e499e53c0ee8490b39c20f026014b29b4837956a14b1: Status 404 returned error can't find the container with id 87b44b0447a5aa96ffb5e499e53c0ee8490b39c20f026014b29b4837956a14b1 Sep 09 23:48:17.419568 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.419519 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ff3f59_387b_47ae_9e72_a9923f65f688.slice/crio-7581048ac06e4904863df5b83c65d467b711ea43eedb5e94b1ff3f523186689f WatchSource:0}: Error finding container 7581048ac06e4904863df5b83c65d467b711ea43eedb5e94b1ff3f523186689f: Status 404 returned error can't find the container with id 7581048ac06e4904863df5b83c65d467b711ea43eedb5e94b1ff3f523186689f Sep 09 23:48:17.420907 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.420778 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb7d427_1679_4bbd_ab39_f38f8a7d78b5.slice/crio-7f8e3664a5277f2cce6a4c5a3cc2b5a4da9e26a56002ebb5b6404540f6dbf6c1 WatchSource:0}: Error finding container 7f8e3664a5277f2cce6a4c5a3cc2b5a4da9e26a56002ebb5b6404540f6dbf6c1: Status 404 returned error can't find the container with id 7f8e3664a5277f2cce6a4c5a3cc2b5a4da9e26a56002ebb5b6404540f6dbf6c1 Sep 09 23:48:17.421760 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:48:17.421591 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded104fe1_52de_450d_8d73_3e58d95f0efc.slice/crio-7fca02484b326154f95acbb23a842ebf493a79a2a2fe004faafa24dc9f1161c8 WatchSource:0}: Error finding container 7fca02484b326154f95acbb23a842ebf493a79a2a2fe004faafa24dc9f1161c8: Status 404 returned error can't find the container with id 7fca02484b326154f95acbb23a842ebf493a79a2a2fe004faafa24dc9f1161c8 Sep 09 23:48:17.513370 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.513343 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-957mh" event={"ID":"d5719a4b-0bf4-489d-a77a-9181bf0dedb1","Type":"ContainerStarted","Data":"df90ade06042eb9e3ad76dc592fa3fcaf839a959dbeb13f494ad685b20f24093"} Sep 09 23:48:17.514966 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.514937 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsg52" event={"ID":"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5","Type":"ContainerStarted","Data":"7f8e3664a5277f2cce6a4c5a3cc2b5a4da9e26a56002ebb5b6404540f6dbf6c1"} Sep 09 23:48:17.516257 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.516238 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6gfn" event={"ID":"d6257ca7-5c53-45da-8525-315f9698cf0a","Type":"ContainerStarted","Data":"56be0acb1d93da0ff0bca029401464600a0dc7d1567c20fb1b49613303775836"} Sep 09 23:48:17.519252 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.519228 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" event={"ID":"b918f93a5380fe0ffc07a388ced93b00","Type":"ContainerStarted","Data":"9efa6a00a2826d2e02c3c420f0511486033baa43182221ca1dc0a00e0845fd00"} Sep 09 23:48:17.523403 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.523382 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-76k75" event={"ID":"ed104fe1-52de-450d-8d73-3e58d95f0efc","Type":"ContainerStarted","Data":"7fca02484b326154f95acbb23a842ebf493a79a2a2fe004faafa24dc9f1161c8"} Sep 09 23:48:17.524450 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.524426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"7581048ac06e4904863df5b83c65d467b711ea43eedb5e94b1ff3f523186689f"} Sep 09 23:48:17.529695 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.529673 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7h6np" event={"ID":"56541eb1-521a-40b3-a12a-5b7a69e3a7dd","Type":"ContainerStarted","Data":"87b44b0447a5aa96ffb5e499e53c0ee8490b39c20f026014b29b4837956a14b1"} Sep 09 23:48:17.531239 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.531215 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" event={"ID":"af9a88e9-a1a5-40f8-abe6-ef05a59ce875","Type":"ContainerStarted","Data":"cf3a3cc7158e50b539e5137bcd624b66b6063e28e4bb19409f06afa96345fce2"} Sep 09 23:48:17.531753 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.531714 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-250.ec2.internal" podStartSLOduration=2.53170157 podStartE2EDuration="2.53170157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:17.531343976 +0000 UTC m=+3.514077657" watchObservedRunningTime="2026-09-09 23:48:17.53170157 +0000 UTC m=+3.514435250" Sep 09 23:48:17.533180 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.533159 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rmgpz" event={"ID":"e3890a48-748e-475b-8739-e2c3f45db416","Type":"ContainerStarted","Data":"65847a4365a23e4af054c70587d9c25de7c51c676f3c6b0f77a14ffc99a5fc91"} Sep 09 23:48:17.536101 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.536081 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjs7w" event={"ID":"107b0c9c-1d8b-444e-a779-6a7eb2e99815","Type":"ContainerStarted","Data":"9518d0045e1a049d28687a74dcf387688053a9aaf6de6231b0cd162e5a608248"} Sep 09 23:48:17.999847 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:17.999768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:18.000012 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:17.999988 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:18.000012 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.000011 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:18.000137 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.000023 2556 projected.go:196] Error preparing data for projected volume kube-api-access-k6j2q for pod openshift-network-diagnostics/network-check-target-ssd6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:18.000137 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.000080 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q podName:28b2275d-0a9b-4951-8a24-0de2e9e81490 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:20.000061561 +0000 UTC m=+5.982795259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6j2q" (UniqueName: "kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q") pod "network-check-target-ssd6p" (UID: "28b2275d-0a9b-4951-8a24-0de2e9e81490") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:18.100581 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.100539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:18.100581 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.100585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:18.100803 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.100734 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:18.100803 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.100794 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs podName:7b1da39f-2765-4aa1-88a8-0fcec7475d0d nodeName:}" failed. No retries permitted until 2026-09-09 23:48:20.100775691 +0000 UTC m=+6.083509356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs") pod "network-metrics-daemon-ntvrv" (UID: "7b1da39f-2765-4aa1-88a8-0fcec7475d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:18.101226 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.101198 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:18.101316 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.101253 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret podName:1d726466-e0ff-499c-94bf-0219bf7ba099 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:20.101238188 +0000 UTC m=+6.083971849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret") pod "global-pull-secret-syncer-766j4" (UID: "1d726466-e0ff-499c-94bf-0219bf7ba099") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:18.413098 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.412993 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:43:16 +0000 UTC" deadline="2028-03-01 00:06:18.989730571 +0000 UTC" Sep 09 23:48:18.413098 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.413028 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12912h18m0.576706679s" Sep 09 23:48:18.506491 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.506435 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:18.506648 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.506556 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:18.507012 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.506946 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:18.507095 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.507040 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:18.507150 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.507107 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:18.507202 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:18.507185 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:18.547645 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.547612 2556 generic.go:356] "Generic (PLEG): container finished" podID="1fb08136825eb2ae62fa73ecf8896a9e" containerID="cc8ba9275577075fc0e7b1ce434aa3c86fd6281966db07155ddf67889036af27" exitCode=0 Sep 09 23:48:18.548653 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:18.548583 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" event={"ID":"1fb08136825eb2ae62fa73ecf8896a9e","Type":"ContainerDied","Data":"cc8ba9275577075fc0e7b1ce434aa3c86fd6281966db07155ddf67889036af27"} Sep 09 23:48:19.591447 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:19.590535 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" event={"ID":"1fb08136825eb2ae62fa73ecf8896a9e","Type":"ContainerStarted","Data":"a5c1af429368661041f9285fc8c41b2fa2833b0fb6c8f8536879d2d24a6c4273"} Sep 09 23:48:20.019143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:20.018412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:20.019143 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.018620 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:20.019143 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.018642 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:20.019143 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.018655 2556 projected.go:196] Error preparing data for projected volume kube-api-access-k6j2q for pod openshift-network-diagnostics/network-check-target-ssd6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:20.019143 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.018728 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q podName:28b2275d-0a9b-4951-8a24-0de2e9e81490 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:24.018696017 +0000 UTC m=+10.001429681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6j2q" (UniqueName: "kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q") pod "network-check-target-ssd6p" (UID: "28b2275d-0a9b-4951-8a24-0de2e9e81490") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:20.119069 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:20.119004 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:20.119069 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:20.119057 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:20.119308 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.119199 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:20.119308 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.119266 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs podName:7b1da39f-2765-4aa1-88a8-0fcec7475d0d nodeName:}" failed. No retries permitted until 2026-09-09 23:48:24.119246301 +0000 UTC m=+10.101979960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs") pod "network-metrics-daemon-ntvrv" (UID: "7b1da39f-2765-4aa1-88a8-0fcec7475d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:20.119855 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.119659 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:20.119855 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.119746 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret podName:1d726466-e0ff-499c-94bf-0219bf7ba099 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:24.119700044 +0000 UTC m=+10.102433718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret") pod "global-pull-secret-syncer-766j4" (UID: "1d726466-e0ff-499c-94bf-0219bf7ba099") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:20.504099 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:20.504019 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:20.504099 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:20.504062 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:20.504317 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:20.504019 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:20.504317 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.504160 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:20.504317 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.504268 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:20.504527 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:20.504342 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:22.504376 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:22.504341 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:22.504803 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:22.504342 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:22.504803 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:22.504475 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:22.504803 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:22.504508 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:22.504803 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:22.504352 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:22.504803 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:22.504651 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:24.049790 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:24.049744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:24.050277 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.050005 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:24.050277 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.050024 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:24.050277 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.050033 2556 projected.go:196] Error preparing data for projected volume kube-api-access-k6j2q for pod openshift-network-diagnostics/network-check-target-ssd6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:24.050277 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.050091 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q podName:28b2275d-0a9b-4951-8a24-0de2e9e81490 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:32.050075369 +0000 UTC m=+18.032809051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6j2q" (UniqueName: "kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q") pod "network-check-target-ssd6p" (UID: "28b2275d-0a9b-4951-8a24-0de2e9e81490") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:24.150389 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:24.150344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:24.150539 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:24.150399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:24.150603 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.150535 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:24.150603 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.150595 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs podName:7b1da39f-2765-4aa1-88a8-0fcec7475d0d nodeName:}" failed. No retries permitted until 2026-09-09 23:48:32.150577222 +0000 UTC m=+18.133310883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs") pod "network-metrics-daemon-ntvrv" (UID: "7b1da39f-2765-4aa1-88a8-0fcec7475d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:24.151056 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.151032 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:24.151142 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.151100 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret podName:1d726466-e0ff-499c-94bf-0219bf7ba099 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:32.151086379 +0000 UTC m=+18.133820051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret") pod "global-pull-secret-syncer-766j4" (UID: "1d726466-e0ff-499c-94bf-0219bf7ba099") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:24.504718 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:24.504636 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:24.504718 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:24.504710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:24.504967 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.504727 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:24.504967 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.504820 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:24.504967 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:24.504903 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:24.505126 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:24.505009 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:26.504739 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:26.504658 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:26.504739 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:26.504702 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:26.505430 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:26.504668 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:26.505430 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:26.504793 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:26.505430 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:26.504966 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:26.505430 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:26.505045 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:28.504485 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:28.504295 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:28.504926 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:28.504295 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:28.504926 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:28.504588 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:28.504926 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:28.504363 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:28.504926 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:28.504668 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:28.504926 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:28.504702 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:30.504572 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:30.504535 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:30.505045 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:30.504535 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:30.505045 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:30.504666 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:30.505045 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:30.504743 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:30.505045 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:30.504536 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:30.505045 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:30.504849 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:32.107195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:32.107154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:32.107631 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.107309 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:32.107631 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.107336 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:32.107631 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.107350 2556 projected.go:196] Error preparing data for projected volume kube-api-access-k6j2q for pod openshift-network-diagnostics/network-check-target-ssd6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:32.107631 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.107418 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q podName:28b2275d-0a9b-4951-8a24-0de2e9e81490 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:48.107399058 +0000 UTC m=+34.090132722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6j2q" (UniqueName: "kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q") pod "network-check-target-ssd6p" (UID: "28b2275d-0a9b-4951-8a24-0de2e9e81490") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:32.208556 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:32.208522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:32.208556 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:32.208561 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:32.208777 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.208677 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:32.208777 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.208691 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:32.208777 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.208731 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs podName:7b1da39f-2765-4aa1-88a8-0fcec7475d0d nodeName:}" failed. No retries permitted until 2026-09-09 23:48:48.20871712 +0000 UTC m=+34.191450779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs") pod "network-metrics-daemon-ntvrv" (UID: "7b1da39f-2765-4aa1-88a8-0fcec7475d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:32.208777 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.208756 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret podName:1d726466-e0ff-499c-94bf-0219bf7ba099 nodeName:}" failed. No retries permitted until 2026-09-09 23:48:48.208738227 +0000 UTC m=+34.191471889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret") pod "global-pull-secret-syncer-766j4" (UID: "1d726466-e0ff-499c-94bf-0219bf7ba099") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:32.504475 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:32.504440 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:32.504665 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:32.504445 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:32.504665 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.504580 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:32.504771 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.504722 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:32.504815 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:32.504765 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:32.504875 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:32.504857 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:34.507162 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:34.507129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:34.507539 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:34.507174 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:34.507539 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:34.507173 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:34.507539 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:34.507257 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:34.507539 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:34.507329 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:34.507539 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:34.507403 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:35.625235 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.625028 2556 generic.go:356] "Generic (PLEG): container finished" podID="5fb7d427-1679-4bbd-ab39-f38f8a7d78b5" containerID="599095c1ccaa9cbc6d0c3ab0dc80a3ee13831fba126c94b84643a8dd8ae6a15f" exitCode=0 Sep 09 23:48:35.625235 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.625108 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsg52" event={"ID":"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5","Type":"ContainerDied","Data":"599095c1ccaa9cbc6d0c3ab0dc80a3ee13831fba126c94b84643a8dd8ae6a15f"} Sep 09 23:48:35.627011 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.626983 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6gfn" event={"ID":"d6257ca7-5c53-45da-8525-315f9698cf0a","Type":"ContainerStarted","Data":"98a701a53e8fdec3a8687eb21bb3958709c91dd354c7d917291c32071eef4d50"} Sep 09 23:48:35.628521 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.628493 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-76k75" event={"ID":"ed104fe1-52de-450d-8d73-3e58d95f0efc","Type":"ContainerStarted","Data":"fc5f83abd7a2d570588d4f4ffa4d10f0dd3c093c4acd3747a9d58454a8d7f311"} Sep 09 23:48:35.631554 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.631529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"595ba302a46fdf26f2380533bec529c3af0212cbec46dd06c06c9acca6b0e6c0"} Sep 09 23:48:35.631656 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.631593 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"ca3d2bbb137c90c413e65bb68160dbbdb3bf7448aed25747aaa4587978d491ef"} Sep 09 23:48:35.631656 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.631638 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"a3f146348044be1331176d65af41c61f730f737757ed911b942d52b2fef1657b"} Sep 09 23:48:35.631759 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.631668 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"cae934a945d6e72685eeeffa75a86300e63fe3c0d6280c5355d039c8e69f1642"} Sep 09 23:48:35.631759 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.631696 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"55d88b26291a5a4b43f30c04e04164b545d5846b897a6d25cfd10fb713eed294"} Sep 09 23:48:35.631759 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.631740 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"940d044bcaf3c33ad80ef7cb287e664913932b41097da79c91b8b3edc0bfec33"} Sep 09 23:48:35.632957 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.632934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7h6np" event={"ID":"56541eb1-521a-40b3-a12a-5b7a69e3a7dd","Type":"ContainerStarted","Data":"0c5ca77d256d910980d69aed80514e8b1301a2e502004af1ed103d7303934fd0"} Sep 09 23:48:35.634303 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.634283 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" event={"ID":"af9a88e9-a1a5-40f8-abe6-ef05a59ce875","Type":"ContainerStarted","Data":"597887b123552f72b15c53e6de693710d4e290b026785721e60acfde56333da0"} Sep 09 23:48:35.635558 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.635537 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjs7w" event={"ID":"107b0c9c-1d8b-444e-a779-6a7eb2e99815","Type":"ContainerStarted","Data":"ba420eb40e7b1c1ba92b415158ae8d8a564d136fead8dd796e1b66c5bd042f61"} Sep 09 23:48:35.636856 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.636837 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-957mh" event={"ID":"d5719a4b-0bf4-489d-a77a-9181bf0dedb1","Type":"ContainerStarted","Data":"68c20bb20c53c6948fe5feb30c45dc70020c4875f89f7b26cca0e73ff9a2804c"} Sep 09 23:48:35.644261 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.644220 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-250.ec2.internal" podStartSLOduration=20.644207938 podStartE2EDuration="20.644207938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:19.609030902 +0000 UTC m=+5.591764595" watchObservedRunningTime="2026-09-09 23:48:35.644207938 +0000 UTC m=+21.626941616" Sep 09 23:48:35.659440 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.659396 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7h6np" podStartSLOduration=4.426804492 podStartE2EDuration="21.659380942s" totalImagesPullingTime="17.23257645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.658792068 +0000 UTC m=+21.641525749" watchObservedRunningTime="2026-09-09 23:48:35.659380942 +0000 UTC m=+21.642114621" Sep 09 23:48:35.672012 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.671965 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c6gfn" podStartSLOduration=4.439475939 podStartE2EDuration="21.671942364s" totalImagesPullingTime="17.232466425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.671819193 +0000 UTC m=+21.654552876" watchObservedRunningTime="2026-09-09 23:48:35.671942364 +0000 UTC m=+21.654676043" Sep 09 23:48:35.684662 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.684607 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-957mh" podStartSLOduration=7.9225383780000005 podStartE2EDuration="21.684598096s" totalImagesPullingTime="13.762059718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.684051833 +0000 UTC m=+21.666785512" watchObservedRunningTime="2026-09-09 23:48:35.684598096 +0000 UTC m=+21.667331776" Sep 09 23:48:35.696127 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.696086 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jjs7w" podStartSLOduration=4.458302885 podStartE2EDuration="21.696072623s" totalImagesPullingTime="17.237769738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.695559106 +0000 UTC m=+21.678292790" watchObservedRunningTime="2026-09-09 23:48:35.696072623 +0000 UTC m=+21.678806303" Sep 09 23:48:35.710684 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.710634 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-76k75" podStartSLOduration=4.424089048 podStartE2EDuration="21.710616719s" totalImagesPullingTime="17.286527671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:35.710062499 +0000 UTC m=+21.692796182" watchObservedRunningTime="2026-09-09 23:48:35.710616719 +0000 UTC m=+21.693350402" Sep 09 23:48:35.854605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.854572 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:35.929530 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:35.929498 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:36.032115 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.032087 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:36.101621 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.101589 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:36.412316 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.412109 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:48:36.437819 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.437526 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:48:36.412311021Z","UUID":"ebd087ce-4717-433d-9d13-0f015fa7e619","Handler":null,"Name":"","Endpoint":""} Sep 09 23:48:36.439643 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.439366 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:36.439756 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.439721 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:48:36.439756 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.439749 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:48:36.504355 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.504320 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:36.504524 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.504325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:36.504524 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:36.504441 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:36.504524 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.504452 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:36.504685 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:36.504544 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:36.504685 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:36.504655 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:36.640861 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.640749 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" event={"ID":"af9a88e9-a1a5-40f8-abe6-ef05a59ce875","Type":"ContainerStarted","Data":"c78ea3a2f2009b9f7d56f15a2fd2e549cfd0ebc38a1409bbebce05bc5867d996"} Sep 09 23:48:36.642456 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.642419 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rmgpz" event={"ID":"e3890a48-748e-475b-8739-e2c3f45db416","Type":"ContainerStarted","Data":"05a947334e2559a9ab055395060a9df77000ec8696421a60e9376273a79adc2b"} Sep 09 23:48:36.655816 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.655757 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rmgpz" podStartSLOduration=8.901014953 podStartE2EDuration="22.655742778s" totalImagesPullingTime="13.754727825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:36.655517903 +0000 UTC m=+22.638251584" watchObservedRunningTime="2026-09-09 23:48:36.655742778 +0000 UTC m=+22.638476459" Sep 09 23:48:36.772522 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.772492 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:36.872594 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.872547 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:36.974750 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:36.974710 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:37.224468 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.224409 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:37.225147 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.225092 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:37.321856 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.321823 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:37.421267 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.421244 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:37.528534 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.528418 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:37.647248 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.647210 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" event={"ID":"af9a88e9-a1a5-40f8-abe6-ef05a59ce875","Type":"ContainerStarted","Data":"7747f6852a4f1d8417742b306e913712cb01e8d59a8af32530daae8c3f6ad8c9"} Sep 09 23:48:37.651283 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.651246 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"1c64246286f902fb715f9dcd3f864197a22e2ad1cf74fe1500a5a4f92f2b26d5"} Sep 09 23:48:37.651651 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.651595 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:37.652143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.652118 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-957mh" Sep 09 23:48:37.665513 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.665460 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqmgl" podStartSLOduration=4.123833141 podStartE2EDuration="23.665442911s" totalImagesPullingTime="19.54160977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:37.665077125 +0000 UTC m=+23.647810808" watchObservedRunningTime="2026-09-09 23:48:37.665442911 +0000 UTC m=+23.648176597" Sep 09 23:48:37.729455 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:37.729424 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:38.278769 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:38.278732 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:38.342827 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:38.342799 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:38.397839 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:38.397802 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:38.507934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:38.507904 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:38.508127 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:38.507998 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:38.508127 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:38.508007 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:38.508127 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:38.508027 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:38.508127 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:38.508116 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:38.508317 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:38.508213 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:39.171554 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:39.171519 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:40.502267 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.502100 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:40.506864 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.506846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:40.506988 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.506978 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:40.507023 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:40.506992 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:40.507061 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:40.507050 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:40.507091 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.507082 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:40.507161 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:40.507148 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:40.659700 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.659674 2556 generic.go:356] "Generic (PLEG): container finished" podID="5fb7d427-1679-4bbd-ab39-f38f8a7d78b5" containerID="6adc0123017afedd7309aa2b0189408fde63f5c899fa913bd66c2d65679bf21c" exitCode=0 Sep 09 23:48:40.659865 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.659755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsg52" event={"ID":"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5","Type":"ContainerDied","Data":"6adc0123017afedd7309aa2b0189408fde63f5c899fa913bd66c2d65679bf21c"} Sep 09 23:48:40.663995 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.663961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" event={"ID":"26ff3f59-387b-47ae-9e72-a9923f65f688","Type":"ContainerStarted","Data":"c43d27debe689e312bb24cd05c6aaefd8656cb16f7767c0c84393244c28fd771"} Sep 09 23:48:40.666271 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.664867 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:40.666271 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.665119 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:40.681423 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.681403 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:40.681542 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.681489 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:40.686197 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.686176 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:40.710054 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.710015 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" podStartSLOduration=9.421415223 podStartE2EDuration="26.710001376s" totalImagesPullingTime="17.288586153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:40.709767249 +0000 UTC m=+26.692500930" watchObservedRunningTime="2026-09-09 23:48:40.710001376 +0000 UTC m=+26.692735057" Sep 09 23:48:40.862947 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.862843 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:40.988867 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:40.988836 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:41.116070 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:41.116000 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:41.293421 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:41.293384 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:41.392728 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:41.392702 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:41.605654 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:41.605629 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:41.666549 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:41.666480 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 23:48:41.706072 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:41.706044 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:42.507114 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:42.507087 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:42.507262 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:42.507179 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:42.507262 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:42.507201 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:42.507262 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:42.507196 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:42.507363 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:42.507271 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:42.507363 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:42.507354 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:42.599480 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:42.599452 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:42.671021 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:42.670994 2556 generic.go:356] "Generic (PLEG): container finished" podID="5fb7d427-1679-4bbd-ab39-f38f8a7d78b5" containerID="c84af0d00b61d1614c818ea609967d8286e251bf877495ff8754dd0a2a2bde9d" exitCode=0 Sep 09 23:48:42.671575 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:42.671055 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsg52" event={"ID":"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5","Type":"ContainerDied","Data":"c84af0d00b61d1614c818ea609967d8286e251bf877495ff8754dd0a2a2bde9d"} Sep 09 23:48:42.671575 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:42.671126 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 23:48:42.794992 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:42.794921 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:43.194970 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:43.194940 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:43.399095 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:43.399061 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:43.451407 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:43.451341 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:43.992485 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:43.992404 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:44.388519 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.388427 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:44.445281 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.445252 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:44.506764 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.506737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:44.506908 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.506737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:44.506908 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:44.506828 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:44.507004 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.506744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:44.507004 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:44.506921 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:44.507004 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:44.506992 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:44.679781 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.679751 2556 generic.go:356] "Generic (PLEG): container finished" podID="5fb7d427-1679-4bbd-ab39-f38f8a7d78b5" containerID="db141436fbfde8e330ee510795b153df5c8eb77fbc4ccbef8833cbfef5a5a191" exitCode=0 Sep 09 23:48:44.679951 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.679794 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsg52" event={"ID":"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5","Type":"ContainerDied","Data":"db141436fbfde8e330ee510795b153df5c8eb77fbc4ccbef8833cbfef5a5a191"} Sep 09 23:48:44.681103 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.681075 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:44.791138 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.791106 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:44.824275 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.824252 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:48:44.824477 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.824453 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 23:48:44.839340 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.839305 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" podUID="26ff3f59-387b-47ae-9e72-a9923f65f688" containerName="ovnkube-controller" probeResult="failure" output="" Sep 09 23:48:44.848126 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.848101 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" podUID="26ff3f59-387b-47ae-9e72-a9923f65f688" containerName="ovnkube-controller" probeResult="failure" output="" Sep 09 23:48:44.993126 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:44.993049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:45.595860 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:45.595817 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:45.695684 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:45.695648 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:45.942111 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:45.942075 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:46.198867 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:46.198779 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:46.394638 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:46.394611 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:46.504830 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:46.504749 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:46.504830 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:46.504764 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:46.505032 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:46.504883 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:46.505032 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:46.504928 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:46.505032 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:46.505020 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:46.505174 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:46.505144 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:46.598583 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:46.598546 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:46.799243 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:46.799170 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:47.265555 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:47.265513 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:47.367335 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:47.367292 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:47.794121 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:47.794036 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:47.996606 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:47.996567 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:48.123063 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.122993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:48.123206 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.123139 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:48:48.123206 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.123158 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:48:48.123206 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.123168 2556 projected.go:196] Error preparing data for projected volume kube-api-access-k6j2q for pod openshift-network-diagnostics/network-check-target-ssd6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:48.123338 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.123233 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q podName:28b2275d-0a9b-4951-8a24-0de2e9e81490 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:20.123213138 +0000 UTC m=+66.105946824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6j2q" (UniqueName: "kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q") pod "network-check-target-ssd6p" (UID: "28b2275d-0a9b-4951-8a24-0de2e9e81490") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:48:48.196649 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.196607 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:48.223437 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.223402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:48.223614 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.223511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:48.223614 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.223553 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:48.223614 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.223581 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:48.223750 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.223621 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret podName:1d726466-e0ff-499c-94bf-0219bf7ba099 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:20.223604814 +0000 UTC m=+66.206338489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret") pod "global-pull-secret-syncer-766j4" (UID: "1d726466-e0ff-499c-94bf-0219bf7ba099") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:48:48.223750 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.223639 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs podName:7b1da39f-2765-4aa1-88a8-0fcec7475d0d nodeName:}" failed. No retries permitted until 2026-09-09 23:49:20.223629668 +0000 UTC m=+66.206363331 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs") pod "network-metrics-daemon-ntvrv" (UID: "7b1da39f-2765-4aa1-88a8-0fcec7475d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:48:48.398344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.398311 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:48.504162 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.504088 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:48.504162 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.504117 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:48.504397 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.504094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:48.504397 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.504223 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:48.504636 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.504283 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:48.504777 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:48.504735 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:48.596350 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.596321 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:48.801358 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.801191 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:48.999481 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:48.999407 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:49.056436 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:49.056402 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:49.602378 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:49.602352 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:49.693486 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:49.693459 2556 generic.go:356] "Generic (PLEG): container finished" podID="5fb7d427-1679-4bbd-ab39-f38f8a7d78b5" containerID="c6085c3b2ab66e349f5d403d48c50d99795889219b64f715dfbf61e32daee46f" exitCode=0 Sep 09 23:48:49.693616 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:49.693501 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsg52" event={"ID":"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5","Type":"ContainerDied","Data":"c6085c3b2ab66e349f5d403d48c50d99795889219b64f715dfbf61e32daee46f"} Sep 09 23:48:50.190830 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.190799 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:50.408539 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.408507 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:50.507143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.507069 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:50.507309 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.507069 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:50.507309 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:50.507166 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:50.507309 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.507069 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:50.507309 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:50.507261 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:50.507449 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:50.507347 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:50.597597 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.597565 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:50.698816 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.698784 2556 generic.go:356] "Generic (PLEG): container finished" podID="5fb7d427-1679-4bbd-ab39-f38f8a7d78b5" containerID="8a41f1553132f09e16e343442b60b9b71ce8c31a353508e3afbcb0182f6d8c4f" exitCode=0 Sep 09 23:48:50.699185 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.698824 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsg52" event={"ID":"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5","Type":"ContainerDied","Data":"8a41f1553132f09e16e343442b60b9b71ce8c31a353508e3afbcb0182f6d8c4f"} Sep 09 23:48:50.792128 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:50.792091 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:51.704854 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:51.704811 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsg52" event={"ID":"5fb7d427-1679-4bbd-ab39-f38f8a7d78b5","Type":"ContainerStarted","Data":"92b3f903037261077bd73b288dd23e2edfdd960cde5a71917e4d38de8e52bfbf"} Sep 09 23:48:51.725924 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:51.725867 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hsg52" podStartSLOduration=9.956006915 podStartE2EDuration="37.72585369s" totalImagesPullingTime="27.769846775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:48:51.724481449 +0000 UTC m=+37.707215126" watchObservedRunningTime="2026-09-09 23:48:51.72585369 +0000 UTC m=+37.708587371" Sep 09 23:48:52.504647 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:52.504610 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:52.504824 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:52.504611 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:52.504824 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:52.504718 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:52.504824 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:52.504807 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:52.504981 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:52.504622 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:52.504981 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:52.504934 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:54.504705 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:54.504677 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:54.504705 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:54.504687 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:54.505169 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:54.504766 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:54.505169 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:54.504841 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:54.505169 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:54.504861 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:54.505169 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:54.504957 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:56.504139 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:56.504104 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:56.504503 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:56.504104 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:56.504503 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:56.504218 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:56.504503 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:56.504298 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:56.504503 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:56.504112 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:56.504503 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:56.504373 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:57.136439 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.136368 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:57.227682 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.227647 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:57.327238 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.327212 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:57.425264 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.425232 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:57.821984 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.821954 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssd6p"] Sep 09 23:48:57.822473 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.822127 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:57.822473 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:57.822234 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:57.825154 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.825124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ntvrv"] Sep 09 23:48:57.825768 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.825256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:57.825768 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:57.825366 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:48:57.825931 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.825830 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-766j4"] Sep 09 23:48:57.826003 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:57.825985 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:57.826117 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:57.826097 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:58.223072 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:58.223043 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:58.317827 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:58.317750 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:48:59.504587 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:59.504562 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:48:59.504991 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:59.504561 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:48:59.504991 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:59.504661 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssd6p" podUID="28b2275d-0a9b-4951-8a24-0de2e9e81490" Sep 09 23:48:59.504991 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:48:59.504561 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:48:59.504991 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:59.504736 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-766j4" podUID="1d726466-e0ff-499c-94bf-0219bf7ba099" Sep 09 23:48:59.504991 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:48:59.504804 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ntvrv" podUID="7b1da39f-2765-4aa1-88a8-0fcec7475d0d" Sep 09 23:49:01.289764 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.289604 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-250.ec2.internal" event="NodeReady" Sep 09 23:49:01.290121 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.289860 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:49:01.332022 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.331992 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8pb49"] Sep 09 23:49:01.337805 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.337782 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bv79j"] Sep 09 23:49:01.337943 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.337922 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.340448 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.340426 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:49:01.340559 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.340504 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:49:01.340559 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.340505 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ccffp\"" Sep 09 23:49:01.344298 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.343877 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bv79j" Sep 09 23:49:01.344541 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.344518 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8pb49"] Sep 09 23:49:01.346179 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.346160 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:49:01.346289 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.346160 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:49:01.346289 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.346166 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:49:01.346289 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.346269 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2qmv7\"" Sep 09 23:49:01.356427 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.356406 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bv79j"] Sep 09 23:49:01.415904 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.415856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44c8780f-62ae-4022-8f81-3882e138ea9b-tmp-dir\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.416035 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.415916 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv446\" (UniqueName: \"kubernetes.io/projected/39418259-15c3-4964-a968-fc94cdb1d7bd-kube-api-access-cv446\") pod \"ingress-canary-bv79j\" (UID: \"39418259-15c3-4964-a968-fc94cdb1d7bd\") " pod="openshift-ingress-canary/ingress-canary-bv79j" Sep 09 23:49:01.416035 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.415936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44c8780f-62ae-4022-8f81-3882e138ea9b-metrics-tls\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.416035 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.415958 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39418259-15c3-4964-a968-fc94cdb1d7bd-cert\") pod \"ingress-canary-bv79j\" (UID: \"39418259-15c3-4964-a968-fc94cdb1d7bd\") " pod="openshift-ingress-canary/ingress-canary-bv79j" Sep 09 23:49:01.416035 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.415978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t994s\" (UniqueName: \"kubernetes.io/projected/44c8780f-62ae-4022-8f81-3882e138ea9b-kube-api-access-t994s\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.416158 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.416065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44c8780f-62ae-4022-8f81-3882e138ea9b-config-volume\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.454576 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.454513 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:01.504483 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.504455 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:49:01.504558 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.504490 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:49:01.504558 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.504470 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:49:01.507231 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.507208 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:49:01.507344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.507274 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:49:01.507344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.507277 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:49:01.507344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.507308 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7wg5\"" Sep 09 23:49:01.507344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.507333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:49:01.507511 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.507462 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7tkk\"" Sep 09 23:49:01.512203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.512181 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:01.516322 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.516304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44c8780f-62ae-4022-8f81-3882e138ea9b-tmp-dir\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.516390 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.516348 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv446\" (UniqueName: \"kubernetes.io/projected/39418259-15c3-4964-a968-fc94cdb1d7bd-kube-api-access-cv446\") pod \"ingress-canary-bv79j\" (UID: \"39418259-15c3-4964-a968-fc94cdb1d7bd\") " pod="openshift-ingress-canary/ingress-canary-bv79j" Sep 09 23:49:01.516390 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.516373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44c8780f-62ae-4022-8f81-3882e138ea9b-metrics-tls\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.516620 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.516495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39418259-15c3-4964-a968-fc94cdb1d7bd-cert\") pod \"ingress-canary-bv79j\" (UID: \"39418259-15c3-4964-a968-fc94cdb1d7bd\") " pod="openshift-ingress-canary/ingress-canary-bv79j" Sep 09 23:49:01.516620 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.516550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t994s\" (UniqueName: \"kubernetes.io/projected/44c8780f-62ae-4022-8f81-3882e138ea9b-kube-api-access-t994s\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.516731 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.516647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44c8780f-62ae-4022-8f81-3882e138ea9b-config-volume\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.516731 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.516700 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44c8780f-62ae-4022-8f81-3882e138ea9b-tmp-dir\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.517244 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.517222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44c8780f-62ae-4022-8f81-3882e138ea9b-config-volume\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.520289 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.520268 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39418259-15c3-4964-a968-fc94cdb1d7bd-cert\") pod \"ingress-canary-bv79j\" (UID: \"39418259-15c3-4964-a968-fc94cdb1d7bd\") " pod="openshift-ingress-canary/ingress-canary-bv79j" Sep 09 23:49:01.520289 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.520280 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44c8780f-62ae-4022-8f81-3882e138ea9b-metrics-tls\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.523272 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.523249 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t994s\" (UniqueName: \"kubernetes.io/projected/44c8780f-62ae-4022-8f81-3882e138ea9b-kube-api-access-t994s\") pod \"dns-default-8pb49\" (UID: \"44c8780f-62ae-4022-8f81-3882e138ea9b\") " pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.523574 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.523556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv446\" (UniqueName: \"kubernetes.io/projected/39418259-15c3-4964-a968-fc94cdb1d7bd-kube-api-access-cv446\") pod \"ingress-canary-bv79j\" (UID: \"39418259-15c3-4964-a968-fc94cdb1d7bd\") " pod="openshift-ingress-canary/ingress-canary-bv79j" Sep 09 23:49:01.648430 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.648393 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:01.654506 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.654481 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bv79j" Sep 09 23:49:01.979113 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.978850 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bv79j"] Sep 09 23:49:01.981704 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:01.981677 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8pb49"] Sep 09 23:49:01.984804 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:01.984782 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c8780f_62ae_4022_8f81_3882e138ea9b.slice/crio-7578aaf55e1ccfc514bd2814195657baffd037546f93ec6886c5d5eb81c8c01a WatchSource:0}: Error finding container 7578aaf55e1ccfc514bd2814195657baffd037546f93ec6886c5d5eb81c8c01a: Status 404 returned error can't find the container with id 7578aaf55e1ccfc514bd2814195657baffd037546f93ec6886c5d5eb81c8c01a Sep 09 23:49:02.733713 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.733674 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bv79j" event={"ID":"39418259-15c3-4964-a968-fc94cdb1d7bd","Type":"ContainerStarted","Data":"b800fbdc3aa621d5e6af2ddd0bcecacf89335d4b6fe8aadf7321140465e3f4fa"} Sep 09 23:49:02.735104 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.735049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pb49" event={"ID":"44c8780f-62ae-4022-8f81-3882e138ea9b","Type":"ContainerStarted","Data":"7578aaf55e1ccfc514bd2814195657baffd037546f93ec6886c5d5eb81c8c01a"} Sep 09 23:49:02.791177 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.791140 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:02.888271 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.888235 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:02.965957 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.965917 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:02.968542 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.968446 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9"] Sep 09 23:49:02.979852 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.979824 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" Sep 09 23:49:02.979996 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.979907 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9"] Sep 09 23:49:02.982009 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.981983 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 09 23:49:02.982275 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:02.982258 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7wmmv\"" Sep 09 23:49:03.129600 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.129487 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6c040b47-6e07-4e41-9528-72c18d174f81-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8mgq9\" (UID: \"6c040b47-6e07-4e41-9528-72c18d174f81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" Sep 09 23:49:03.217646 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.217610 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n6d22"] Sep 09 23:49:03.231612 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.231486 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6c040b47-6e07-4e41-9528-72c18d174f81-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8mgq9\" (UID: \"6c040b47-6e07-4e41-9528-72c18d174f81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" Sep 09 23:49:03.234597 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.234569 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6c040b47-6e07-4e41-9528-72c18d174f81-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-8mgq9\" (UID: \"6c040b47-6e07-4e41-9528-72c18d174f81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" Sep 09 23:49:03.237292 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.237262 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:03.238779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.238698 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n6d22"] Sep 09 23:49:03.238779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.238756 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.241186 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.241162 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:49:03.241354 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.241336 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:49:03.241436 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.241381 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:49:03.241706 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.241679 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rjj8g\"" Sep 09 23:49:03.242627 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.242605 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:49:03.292263 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.292206 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" Sep 09 23:49:03.312569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.312539 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:03.333033 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.333001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-data-volume\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.333177 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.333052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89k6\" (UniqueName: \"kubernetes.io/projected/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-api-access-l89k6\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.333177 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.333091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-crio-socket\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.333177 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.333114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.333177 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.333136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.419476 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.419389 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:03.433570 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.433542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-crio-socket\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.433734 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.433581 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.433734 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.433611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.433734 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:03.433685 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:49:03.433734 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.433699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-data-volume\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.433734 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.433701 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-crio-socket\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.433734 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.433726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l89k6\" (UniqueName: \"kubernetes.io/projected/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-api-access-l89k6\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.434073 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:03.433768 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm podName:22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:03.93373882 +0000 UTC m=+49.916472530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n6d22" (UID: "22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8") : configmap "kube-rbac-proxy" not found Sep 09 23:49:03.434073 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:03.433798 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:49:03.434073 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:03.433863 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls podName:22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:03.933844771 +0000 UTC m=+49.916578452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n6d22" (UID: "22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8") : secret "insights-runtime-extractor-tls" not found Sep 09 23:49:03.434073 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.434029 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-data-volume\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.444513 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.444492 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89k6\" (UniqueName: \"kubernetes.io/projected/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-api-access-l89k6\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.502104 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.501999 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:03.601559 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.601518 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:03.783069 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.782985 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:03.843550 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.843507 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:03.937290 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.937257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.937448 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.937301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:03.937448 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:03.937391 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:49:03.937448 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:03.937445 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:49:03.937591 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:03.937461 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm podName:22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:04.937441744 +0000 UTC m=+50.920175420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n6d22" (UID: "22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8") : configmap "kube-rbac-proxy" not found Sep 09 23:49:03.937591 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:03.937481 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls podName:22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:04.937470639 +0000 UTC m=+50.920204309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n6d22" (UID: "22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8") : secret "insights-runtime-extractor-tls" not found Sep 09 23:49:03.974484 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:03.974448 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:04.029367 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:04.029332 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:04.168774 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:04.168736 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:04.218907 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:04.218846 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:04.950449 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:04.946701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:04.950449 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:04.948810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:04.950449 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:04.947336 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:49:04.950449 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:04.949046 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm podName:22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:06.949018825 +0000 UTC m=+52.931752502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n6d22" (UID: "22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8") : configmap "kube-rbac-proxy" not found Sep 09 23:49:04.950449 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:04.949078 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:49:04.950449 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:04.949149 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls podName:22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:06.949130658 +0000 UTC m=+52.931864331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n6d22" (UID: "22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8") : secret "insights-runtime-extractor-tls" not found Sep 09 23:49:04.998962 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:04.998940 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6gfn_d6257ca7-5c53-45da-8525-315f9698cf0a/dns-node-resolver/0.log" Sep 09 23:49:05.159842 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.159800 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9"] Sep 09 23:49:05.183707 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.183676 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:05.390706 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.390501 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:05.658143 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.658107 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:05.743704 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.743645 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bv79j" event={"ID":"39418259-15c3-4964-a968-fc94cdb1d7bd","Type":"ContainerStarted","Data":"6be45a5fef8d0d34e62be5421040bae6218925b4ee9122251e86897dee08f6c0"} Sep 09 23:49:05.745549 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.745512 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pb49" event={"ID":"44c8780f-62ae-4022-8f81-3882e138ea9b","Type":"ContainerStarted","Data":"bfe70bd23755b9aeccf43236efde2bfaecc28c364a33359bd7a26bb15e6ea9c0"} Sep 09 23:49:05.745678 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.745584 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:05.745678 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.745611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pb49" event={"ID":"44c8780f-62ae-4022-8f81-3882e138ea9b","Type":"ContainerStarted","Data":"aec7fea7424c32c0f0b0a0c62938ef7461afd316026642a1bd0a0ed822159c5e"} Sep 09 23:49:05.746657 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.746638 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" event={"ID":"6c040b47-6e07-4e41-9528-72c18d174f81","Type":"ContainerStarted","Data":"ef5c02a32240e878257fe329945bfd37fb286db7cdc439b43da43ebe4d166112"} Sep 09 23:49:05.775514 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.775445 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bv79j" podStartSLOduration=1.863557225 podStartE2EDuration="4.775426613s" totalImagesPullingTime="2.911869388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:05.757735511 +0000 UTC m=+51.740469191" watchObservedRunningTime="2026-09-09 23:49:05.775426613 +0000 UTC m=+51.758160295" Sep 09 23:49:05.776214 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.776172 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8pb49" podStartSLOduration=1.874384852 podStartE2EDuration="4.77615868s" totalImagesPullingTime="2.901773828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:05.775424177 +0000 UTC m=+51.758157859" watchObservedRunningTime="2026-09-09 23:49:05.77615868 +0000 UTC m=+51.758892363" Sep 09 23:49:05.809731 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.809705 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:05.861494 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:05.861450 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:06.269586 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.269559 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:06.394144 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.394113 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:06.398323 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.398305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjs7w_107b0c9c-1d8b-444e-a779-6a7eb2e99815/node-ca/0.log" Sep 09 23:49:06.443014 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.442989 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:06.750775 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.750738 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" event={"ID":"6c040b47-6e07-4e41-9528-72c18d174f81","Type":"ContainerStarted","Data":"e9b17b209b90f3064892c3ac7360f8be262191d63529db6468486256a3ad49e2"} Sep 09 23:49:06.764951 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.764906 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" podStartSLOduration=3.67299361 podStartE2EDuration="4.764870471s" totalImagesPullingTime="1.091876861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:06.763731514 +0000 UTC m=+52.746465195" watchObservedRunningTime="2026-09-09 23:49:06.764870471 +0000 UTC m=+52.747604151" Sep 09 23:49:06.880052 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.880021 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:06.973740 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.973703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:06.973740 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.973740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:06.974274 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.974255 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:06.977580 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.977556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6d22\" (UID: \"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8\") " pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:06.998941 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:06.998918 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bv79j_39418259-15c3-4964-a968-fc94cdb1d7bd/serve-healthcheck-canary/0.log" Sep 09 23:49:07.150273 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:07.150222 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n6d22" Sep 09 23:49:07.416216 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:07.415988 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n6d22"] Sep 09 23:49:07.421197 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:07.421160 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d9f2d4_0aff_4e0f_9aff_6e5d39f9d6a8.slice/crio-53f04b3907bb5e06e30145d68aa86e0d41db795dadebf8f2cf6c4623db113840 WatchSource:0}: Error finding container 53f04b3907bb5e06e30145d68aa86e0d41db795dadebf8f2cf6c4623db113840: Status 404 returned error can't find the container with id 53f04b3907bb5e06e30145d68aa86e0d41db795dadebf8f2cf6c4623db113840 Sep 09 23:49:07.754938 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:07.754815 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n6d22" event={"ID":"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8","Type":"ContainerStarted","Data":"44763ae84e9a283eda6b45047496a2f9457bdda5199ff5666e18d7ea250d3124"} Sep 09 23:49:07.754938 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:07.754881 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n6d22" event={"ID":"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8","Type":"ContainerStarted","Data":"53f04b3907bb5e06e30145d68aa86e0d41db795dadebf8f2cf6c4623db113840"} Sep 09 23:49:07.754938 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:07.754936 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" Sep 09 23:49:07.759657 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:07.759635 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-8mgq9" Sep 09 23:49:07.995677 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:07.995636 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:08.039905 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.039752 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-68cdn"] Sep 09 23:49:08.041716 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.041696 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.044170 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.044146 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 09 23:49:08.044287 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.044195 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 09 23:49:08.044353 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.044337 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:49:08.045263 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.045241 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:49:08.045325 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.045289 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:49:08.045548 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.045523 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l5hxz\"" Sep 09 23:49:08.050612 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.050592 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-68cdn"] Sep 09 23:49:08.067536 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.067512 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:08.183461 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.183432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.183539 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.183522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.183584 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.183541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.183584 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.183556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvf4q\" (UniqueName: \"kubernetes.io/projected/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-kube-api-access-xvf4q\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.284907 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.284849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.285182 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.284953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.285182 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.284978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvf4q\" (UniqueName: \"kubernetes.io/projected/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-kube-api-access-xvf4q\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.285182 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.285029 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.285182 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:08.285168 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 09 23:49:08.285358 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:08.285234 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-tls podName:922cf429-3bd5-4d86-a3a3-cc15d16ffa35 nodeName:}" failed. No retries permitted until 2026-09-09 23:49:08.78521462 +0000 UTC m=+54.767948282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-68cdn" (UID: "922cf429-3bd5-4d86-a3a3-cc15d16ffa35") : secret "prometheus-operator-tls" not found Sep 09 23:49:08.285688 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.285667 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.287976 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.287957 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.293129 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.293078 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvf4q\" (UniqueName: \"kubernetes.io/projected/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-kube-api-access-xvf4q\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.377354 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.377307 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:08.429685 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.429652 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:08.759708 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.759671 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n6d22" event={"ID":"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8","Type":"ContainerStarted","Data":"ee86183169c3ab8f9949cf6ebbd574b7109e0089836460ed20d06017ab55593b"} Sep 09 23:49:08.788201 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.788171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.790469 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.790449 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/922cf429-3bd5-4d86-a3a3-cc15d16ffa35-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-68cdn\" (UID: \"922cf429-3bd5-4d86-a3a3-cc15d16ffa35\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:08.951106 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:08.951068 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" Sep 09 23:49:09.224725 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:09.224694 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-68cdn"] Sep 09 23:49:09.227665 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:09.227636 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922cf429_3bd5_4d86_a3a3_cc15d16ffa35.slice/crio-ba3c14dc30a6a8f79261ec85dc485a0836d96f3663a97606c1f272a678562349 WatchSource:0}: Error finding container ba3c14dc30a6a8f79261ec85dc485a0836d96f3663a97606c1f272a678562349: Status 404 returned error can't find the container with id ba3c14dc30a6a8f79261ec85dc485a0836d96f3663a97606c1f272a678562349 Sep 09 23:49:09.723924 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:09.723877 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:09.763237 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:09.763206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" event={"ID":"922cf429-3bd5-4d86-a3a3-cc15d16ffa35","Type":"ContainerStarted","Data":"ba3c14dc30a6a8f79261ec85dc485a0836d96f3663a97606c1f272a678562349"} Sep 09 23:49:09.819520 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:09.819495 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:10.770254 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:10.770179 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n6d22" event={"ID":"22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8","Type":"ContainerStarted","Data":"53a735993aad239e9f5ecc36ced6e56cc909b05491d64005cab85610b9ae8201"} Sep 09 23:49:10.772331 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:10.772308 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" event={"ID":"922cf429-3bd5-4d86-a3a3-cc15d16ffa35","Type":"ContainerStarted","Data":"12b8ff63de8385b8dc1af927cbe77f14ae0255b7d9f98b847879a6a7a31dfd98"} Sep 09 23:49:10.790777 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:10.790726 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n6d22" podStartSLOduration=5.55452119 podStartE2EDuration="7.7907089s" totalImagesPullingTime="2.23618771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:49:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:10.789989001 +0000 UTC m=+56.772722682" watchObservedRunningTime="2026-09-09 23:49:10.7907089 +0000 UTC m=+56.773442581" Sep 09 23:49:10.971980 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:10.971898 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:11.776833 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:11.776789 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" event={"ID":"922cf429-3bd5-4d86-a3a3-cc15d16ffa35","Type":"ContainerStarted","Data":"08dda7a4c6d8a6fa38ce6e1880a8ff1d6f9f6ae130199b1b93355950be81ef74"} Sep 09 23:49:11.791790 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:11.791744 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-68cdn" podStartSLOduration=2.312281665 podStartE2EDuration="3.791726396s" totalImagesPullingTime="1.479444731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:11.791150812 +0000 UTC m=+57.773884493" watchObservedRunningTime="2026-09-09 23:49:11.791726396 +0000 UTC m=+57.774460078" Sep 09 23:49:12.199712 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:12.199678 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:12.254947 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:12.254917 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.135386 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.135352 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.235139 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.235108 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.366344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.366312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.382835 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.382803 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hltj2"] Sep 09 23:49:13.385521 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.385469 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.387814 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.387794 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:49:13.388095 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.388080 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:49:13.388352 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.388331 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:49:13.388449 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.388384 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zrbrm\"" Sep 09 23:49:13.393603 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.393581 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k"] Sep 09 23:49:13.395373 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.395355 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.397578 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.397562 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 09 23:49:13.397645 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.397609 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gwwmk\"" Sep 09 23:49:13.398012 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.397997 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 09 23:49:13.398079 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.398014 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 09 23:49:13.407616 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.407596 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k"] Sep 09 23:49:13.417986 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.417958 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.418077 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-root\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.418077 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.418077 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.418180 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-wtmp\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.418180 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-tls\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.418249 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frsz9\" (UniqueName: \"kubernetes.io/projected/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-api-access-frsz9\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.418292 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418259 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.418292 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.418353 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.418353 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418328 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-sys\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.418353 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.418452 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrlh\" (UniqueName: \"kubernetes.io/projected/5a6dd675-7be7-4015-9094-c851e648f97e-kube-api-access-jxrlh\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.418452 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418429 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6dd675-7be7-4015-9094-c851e648f97e-metrics-client-ca\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.418523 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.418473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-textfile\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.463572 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.463539 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.518964 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.518917 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.518964 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.518962 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-sys\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.518988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrlh\" (UniqueName: \"kubernetes.io/projected/5a6dd675-7be7-4015-9094-c851e648f97e-kube-api-access-jxrlh\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519033 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6dd675-7be7-4015-9094-c851e648f97e-metrics-client-ca\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-textfile\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519135 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-root\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519143 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-sys\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.519212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-wtmp\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519677 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519254 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-tls\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519677 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519261 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-root\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.519677 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frsz9\" (UniqueName: \"kubernetes.io/projected/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-api-access-frsz9\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.519677 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519327 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.519677 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.519677 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.519989 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.519977 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.520472 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.520442 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-wtmp\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.520472 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.520460 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.520903 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.520858 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6dd675-7be7-4015-9094-c851e648f97e-metrics-client-ca\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.521021 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.520877 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.521021 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.520975 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-textfile\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.522107 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.522075 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-tls\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.522293 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.522274 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6dd675-7be7-4015-9094-c851e648f97e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.522364 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.522280 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.522639 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.522618 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.526608 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.526582 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrlh\" (UniqueName: \"kubernetes.io/projected/5a6dd675-7be7-4015-9094-c851e648f97e-kube-api-access-jxrlh\") pod \"node-exporter-hltj2\" (UID: \"5a6dd675-7be7-4015-9094-c851e648f97e\") " pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.528516 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.528493 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frsz9\" (UniqueName: \"kubernetes.io/projected/6d8cd6e3-5e0c-4526-856b-ef3aaef836fc-kube-api-access-frsz9\") pod \"kube-state-metrics-74cb57df7-sdk8k\" (UID: \"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.563832 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.563797 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.661938 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.661909 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.694969 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.694942 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hltj2" Sep 09 23:49:13.704659 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.704632 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" Sep 09 23:49:13.785869 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.785747 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hltj2" event={"ID":"5a6dd675-7be7-4015-9094-c851e648f97e","Type":"ContainerStarted","Data":"ccbd79bea5df0f53e5a0db7eeb8c05969eded464c2a578dfc8053795b412d902"} Sep 09 23:49:13.809349 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.809290 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.909734 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.909702 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:13.985498 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:13.985411 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k"] Sep 09 23:49:13.988267 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:13.988241 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8cd6e3_5e0c_4526_856b_ef3aaef836fc.slice/crio-470ab06f7f9545fadf06e146f4a68bf7dd5e7c8a004e7cb0099ebcc66c917a88 WatchSource:0}: Error finding container 470ab06f7f9545fadf06e146f4a68bf7dd5e7c8a004e7cb0099ebcc66c917a88: Status 404 returned error can't find the container with id 470ab06f7f9545fadf06e146f4a68bf7dd5e7c8a004e7cb0099ebcc66c917a88 Sep 09 23:49:14.063166 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.063133 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:14.395186 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.395154 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:14.492074 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.492040 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:14.496905 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.496863 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:49:14.501984 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.501959 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.504341 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.504317 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wvqhf\"" Sep 09 23:49:14.504467 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.504427 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:49:14.504675 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.504655 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:49:14.504741 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.504686 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:49:14.504866 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.504849 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:49:14.506272 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.505281 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:49:14.506272 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.505514 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:49:14.506272 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.506109 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:49:14.506272 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.506203 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:49:14.506797 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.506622 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:49:14.538396 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.538362 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:49:14.606159 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.606103 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635379 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m2js\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-kube-api-access-9m2js\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635435 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635466 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635498 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635716 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.646116 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.635831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.706147 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.706112 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:14.736553 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736719 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m2js\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-kube-api-access-9m2js\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736719 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736719 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736657 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736719 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736719 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736715 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736958 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736958 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736958 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736958 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.736958 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.737122 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.737122 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.736992 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.737122 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.737071 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.737215 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:14.737146 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle podName:2fa35865-192f-41a3-bf02-14c9b51f7c3e nodeName:}" failed. No retries permitted until 2026-09-09 23:49:15.237125673 +0000 UTC m=+61.219859353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e") : configmap references non-existent config key: ca-bundle.crt Sep 09 23:49:14.737845 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:14.737809 2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 09 23:49:14.737994 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:49:14.737871 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls podName:2fa35865-192f-41a3-bf02-14c9b51f7c3e nodeName:}" failed. No retries permitted until 2026-09-09 23:49:15.237853418 +0000 UTC m=+61.220587095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e") : secret "alertmanager-main-tls" not found Sep 09 23:49:14.739799 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.739766 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.740239 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.740211 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.742276 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.742190 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.742385 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.742328 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.742480 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.742456 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.743085 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.743062 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.743180 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.743108 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.743671 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.743641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.744100 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.744055 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.750472 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.750432 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m2js\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-kube-api-access-9m2js\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:14.791823 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.791787 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" event={"ID":"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc","Type":"ContainerStarted","Data":"470ab06f7f9545fadf06e146f4a68bf7dd5e7c8a004e7cb0099ebcc66c917a88"} Sep 09 23:49:14.850671 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.850640 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sgdds" Sep 09 23:49:14.962606 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:14.962531 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:15.062647 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.062603 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:15.122737 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.122693 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:15.241807 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.241727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:15.241807 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.241777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:15.242774 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.242748 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:15.244483 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.244456 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:15.414062 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.413877 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:49:15.415326 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.415278 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:15.480460 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.477648 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:15.710060 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.709930 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:49:15.714561 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:15.714529 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa35865_192f_41a3_bf02_14c9b51f7c3e.slice/crio-48f5fca5be12a4a1ecdcd1147d2c37045e2a4105eb565bae41cce4e79ac86e24 WatchSource:0}: Error finding container 48f5fca5be12a4a1ecdcd1147d2c37045e2a4105eb565bae41cce4e79ac86e24: Status 404 returned error can't find the container with id 48f5fca5be12a4a1ecdcd1147d2c37045e2a4105eb565bae41cce4e79ac86e24 Sep 09 23:49:15.753505 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.753429 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8pb49" Sep 09 23:49:15.804797 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.804758 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerStarted","Data":"48f5fca5be12a4a1ecdcd1147d2c37045e2a4105eb565bae41cce4e79ac86e24"} Sep 09 23:49:15.807943 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.807911 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" event={"ID":"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc","Type":"ContainerStarted","Data":"3d3a18e8df2125572ac372c703b06e139554cf0dc6e7cefbc362e83ec3f88902"} Sep 09 23:49:15.808097 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.807971 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" event={"ID":"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc","Type":"ContainerStarted","Data":"d05053b3675f8dfb8ce9dc048f09685359c584c93da0e177da1e192ef847642d"} Sep 09 23:49:15.808097 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.807999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" event={"ID":"6d8cd6e3-5e0c-4526-856b-ef3aaef836fc","Type":"ContainerStarted","Data":"44e2c1ae35d1d85161b6424ea2ccc3f737efbc34a0a30e9da8a66bea32863356"} Sep 09 23:49:15.810196 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.810166 2556 generic.go:356] "Generic (PLEG): container finished" podID="5a6dd675-7be7-4015-9094-c851e648f97e" containerID="b8ca467899fbc9f85b38cacdb381bf919de74fd9dc133e40a7c17ff1b54dadf8" exitCode=0 Sep 09 23:49:15.810335 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.810206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hltj2" event={"ID":"5a6dd675-7be7-4015-9094-c851e648f97e","Type":"ContainerDied","Data":"b8ca467899fbc9f85b38cacdb381bf919de74fd9dc133e40a7c17ff1b54dadf8"} Sep 09 23:49:15.826111 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:15.826054 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-sdk8k" podStartSLOduration=1.459353382 podStartE2EDuration="2.826034003s" totalImagesPullingTime="1.366680621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:15.824715243 +0000 UTC m=+61.807448922" watchObservedRunningTime="2026-09-09 23:49:15.826034003 +0000 UTC m=+61.808767708" Sep 09 23:49:16.321620 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.321588 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:16.399711 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.399677 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g"] Sep 09 23:49:16.403470 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.403409 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:16.404626 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.404601 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.407209 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.407169 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 23:49:16.407381 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.407263 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 23:49:16.407381 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.407373 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bs1jsp59frvg8\"" Sep 09 23:49:16.407538 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.407479 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-smd4s\"" Sep 09 23:49:16.407538 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.407482 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 23:49:16.407634 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.407480 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 23:49:16.407634 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.407491 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 23:49:16.413694 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.413675 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g"] Sep 09 23:49:16.530462 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.530365 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:16.559662 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.559625 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc476\" (UniqueName: \"kubernetes.io/projected/8a1d052d-2854-40bb-b13a-4759cc96a16e-kube-api-access-vc476\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.559857 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.559740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-tls\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.559857 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.559809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-grpc-tls\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.559999 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.559938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.559999 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.559976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.560097 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.560005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.560097 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.560038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a1d052d-2854-40bb-b13a-4759cc96a16e-metrics-client-ca\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.560097 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.560088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.629986 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.629908 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:16.661090 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.661048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.661280 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.661097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.661321 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.661268 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.661321 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.661311 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a1d052d-2854-40bb-b13a-4759cc96a16e-metrics-client-ca\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.661396 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.661362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.661444 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.661414 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc476\" (UniqueName: \"kubernetes.io/projected/8a1d052d-2854-40bb-b13a-4759cc96a16e-kube-api-access-vc476\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.661488 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.661454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-tls\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.661537 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.661499 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-grpc-tls\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.662154 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.662124 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a1d052d-2854-40bb-b13a-4759cc96a16e-metrics-client-ca\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.663852 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.663818 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.664198 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.664177 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.664251 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.664205 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-tls\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.664287 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.664259 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.664287 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.664271 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.664439 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.664419 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a1d052d-2854-40bb-b13a-4759cc96a16e-secret-grpc-tls\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.668417 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.668393 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc476\" (UniqueName: \"kubernetes.io/projected/8a1d052d-2854-40bb-b13a-4759cc96a16e-kube-api-access-vc476\") pod \"thanos-querier-6bd894fbb9-rzc8g\" (UID: \"8a1d052d-2854-40bb-b13a-4759cc96a16e\") " pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.714362 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.714330 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:16.817001 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.816962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hltj2" event={"ID":"5a6dd675-7be7-4015-9094-c851e648f97e","Type":"ContainerStarted","Data":"b68342a3b00955f33aa687e2c53902e983dcd2773bac4e5d5f3e6622ab9dbe28"} Sep 09 23:49:16.817164 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.817021 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hltj2" event={"ID":"5a6dd675-7be7-4015-9094-c851e648f97e","Type":"ContainerStarted","Data":"4182a55590a0f763650cf53aa02b802f97e29f52360ca30ebaa8668d91f8bda0"} Sep 09 23:49:16.834038 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.833951 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hltj2" podStartSLOduration=2.07619708 podStartE2EDuration="3.833929489s" totalImagesPullingTime="1.642405969s" totalInitContainerRuntime="115.32644ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:16.833244656 +0000 UTC m=+62.815978340" watchObservedRunningTime="2026-09-09 23:49:16.833929489 +0000 UTC m=+62.816663175" Sep 09 23:49:16.992803 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:16.992770 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g"] Sep 09 23:49:17.030811 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:17.030779 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1d052d_2854_40bb_b13a_4759cc96a16e.slice/crio-13f400d37e121502e4ce97e0f6367c2149cebad7b793f8e026954b2ecc281f0b WatchSource:0}: Error finding container 13f400d37e121502e4ce97e0f6367c2149cebad7b793f8e026954b2ecc281f0b: Status 404 returned error can't find the container with id 13f400d37e121502e4ce97e0f6367c2149cebad7b793f8e026954b2ecc281f0b Sep 09 23:49:17.822364 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:17.822326 2556 generic.go:356] "Generic (PLEG): container finished" podID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerID="9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c" exitCode=0 Sep 09 23:49:17.822810 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:17.822409 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerDied","Data":"9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c"} Sep 09 23:49:17.823825 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:17.823749 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" event={"ID":"8a1d052d-2854-40bb-b13a-4759cc96a16e","Type":"ContainerStarted","Data":"13f400d37e121502e4ce97e0f6367c2149cebad7b793f8e026954b2ecc281f0b"} Sep 09 23:49:18.155380 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:18.155346 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:18.248247 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:18.248217 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:18.402775 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:18.402704 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:18.468135 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:18.468056 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:18.548540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:18.548505 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:19.577649 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.577576 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:19.583614 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.583586 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:49:19.607187 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.607070 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:49:19.607263 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.607227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.609984 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.609569 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 23:49:19.609984 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.609767 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 23:49:19.609984 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.609793 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 23:49:19.609984 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.609826 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 23:49:19.609984 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.609965 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 23:49:19.610328 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.610211 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-blnfsfe0dusji\"" Sep 09 23:49:19.610388 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.610377 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 23:49:19.610679 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.610658 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 23:49:19.610792 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.610729 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 23:49:19.610854 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.610799 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:49:19.611037 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.610981 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xgzsx\"" Sep 09 23:49:19.611129 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.611098 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 23:49:19.611313 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.611296 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 23:49:19.611377 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.611356 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 23:49:19.611377 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.611358 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 23:49:19.611500 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.611405 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 23:49:19.614001 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.613575 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 23:49:19.687622 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687593 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.687746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687664 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.687746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.687852 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.687852 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687801 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.687852 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687825 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688006 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688006 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rmvg\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-kube-api-access-2rmvg\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688006 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687922 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-config-out\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688006 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.687984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-config\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688192 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688013 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688192 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688192 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688093 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-web-config\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688192 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688392 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688200 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688392 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688230 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688392 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688392 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688311 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688392 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688337 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.688392 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.688365 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789565 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmvg\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-kube-api-access-2rmvg\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789679 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-config-out\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789679 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-config\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789787 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789787 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789755 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789980 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-web-config\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789980 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789980 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.789980 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.789959 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790176 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790023 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790176 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790176 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790089 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790176 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790127 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790333 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790553 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790371 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790553 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790398 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.790553 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.790432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.792330 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.792297 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.792442 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.792341 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.793335 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.793306 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.795877 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.794937 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.795877 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.795553 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.796992 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.796968 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.800683 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.799727 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.800683 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.799989 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-config-out\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.800683 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.800516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.803007 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.801100 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.803007 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.801602 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.803007 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.802055 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.803536 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.803350 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.803536 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.803472 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-config\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.803536 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.803523 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-web-config\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.803861 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.803837 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.804622 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.804599 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.805497 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.805471 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.805591 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.805480 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.807657 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.807635 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmvg\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-kube-api-access-2rmvg\") pod \"prometheus-k8s-0\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:19.834396 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.834365 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerStarted","Data":"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9"} Sep 09 23:49:19.836161 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.836125 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" event={"ID":"8a1d052d-2854-40bb-b13a-4759cc96a16e","Type":"ContainerStarted","Data":"5ccfecfd34aa8a36a757af4709681c5e412f3ce4b5f9c89ac6b8bfd6f26928c7"} Sep 09 23:49:19.920048 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:19.919962 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:20.194207 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.194171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:49:20.196707 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.196687 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:49:20.207179 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.207152 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:49:20.217599 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.217543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6j2q\" (UniqueName: \"kubernetes.io/projected/28b2275d-0a9b-4951-8a24-0de2e9e81490-kube-api-access-k6j2q\") pod \"network-check-target-ssd6p\" (UID: \"28b2275d-0a9b-4951-8a24-0de2e9e81490\") " pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:49:20.227204 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.227176 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:49:20.231882 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:20.231851 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524d7631_b466_4ed9_99ca_695b92757da5.slice/crio-544bfaab15a576d6093e06f563b59f30d11db0d279fd5d40ff69652571acf8b4 WatchSource:0}: Error finding container 544bfaab15a576d6093e06f563b59f30d11db0d279fd5d40ff69652571acf8b4: Status 404 returned error can't find the container with id 544bfaab15a576d6093e06f563b59f30d11db0d279fd5d40ff69652571acf8b4 Sep 09 23:49:20.294639 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.294613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:49:20.294735 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.294681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:49:20.310869 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.310239 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:49:20.310869 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.310606 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:49:20.317417 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.317390 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d726466-e0ff-499c-94bf-0219bf7ba099-original-pull-secret\") pod \"global-pull-secret-syncer-766j4\" (UID: \"1d726466-e0ff-499c-94bf-0219bf7ba099\") " pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:49:20.317599 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.317573 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b1da39f-2765-4aa1-88a8-0fcec7475d0d-metrics-certs\") pod \"network-metrics-daemon-ntvrv\" (UID: \"7b1da39f-2765-4aa1-88a8-0fcec7475d0d\") " pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:49:20.413638 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.413599 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-766j4" Sep 09 23:49:20.422207 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.422000 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7wg5\"" Sep 09 23:49:20.429661 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.429631 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:49:20.435929 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.435900 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7tkk\"" Sep 09 23:49:20.445804 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.445778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ntvrv" Sep 09 23:49:20.698649 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.698618 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-766j4"] Sep 09 23:49:20.702959 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.702931 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:20.725482 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.725406 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssd6p"] Sep 09 23:49:20.745132 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.744911 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ntvrv"] Sep 09 23:49:20.762853 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.762821 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:20.819449 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.819415 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:20.827682 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:20.827644 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d726466_e0ff_499c_94bf_0219bf7ba099.slice/crio-0fd9f27e644fbb1a7eea2a29f42ff94651dec162841e09524381ffb9fc4b173c WatchSource:0}: Error finding container 0fd9f27e644fbb1a7eea2a29f42ff94651dec162841e09524381ffb9fc4b173c: Status 404 returned error can't find the container with id 0fd9f27e644fbb1a7eea2a29f42ff94651dec162841e09524381ffb9fc4b173c Sep 09 23:49:20.828739 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:20.828701 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1da39f_2765_4aa1_88a8_0fcec7475d0d.slice/crio-f0794b1a5024bf9bcd0755e84b99363ff6f03dc73682763e3ff7acad63157b40 WatchSource:0}: Error finding container f0794b1a5024bf9bcd0755e84b99363ff6f03dc73682763e3ff7acad63157b40: Status 404 returned error can't find the container with id f0794b1a5024bf9bcd0755e84b99363ff6f03dc73682763e3ff7acad63157b40 Sep 09 23:49:20.830706 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:49:20.829914 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b2275d_0a9b_4951_8a24_0de2e9e81490.slice/crio-f9f638dd8f3219cf947e0ec02ab8f18c1d2f58e2dad8fb12d0d6801529b9ae29 WatchSource:0}: Error finding container f9f638dd8f3219cf947e0ec02ab8f18c1d2f58e2dad8fb12d0d6801529b9ae29: Status 404 returned error can't find the container with id f9f638dd8f3219cf947e0ec02ab8f18c1d2f58e2dad8fb12d0d6801529b9ae29 Sep 09 23:49:20.842530 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.842501 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ntvrv" event={"ID":"7b1da39f-2765-4aa1-88a8-0fcec7475d0d","Type":"ContainerStarted","Data":"f0794b1a5024bf9bcd0755e84b99363ff6f03dc73682763e3ff7acad63157b40"} Sep 09 23:49:20.844359 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.844335 2556 generic.go:356] "Generic (PLEG): container finished" podID="524d7631-b466-4ed9-99ca-695b92757da5" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" exitCode=0 Sep 09 23:49:20.844463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.844437 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerDied","Data":"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7"} Sep 09 23:49:20.844546 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.844529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerStarted","Data":"544bfaab15a576d6093e06f563b59f30d11db0d279fd5d40ff69652571acf8b4"} Sep 09 23:49:20.845855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.845832 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssd6p" event={"ID":"28b2275d-0a9b-4951-8a24-0de2e9e81490","Type":"ContainerStarted","Data":"f9f638dd8f3219cf947e0ec02ab8f18c1d2f58e2dad8fb12d0d6801529b9ae29"} Sep 09 23:49:20.849666 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.849646 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerStarted","Data":"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597"} Sep 09 23:49:20.849775 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.849704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerStarted","Data":"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642"} Sep 09 23:49:20.849775 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.849745 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerStarted","Data":"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02"} Sep 09 23:49:20.849882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.849788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerStarted","Data":"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11"} Sep 09 23:49:20.852281 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.852256 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" event={"ID":"8a1d052d-2854-40bb-b13a-4759cc96a16e","Type":"ContainerStarted","Data":"e882b77e817540ebb13ce5c6ae5a34e4d8fb07839ea437bbc1da5044fdd9452f"} Sep 09 23:49:20.852345 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.852325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" event={"ID":"8a1d052d-2854-40bb-b13a-4759cc96a16e","Type":"ContainerStarted","Data":"025c535339a0ccd861a183a8a7ab0028d951250f80ebd50e5a69f2bba0e33b61"} Sep 09 23:49:20.853813 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.853773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-766j4" event={"ID":"1d726466-e0ff-499c-94bf-0219bf7ba099","Type":"ContainerStarted","Data":"0fd9f27e644fbb1a7eea2a29f42ff94651dec162841e09524381ffb9fc4b173c"} Sep 09 23:49:20.880307 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:20.880282 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:21.865937 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:21.865194 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerStarted","Data":"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7"} Sep 09 23:49:21.872211 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:21.872177 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" event={"ID":"8a1d052d-2854-40bb-b13a-4759cc96a16e","Type":"ContainerStarted","Data":"a95ac4eefc535b707a59a4692ae2c81494ebdb7405d3668b6e7575d039853621"} Sep 09 23:49:21.872363 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:21.872260 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" event={"ID":"8a1d052d-2854-40bb-b13a-4759cc96a16e","Type":"ContainerStarted","Data":"90ac0276eac0ab9e8d8789594d5dbdde7a575d2be6eeb97fcaff44d9b9745612"} Sep 09 23:49:21.872363 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:21.872302 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" event={"ID":"8a1d052d-2854-40bb-b13a-4759cc96a16e","Type":"ContainerStarted","Data":"a94b7e6f53d900aca4b2173bc75c96ea3a7a5c1848b0cb66b7206759e89cfdc1"} Sep 09 23:49:21.873096 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:21.873075 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:21.896582 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:21.895929 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.10489062 podStartE2EDuration="7.895907285s" totalImagesPullingTime="3.775287712s" totalInitContainerRuntime="15.728953ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:21.892325575 +0000 UTC m=+67.875059256" watchObservedRunningTime="2026-09-09 23:49:21.895907285 +0000 UTC m=+67.878640963" Sep 09 23:49:22.210191 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:22.210149 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:22.268719 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:22.268634 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:22.883048 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:22.881609 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ntvrv" event={"ID":"7b1da39f-2765-4aa1-88a8-0fcec7475d0d","Type":"ContainerStarted","Data":"b4226cbc9da1f29745dfc276a5f5023222d65b95f1ec52af5444847c2478882c"} Sep 09 23:49:22.883048 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:22.881664 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ntvrv" event={"ID":"7b1da39f-2765-4aa1-88a8-0fcec7475d0d","Type":"ContainerStarted","Data":"70f53288b383006f6d79cd72c1cf02cc9046a2fbcb2deacdf63d89ed95fe829d"} Sep 09 23:49:22.898711 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:22.897333 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" podStartSLOduration=3.457538933 podStartE2EDuration="6.897316712s" totalImagesPullingTime="3.439777779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:21.919672773 +0000 UTC m=+67.902406456" watchObservedRunningTime="2026-09-09 23:49:22.897316712 +0000 UTC m=+68.880050432" Sep 09 23:49:22.898711 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:22.897479 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ntvrv" podStartSLOduration=67.723773419 podStartE2EDuration="1m8.897473718s" totalImagesPullingTime="1.173700299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:22.89611434 +0000 UTC m=+68.878848021" watchObservedRunningTime="2026-09-09 23:49:22.897473718 +0000 UTC m=+68.880207398" Sep 09 23:49:22.988465 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:22.988426 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:23.045877 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:23.045834 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:24.404172 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:24.404130 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:24.505164 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:24.505123 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:25.898718 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:25.898683 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:25.953515 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:25.953481 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:27.010641 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.010596 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:27.113698 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.113660 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:27.910404 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.910359 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssd6p" event={"ID":"28b2275d-0a9b-4951-8a24-0de2e9e81490","Type":"ContainerStarted","Data":"5e3c708e90de37d3f4b8245bd5c5e7666ef45f560293593afc09db9fcdcbd48c"} Sep 09 23:49:27.910590 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.910459 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:49:27.911946 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.911918 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-766j4" event={"ID":"1d726466-e0ff-499c-94bf-0219bf7ba099","Type":"ContainerStarted","Data":"08c3c12c05c0acc2ea704c1c8e8c9ce381a01519ae9eaa9ff354bd1b8aede54b"} Sep 09 23:49:27.915367 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.915345 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerStarted","Data":"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790"} Sep 09 23:49:27.915480 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.915399 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerStarted","Data":"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce"} Sep 09 23:49:27.915480 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.915454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerStarted","Data":"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806"} Sep 09 23:49:27.915568 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.915483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerStarted","Data":"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d"} Sep 09 23:49:27.915568 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.915513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerStarted","Data":"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c"} Sep 09 23:49:27.915568 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.915538 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerStarted","Data":"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc"} Sep 09 23:49:27.924063 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.924008 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ssd6p" podStartSLOduration=67.866214549 podStartE2EDuration="1m13.923992051s" totalImagesPullingTime="6.057777502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:27.923931338 +0000 UTC m=+73.906665019" watchObservedRunningTime="2026-09-09 23:49:27.923992051 +0000 UTC m=+73.906725732" Sep 09 23:49:27.937374 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.937333 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-766j4" podStartSLOduration=67.864752478 podStartE2EDuration="1m13.937319326s" totalImagesPullingTime="6.072566848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:27.936693289 +0000 UTC m=+73.919426973" watchObservedRunningTime="2026-09-09 23:49:27.937319326 +0000 UTC m=+73.920053007" Sep 09 23:49:27.963444 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:27.963386 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.897810427 podStartE2EDuration="8.96336392s" totalImagesPullingTime="6.041108398s" totalInitContainerRuntime="24.445095ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:49:27.960865641 +0000 UTC m=+73.943599313" watchObservedRunningTime="2026-09-09 23:49:27.96336392 +0000 UTC m=+73.946097602" Sep 09 23:49:28.898640 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:28.898611 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bd894fbb9-rzc8g" Sep 09 23:49:29.125444 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:29.125397 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:29.226553 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:29.226474 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:29.921232 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:29.921192 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:49:31.415420 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:31.415387 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:31.512481 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:31.512450 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:31.893814 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:31.893783 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:31.993490 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:31.993446 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:32.097272 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:32.097238 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:33.941708 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:33.941662 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:33.996839 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:33.996796 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:34.502932 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:34.502879 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:35.033786 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:35.033756 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:35.134373 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:35.134340 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:35.814267 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:35.814236 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:35.872642 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:35.872605 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:44.981714 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:44.981602 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:45.032219 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:45.032183 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:45.086615 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:45.086589 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:50.817151 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:50.817118 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:50.871434 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:50.871396 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:58.440337 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:58.440297 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:58.541941 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:58.541909 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:58.595593 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:58.595559 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:49:58.923614 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:49:58.923568 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ssd6p" Sep 09 23:50:05.809704 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:05.809668 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:05.911327 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:05.911292 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:19.920877 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:19.920836 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:19.939711 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:19.939682 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:20.133363 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:20.133336 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:29.461207 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:29.461168 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:29.561447 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:29.561412 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:33.312292 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.312258 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:33.413797 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.413768 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:33.701851 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.701818 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:50:33.702152 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.702127 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="alertmanager" containerID="cri-o://d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9" gracePeriod=120 Sep 09 23:50:33.702249 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.702220 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy-web" containerID="cri-o://afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02" gracePeriod=120 Sep 09 23:50:33.702306 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.702255 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="config-reloader" containerID="cri-o://0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11" gracePeriod=120 Sep 09 23:50:33.702357 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.702279 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy" containerID="cri-o://d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642" gracePeriod=120 Sep 09 23:50:33.702407 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.702198 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy-metric" containerID="cri-o://f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597" gracePeriod=120 Sep 09 23:50:33.702461 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:33.702259 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="prom-label-proxy" containerID="cri-o://ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7" gracePeriod=120 Sep 09 23:50:34.086123 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.086034 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:34.173769 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.173737 2556 generic.go:356] "Generic (PLEG): container finished" podID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerID="ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7" exitCode=0 Sep 09 23:50:34.173769 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.173761 2556 generic.go:356] "Generic (PLEG): container finished" podID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerID="d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642" exitCode=0 Sep 09 23:50:34.173769 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.173768 2556 generic.go:356] "Generic (PLEG): container finished" podID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerID="0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11" exitCode=0 Sep 09 23:50:34.173769 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.173773 2556 generic.go:356] "Generic (PLEG): container finished" podID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerID="d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9" exitCode=0 Sep 09 23:50:34.174113 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.173809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerDied","Data":"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7"} Sep 09 23:50:34.174113 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.173941 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerDied","Data":"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642"} Sep 09 23:50:34.174113 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.173985 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerDied","Data":"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11"} Sep 09 23:50:34.174113 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.174028 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerDied","Data":"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9"} Sep 09 23:50:34.938795 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:34.938773 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.023085 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023004 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-volume\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023085 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023036 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-web\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023085 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023055 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-web-config\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023089 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-tls-assets\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023131 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023168 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023212 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-cluster-tls-config\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023236 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-metrics-client-ca\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023271 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023298 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023341 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-out\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023395 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-main-db\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023434 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m2js\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-kube-api-access-9m2js\") pod \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\" (UID: \"2fa35865-192f-41a3-bf02-14c9b51f7c3e\") " Sep 09 23:50:35.023923 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.023861 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:35.024684 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.024490 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:50:35.024684 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.024633 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:35.026218 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.026181 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:50:35.026723 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.026696 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-kube-api-access-9m2js" (OuterVolumeSpecName: "kube-api-access-9m2js") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "kube-api-access-9m2js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:50:35.026808 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.026792 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-volume" (OuterVolumeSpecName: "config-volume") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:35.026948 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.026917 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:35.027222 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.027187 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:35.027328 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.027286 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:35.027564 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.027545 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-out" (OuterVolumeSpecName: "config-out") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:50:35.027611 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.027585 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:35.030493 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.030454 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:35.036361 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.036341 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-web-config" (OuterVolumeSpecName: "web-config") pod "2fa35865-192f-41a3-bf02-14c9b51f7c3e" (UID: "2fa35865-192f-41a3-bf02-14c9b51f7c3e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:35.124045 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124016 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-tls-assets\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124045 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124043 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124055 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124066 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-cluster-tls-config\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124074 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa35865-192f-41a3-bf02-14c9b51f7c3e-metrics-client-ca\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124082 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-main-tls\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124090 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124099 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-out\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124106 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa35865-192f-41a3-bf02-14c9b51f7c3e-alertmanager-main-db\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124114 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m2js\" (UniqueName: \"kubernetes.io/projected/2fa35865-192f-41a3-bf02-14c9b51f7c3e-kube-api-access-9m2js\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124122 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-config-volume\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124130 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.124217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.124137 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa35865-192f-41a3-bf02-14c9b51f7c3e-web-config\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:35.180264 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.180232 2556 generic.go:356] "Generic (PLEG): container finished" podID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerID="f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597" exitCode=0 Sep 09 23:50:35.180264 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.180257 2556 generic.go:356] "Generic (PLEG): container finished" podID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerID="afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02" exitCode=0 Sep 09 23:50:35.180477 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.180290 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerDied","Data":"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597"} Sep 09 23:50:35.180477 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.180317 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.180477 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.180378 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerDied","Data":"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02"} Sep 09 23:50:35.180477 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.180420 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa35865-192f-41a3-bf02-14c9b51f7c3e","Type":"ContainerDied","Data":"48f5fca5be12a4a1ecdcd1147d2c37045e2a4105eb565bae41cce4e79ac86e24"} Sep 09 23:50:35.180477 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.180444 2556 scope.go:117] "RemoveContainer" containerID="ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7" Sep 09 23:50:35.187918 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.187877 2556 scope.go:117] "RemoveContainer" containerID="f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597" Sep 09 23:50:35.194967 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.194951 2556 scope.go:117] "RemoveContainer" containerID="d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642" Sep 09 23:50:35.201094 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.201077 2556 scope.go:117] "RemoveContainer" containerID="afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02" Sep 09 23:50:35.206402 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.206380 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:50:35.209063 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.209048 2556 scope.go:117] "RemoveContainer" containerID="0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11" Sep 09 23:50:35.210338 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.210320 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:50:35.215582 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.215566 2556 scope.go:117] "RemoveContainer" containerID="d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9" Sep 09 23:50:35.222218 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.222197 2556 scope.go:117] "RemoveContainer" containerID="9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c" Sep 09 23:50:35.228858 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.228841 2556 scope.go:117] "RemoveContainer" containerID="ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7" Sep 09 23:50:35.229180 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:35.229162 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7\": container with ID starting with ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7 not found: ID does not exist" containerID="ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7" Sep 09 23:50:35.229224 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.229192 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7"} err="failed to get container status \"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7\": rpc error: code = NotFound desc = could not find container \"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7\": container with ID starting with ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7 not found: ID does not exist" Sep 09 23:50:35.229224 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.229222 2556 scope.go:117] "RemoveContainer" containerID="f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597" Sep 09 23:50:35.229478 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:35.229456 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597\": container with ID starting with f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597 not found: ID does not exist" containerID="f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597" Sep 09 23:50:35.229544 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.229488 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597"} err="failed to get container status \"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597\": rpc error: code = NotFound desc = could not find container \"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597\": container with ID starting with f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597 not found: ID does not exist" Sep 09 23:50:35.229544 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.229513 2556 scope.go:117] "RemoveContainer" containerID="d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642" Sep 09 23:50:35.229757 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:35.229740 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642\": container with ID starting with d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642 not found: ID does not exist" containerID="d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642" Sep 09 23:50:35.229796 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.229762 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642"} err="failed to get container status \"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642\": rpc error: code = NotFound desc = could not find container \"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642\": container with ID starting with d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642 not found: ID does not exist" Sep 09 23:50:35.229796 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.229776 2556 scope.go:117] "RemoveContainer" containerID="afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02" Sep 09 23:50:35.230001 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:35.229984 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02\": container with ID starting with afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02 not found: ID does not exist" containerID="afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02" Sep 09 23:50:35.230070 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230010 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02"} err="failed to get container status \"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02\": rpc error: code = NotFound desc = could not find container \"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02\": container with ID starting with afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02 not found: ID does not exist" Sep 09 23:50:35.230070 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230030 2556 scope.go:117] "RemoveContainer" containerID="0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11" Sep 09 23:50:35.230256 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:35.230241 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11\": container with ID starting with 0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11 not found: ID does not exist" containerID="0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11" Sep 09 23:50:35.230296 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230259 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11"} err="failed to get container status \"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11\": rpc error: code = NotFound desc = could not find container \"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11\": container with ID starting with 0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11 not found: ID does not exist" Sep 09 23:50:35.230296 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230275 2556 scope.go:117] "RemoveContainer" containerID="d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9" Sep 09 23:50:35.230501 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:35.230486 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9\": container with ID starting with d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9 not found: ID does not exist" containerID="d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9" Sep 09 23:50:35.230561 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230508 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9"} err="failed to get container status \"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9\": rpc error: code = NotFound desc = could not find container \"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9\": container with ID starting with d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9 not found: ID does not exist" Sep 09 23:50:35.230561 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230528 2556 scope.go:117] "RemoveContainer" containerID="9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c" Sep 09 23:50:35.230727 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:35.230712 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c\": container with ID starting with 9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c not found: ID does not exist" containerID="9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c" Sep 09 23:50:35.230783 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230732 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c"} err="failed to get container status \"9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c\": rpc error: code = NotFound desc = could not find container \"9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c\": container with ID starting with 9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c not found: ID does not exist" Sep 09 23:50:35.230783 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230749 2556 scope.go:117] "RemoveContainer" containerID="ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7" Sep 09 23:50:35.230985 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230970 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7"} err="failed to get container status \"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7\": rpc error: code = NotFound desc = could not find container \"ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7\": container with ID starting with ea72d4f55af2bd48aac6cf9212a8060bd75b1939f29444195c2789377916fce7 not found: ID does not exist" Sep 09 23:50:35.230985 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.230984 2556 scope.go:117] "RemoveContainer" containerID="f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597" Sep 09 23:50:35.231158 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.231144 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597"} err="failed to get container status \"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597\": rpc error: code = NotFound desc = could not find container \"f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597\": container with ID starting with f7fac7e52b45da34588d18de87e67ba37ae87db861a617469020ac7f8d447597 not found: ID does not exist" Sep 09 23:50:35.231158 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.231157 2556 scope.go:117] "RemoveContainer" containerID="d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642" Sep 09 23:50:35.231329 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.231314 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642"} err="failed to get container status \"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642\": rpc error: code = NotFound desc = could not find container \"d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642\": container with ID starting with d9540e0941bbbb70691a56f470c672b5502851cd0f9a7ce947ffbc420bc23642 not found: ID does not exist" Sep 09 23:50:35.231365 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.231329 2556 scope.go:117] "RemoveContainer" containerID="afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02" Sep 09 23:50:35.231659 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.231626 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02"} err="failed to get container status \"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02\": rpc error: code = NotFound desc = could not find container \"afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02\": container with ID starting with afec61f0a943f47375f0fe450f8f0edbec55d9f86977ad23162962078b29ef02 not found: ID does not exist" Sep 09 23:50:35.231741 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.231661 2556 scope.go:117] "RemoveContainer" containerID="0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11" Sep 09 23:50:35.231974 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.231950 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11"} err="failed to get container status \"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11\": rpc error: code = NotFound desc = could not find container \"0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11\": container with ID starting with 0c9335af29b550ce176a35ae2a5d7d226e96c0597e2bbac7a974d2ce51d15c11 not found: ID does not exist" Sep 09 23:50:35.232125 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.231975 2556 scope.go:117] "RemoveContainer" containerID="d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9" Sep 09 23:50:35.232340 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.232304 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9"} err="failed to get container status \"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9\": rpc error: code = NotFound desc = could not find container \"d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9\": container with ID starting with d8b7b7542cf44e83a0fdc6be52a4c703c4e0088aed1335180172eee104ead0e9 not found: ID does not exist" Sep 09 23:50:35.232340 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.232328 2556 scope.go:117] "RemoveContainer" containerID="9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c" Sep 09 23:50:35.232658 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.232602 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c"} err="failed to get container status \"9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c\": rpc error: code = NotFound desc = could not find container \"9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c\": container with ID starting with 9bb63ab0f8ba1402deddab28262b3d90af20143cf359142ebd30a4899af29f2c not found: ID does not exist" Sep 09 23:50:35.233489 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233470 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:50:35.233735 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233723 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="prom-label-proxy" Sep 09 23:50:35.233779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233736 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="prom-label-proxy" Sep 09 23:50:35.233779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233745 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy" Sep 09 23:50:35.233779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233751 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy" Sep 09 23:50:35.233779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233761 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy-metric" Sep 09 23:50:35.233779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233766 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy-metric" Sep 09 23:50:35.233779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233776 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="alertmanager" Sep 09 23:50:35.233779 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233781 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="alertmanager" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233786 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="config-reloader" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233791 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="config-reloader" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233798 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy-web" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233803 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy-web" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233811 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="init-config-reloader" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233815 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="init-config-reloader" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233856 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy-web" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233861 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="prom-label-proxy" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233919 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="alertmanager" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233925 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233932 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="config-reloader" Sep 09 23:50:35.234016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.233938 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" containerName="kube-rbac-proxy-metric" Sep 09 23:50:35.237523 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.237507 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.239739 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.239709 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:50:35.239739 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.239717 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:50:35.239898 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.239791 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wvqhf\"" Sep 09 23:50:35.239962 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.239951 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:50:35.240145 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.240127 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:50:35.240220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.240193 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:50:35.240271 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.240218 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:50:35.240271 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.240260 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:50:35.240527 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.240512 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:50:35.245277 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.245260 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:50:35.257009 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.256986 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:50:35.326026 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.325943 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326026 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.325983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7754092-94ef-4a13-b60d-2645af1e9f07-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326026 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7754092-94ef-4a13-b60d-2645af1e9f07-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326276 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326276 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326276 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7754092-94ef-4a13-b60d-2645af1e9f07-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326276 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326211 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7754092-94ef-4a13-b60d-2645af1e9f07-config-out\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326276 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7754092-94ef-4a13-b60d-2645af1e9f07-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326276 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326474 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326474 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326474 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmn5f\" (UniqueName: \"kubernetes.io/projected/c7754092-94ef-4a13-b60d-2645af1e9f07-kube-api-access-tmn5f\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.326474 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.326355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-web-config\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.427626 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427580 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-web-config\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.427626 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427628 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.427848 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7754092-94ef-4a13-b60d-2645af1e9f07-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.427848 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7754092-94ef-4a13-b60d-2645af1e9f07-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.427848 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.427848 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.427848 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7754092-94ef-4a13-b60d-2645af1e9f07-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.427848 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7754092-94ef-4a13-b60d-2645af1e9f07-config-out\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.428171 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427871 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7754092-94ef-4a13-b60d-2645af1e9f07-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.428171 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427927 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.428171 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.427973 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.428171 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.428001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.428171 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.428023 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmn5f\" (UniqueName: \"kubernetes.io/projected/c7754092-94ef-4a13-b60d-2645af1e9f07-kube-api-access-tmn5f\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.428512 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.428439 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7754092-94ef-4a13-b60d-2645af1e9f07-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.428643 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.428611 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7754092-94ef-4a13-b60d-2645af1e9f07-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.429598 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.429267 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7754092-94ef-4a13-b60d-2645af1e9f07-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.430869 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.430774 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.430869 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.430812 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.430869 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.430825 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7754092-94ef-4a13-b60d-2645af1e9f07-config-out\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.430869 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.430852 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-web-config\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.431132 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.430927 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7754092-94ef-4a13-b60d-2645af1e9f07-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.431132 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.431013 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.431198 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.431143 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.431627 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.431613 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.432668 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.432648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7754092-94ef-4a13-b60d-2645af1e9f07-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.435245 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.435222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmn5f\" (UniqueName: \"kubernetes.io/projected/c7754092-94ef-4a13-b60d-2645af1e9f07-kube-api-access-tmn5f\") pod \"alertmanager-main-0\" (UID: \"c7754092-94ef-4a13-b60d-2645af1e9f07\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.546767 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.546741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:50:35.820256 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:35.820224 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:50:35.824152 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:50:35.824127 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7754092_94ef_4a13_b60d_2645af1e9f07.slice/crio-b8327619da58199bd4db41663e8bd092581fa3179efe9db5925eeb5f0a1b6012 WatchSource:0}: Error finding container b8327619da58199bd4db41663e8bd092581fa3179efe9db5925eeb5f0a1b6012: Status 404 returned error can't find the container with id b8327619da58199bd4db41663e8bd092581fa3179efe9db5925eeb5f0a1b6012 Sep 09 23:50:36.184902 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:36.184852 2556 generic.go:356] "Generic (PLEG): container finished" podID="c7754092-94ef-4a13-b60d-2645af1e9f07" containerID="1502a53ab4bffcd15731efbe853731dd51e463dd76961a3cc04ed95c96aa5295" exitCode=0 Sep 09 23:50:36.185336 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:36.184941 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7754092-94ef-4a13-b60d-2645af1e9f07","Type":"ContainerDied","Data":"1502a53ab4bffcd15731efbe853731dd51e463dd76961a3cc04ed95c96aa5295"} Sep 09 23:50:36.185336 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:36.185061 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7754092-94ef-4a13-b60d-2645af1e9f07","Type":"ContainerStarted","Data":"b8327619da58199bd4db41663e8bd092581fa3179efe9db5925eeb5f0a1b6012"} Sep 09 23:50:36.510165 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:36.510137 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa35865-192f-41a3-bf02-14c9b51f7c3e" path="/var/lib/kubelet/pods/2fa35865-192f-41a3-bf02-14c9b51f7c3e/volumes" Sep 09 23:50:37.181324 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.181298 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:37.193031 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.193004 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7754092-94ef-4a13-b60d-2645af1e9f07","Type":"ContainerStarted","Data":"07dc14eed6937111ba8dea9d88eaa0280d7bc34f065f73cf263be30421910ff0"} Sep 09 23:50:37.193368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.193063 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7754092-94ef-4a13-b60d-2645af1e9f07","Type":"ContainerStarted","Data":"f9fdc1d8cf069fb06cfc5172fb1231e4b19b6d9c07d743449914e87ee65d621b"} Sep 09 23:50:37.193368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.193090 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7754092-94ef-4a13-b60d-2645af1e9f07","Type":"ContainerStarted","Data":"71c58539470bb29f3472a751d8ff36f2953ecf3899c510f527e1a043335a836f"} Sep 09 23:50:37.193368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.193120 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7754092-94ef-4a13-b60d-2645af1e9f07","Type":"ContainerStarted","Data":"9a671e9e90b3eaebe6c2790157b86335759c3581360b82a79c4d3b8056130750"} Sep 09 23:50:37.193368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.193149 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7754092-94ef-4a13-b60d-2645af1e9f07","Type":"ContainerStarted","Data":"e074b2a61c495b286faa4a9b495c53ab5669e5988b344c90a6a8c1743302ffc1"} Sep 09 23:50:37.193368 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.193174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7754092-94ef-4a13-b60d-2645af1e9f07","Type":"ContainerStarted","Data":"f3bd00a0730e1b8e3f4f3e43c6b13c1b17c0b444c36bb18625f95884c84d3302"} Sep 09 23:50:37.216126 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.216072 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.198249941 podStartE2EDuration="2.215998946s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.749005ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:50:37.214589106 +0000 UTC m=+143.197322788" watchObservedRunningTime="2026-09-09 23:50:37.215998946 +0000 UTC m=+143.198732627" Sep 09 23:50:37.282661 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.282621 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:37.382450 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.382419 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:37.925379 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.925346 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:37.939445 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.939413 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:50:37.940557 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.939835 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" gracePeriod=600 Sep 09 23:50:37.940557 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.940209 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy-web" containerID="cri-o://1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" gracePeriod=600 Sep 09 23:50:37.940557 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.940321 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy" containerID="cri-o://f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" gracePeriod=600 Sep 09 23:50:37.940557 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.940403 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="thanos-sidecar" containerID="cri-o://97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" gracePeriod=600 Sep 09 23:50:37.940557 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.940479 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="config-reloader" containerID="cri-o://fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" gracePeriod=600 Sep 09 23:50:37.940927 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:37.940738 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="prometheus" containerID="cri-o://4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" gracePeriod=600 Sep 09 23:50:38.006341 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.006313 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:38.200070 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.200028 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:38.204015 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.203975 2556 generic.go:356] "Generic (PLEG): container finished" podID="524d7631-b466-4ed9-99ca-695b92757da5" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" exitCode=0 Sep 09 23:50:38.204015 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204016 2556 generic.go:356] "Generic (PLEG): container finished" podID="524d7631-b466-4ed9-99ca-695b92757da5" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" exitCode=0 Sep 09 23:50:38.204229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204026 2556 generic.go:356] "Generic (PLEG): container finished" podID="524d7631-b466-4ed9-99ca-695b92757da5" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" exitCode=0 Sep 09 23:50:38.204229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204037 2556 generic.go:356] "Generic (PLEG): container finished" podID="524d7631-b466-4ed9-99ca-695b92757da5" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" exitCode=0 Sep 09 23:50:38.204229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204045 2556 generic.go:356] "Generic (PLEG): container finished" podID="524d7631-b466-4ed9-99ca-695b92757da5" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" exitCode=0 Sep 09 23:50:38.204229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204053 2556 generic.go:356] "Generic (PLEG): container finished" podID="524d7631-b466-4ed9-99ca-695b92757da5" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" exitCode=0 Sep 09 23:50:38.204229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerDied","Data":"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790"} Sep 09 23:50:38.204229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204169 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerDied","Data":"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce"} Sep 09 23:50:38.204229 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204219 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerDied","Data":"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806"} Sep 09 23:50:38.204534 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204203 2556 scope.go:117] "RemoveContainer" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" Sep 09 23:50:38.204534 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerDied","Data":"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d"} Sep 09 23:50:38.204534 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204303 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerDied","Data":"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c"} Sep 09 23:50:38.204534 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204342 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerDied","Data":"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc"} Sep 09 23:50:38.204534 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.204382 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"524d7631-b466-4ed9-99ca-695b92757da5","Type":"ContainerDied","Data":"544bfaab15a576d6093e06f563b59f30d11db0d279fd5d40ff69652571acf8b4"} Sep 09 23:50:38.216638 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.216571 2556 scope.go:117] "RemoveContainer" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" Sep 09 23:50:38.224686 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.224635 2556 scope.go:117] "RemoveContainer" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" Sep 09 23:50:38.234439 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.234413 2556 scope.go:117] "RemoveContainer" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" Sep 09 23:50:38.245915 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.245355 2556 scope.go:117] "RemoveContainer" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" Sep 09 23:50:38.254766 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.254747 2556 scope.go:117] "RemoveContainer" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" Sep 09 23:50:38.262960 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.262938 2556 scope.go:117] "RemoveContainer" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" Sep 09 23:50:38.271360 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.271338 2556 scope.go:117] "RemoveContainer" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" Sep 09 23:50:38.271643 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:38.271623 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": container with ID starting with 21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790 not found: ID does not exist" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" Sep 09 23:50:38.271706 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.271651 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790"} err="failed to get container status \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": rpc error: code = NotFound desc = could not find container \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": container with ID starting with 21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790 not found: ID does not exist" Sep 09 23:50:38.271706 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.271671 2556 scope.go:117] "RemoveContainer" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" Sep 09 23:50:38.271975 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:38.271954 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": container with ID starting with f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce not found: ID does not exist" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" Sep 09 23:50:38.272053 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.271983 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce"} err="failed to get container status \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": rpc error: code = NotFound desc = could not find container \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": container with ID starting with f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce not found: ID does not exist" Sep 09 23:50:38.272053 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.272000 2556 scope.go:117] "RemoveContainer" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" Sep 09 23:50:38.272221 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:38.272207 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": container with ID starting with 1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806 not found: ID does not exist" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" Sep 09 23:50:38.272270 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.272223 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806"} err="failed to get container status \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": rpc error: code = NotFound desc = could not find container \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": container with ID starting with 1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806 not found: ID does not exist" Sep 09 23:50:38.272270 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.272234 2556 scope.go:117] "RemoveContainer" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" Sep 09 23:50:38.272475 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:38.272456 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": container with ID starting with 97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d not found: ID does not exist" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" Sep 09 23:50:38.272548 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.272483 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d"} err="failed to get container status \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": rpc error: code = NotFound desc = could not find container \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": container with ID starting with 97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d not found: ID does not exist" Sep 09 23:50:38.272548 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.272506 2556 scope.go:117] "RemoveContainer" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" Sep 09 23:50:38.272758 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:38.272738 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": container with ID starting with fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c not found: ID does not exist" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" Sep 09 23:50:38.272809 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.272764 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c"} err="failed to get container status \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": rpc error: code = NotFound desc = could not find container \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": container with ID starting with fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c not found: ID does not exist" Sep 09 23:50:38.272809 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.272779 2556 scope.go:117] "RemoveContainer" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" Sep 09 23:50:38.273109 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:38.273093 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": container with ID starting with 4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc not found: ID does not exist" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" Sep 09 23:50:38.273189 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.273112 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc"} err="failed to get container status \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": rpc error: code = NotFound desc = could not find container \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": container with ID starting with 4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc not found: ID does not exist" Sep 09 23:50:38.273189 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.273133 2556 scope.go:117] "RemoveContainer" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" Sep 09 23:50:38.273390 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:50:38.273375 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": container with ID starting with 56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7 not found: ID does not exist" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" Sep 09 23:50:38.273430 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.273391 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7"} err="failed to get container status \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": rpc error: code = NotFound desc = could not find container \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": container with ID starting with 56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7 not found: ID does not exist" Sep 09 23:50:38.273430 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.273403 2556 scope.go:117] "RemoveContainer" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" Sep 09 23:50:38.273677 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.273650 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790"} err="failed to get container status \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": rpc error: code = NotFound desc = could not find container \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": container with ID starting with 21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790 not found: ID does not exist" Sep 09 23:50:38.273757 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.273678 2556 scope.go:117] "RemoveContainer" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" Sep 09 23:50:38.274134 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.274107 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce"} err="failed to get container status \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": rpc error: code = NotFound desc = could not find container \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": container with ID starting with f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce not found: ID does not exist" Sep 09 23:50:38.274205 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.274137 2556 scope.go:117] "RemoveContainer" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" Sep 09 23:50:38.274445 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.274421 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806"} err="failed to get container status \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": rpc error: code = NotFound desc = could not find container \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": container with ID starting with 1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806 not found: ID does not exist" Sep 09 23:50:38.274501 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.274448 2556 scope.go:117] "RemoveContainer" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" Sep 09 23:50:38.274699 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.274681 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d"} err="failed to get container status \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": rpc error: code = NotFound desc = could not find container \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": container with ID starting with 97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d not found: ID does not exist" Sep 09 23:50:38.274735 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.274700 2556 scope.go:117] "RemoveContainer" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" Sep 09 23:50:38.274951 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.274931 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c"} err="failed to get container status \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": rpc error: code = NotFound desc = could not find container \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": container with ID starting with fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c not found: ID does not exist" Sep 09 23:50:38.275031 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.274952 2556 scope.go:117] "RemoveContainer" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" Sep 09 23:50:38.275242 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.275221 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc"} err="failed to get container status \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": rpc error: code = NotFound desc = could not find container \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": container with ID starting with 4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc not found: ID does not exist" Sep 09 23:50:38.275321 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.275244 2556 scope.go:117] "RemoveContainer" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" Sep 09 23:50:38.275503 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.275485 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7"} err="failed to get container status \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": rpc error: code = NotFound desc = could not find container \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": container with ID starting with 56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7 not found: ID does not exist" Sep 09 23:50:38.275547 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.275504 2556 scope.go:117] "RemoveContainer" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" Sep 09 23:50:38.275746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.275728 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790"} err="failed to get container status \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": rpc error: code = NotFound desc = could not find container \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": container with ID starting with 21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790 not found: ID does not exist" Sep 09 23:50:38.275787 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.275747 2556 scope.go:117] "RemoveContainer" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" Sep 09 23:50:38.276004 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.275984 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce"} err="failed to get container status \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": rpc error: code = NotFound desc = could not find container \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": container with ID starting with f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce not found: ID does not exist" Sep 09 23:50:38.276004 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.276003 2556 scope.go:117] "RemoveContainer" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" Sep 09 23:50:38.276371 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.276257 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806"} err="failed to get container status \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": rpc error: code = NotFound desc = could not find container \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": container with ID starting with 1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806 not found: ID does not exist" Sep 09 23:50:38.276371 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.276285 2556 scope.go:117] "RemoveContainer" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" Sep 09 23:50:38.276615 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.276586 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d"} err="failed to get container status \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": rpc error: code = NotFound desc = could not find container \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": container with ID starting with 97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d not found: ID does not exist" Sep 09 23:50:38.276731 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.276615 2556 scope.go:117] "RemoveContainer" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" Sep 09 23:50:38.276911 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.276864 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c"} err="failed to get container status \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": rpc error: code = NotFound desc = could not find container \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": container with ID starting with fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c not found: ID does not exist" Sep 09 23:50:38.276988 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.276909 2556 scope.go:117] "RemoveContainer" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" Sep 09 23:50:38.277211 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.277185 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc"} err="failed to get container status \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": rpc error: code = NotFound desc = could not find container \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": container with ID starting with 4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc not found: ID does not exist" Sep 09 23:50:38.277293 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.277212 2556 scope.go:117] "RemoveContainer" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" Sep 09 23:50:38.277444 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.277413 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7"} err="failed to get container status \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": rpc error: code = NotFound desc = could not find container \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": container with ID starting with 56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7 not found: ID does not exist" Sep 09 23:50:38.277444 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.277435 2556 scope.go:117] "RemoveContainer" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" Sep 09 23:50:38.277761 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.277738 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790"} err="failed to get container status \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": rpc error: code = NotFound desc = could not find container \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": container with ID starting with 21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790 not found: ID does not exist" Sep 09 23:50:38.277827 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.277763 2556 scope.go:117] "RemoveContainer" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" Sep 09 23:50:38.278055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.278033 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce"} err="failed to get container status \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": rpc error: code = NotFound desc = could not find container \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": container with ID starting with f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce not found: ID does not exist" Sep 09 23:50:38.278133 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.278055 2556 scope.go:117] "RemoveContainer" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" Sep 09 23:50:38.278295 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.278277 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806"} err="failed to get container status \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": rpc error: code = NotFound desc = could not find container \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": container with ID starting with 1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806 not found: ID does not exist" Sep 09 23:50:38.278295 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.278295 2556 scope.go:117] "RemoveContainer" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" Sep 09 23:50:38.278540 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.278523 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d"} err="failed to get container status \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": rpc error: code = NotFound desc = could not find container \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": container with ID starting with 97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d not found: ID does not exist" Sep 09 23:50:38.278609 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.278544 2556 scope.go:117] "RemoveContainer" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" Sep 09 23:50:38.278794 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.278779 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c"} err="failed to get container status \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": rpc error: code = NotFound desc = could not find container \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": container with ID starting with fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c not found: ID does not exist" Sep 09 23:50:38.278846 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.278795 2556 scope.go:117] "RemoveContainer" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" Sep 09 23:50:38.279062 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.279042 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc"} err="failed to get container status \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": rpc error: code = NotFound desc = could not find container \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": container with ID starting with 4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc not found: ID does not exist" Sep 09 23:50:38.279062 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.279060 2556 scope.go:117] "RemoveContainer" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" Sep 09 23:50:38.279275 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.279259 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7"} err="failed to get container status \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": rpc error: code = NotFound desc = could not find container \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": container with ID starting with 56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7 not found: ID does not exist" Sep 09 23:50:38.279275 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.279274 2556 scope.go:117] "RemoveContainer" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" Sep 09 23:50:38.279569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.279543 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790"} err="failed to get container status \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": rpc error: code = NotFound desc = could not find container \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": container with ID starting with 21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790 not found: ID does not exist" Sep 09 23:50:38.279569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.279563 2556 scope.go:117] "RemoveContainer" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" Sep 09 23:50:38.279824 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.279807 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce"} err="failed to get container status \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": rpc error: code = NotFound desc = could not find container \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": container with ID starting with f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce not found: ID does not exist" Sep 09 23:50:38.279824 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.279824 2556 scope.go:117] "RemoveContainer" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" Sep 09 23:50:38.280083 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.280064 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806"} err="failed to get container status \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": rpc error: code = NotFound desc = could not find container \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": container with ID starting with 1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806 not found: ID does not exist" Sep 09 23:50:38.280083 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.280081 2556 scope.go:117] "RemoveContainer" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" Sep 09 23:50:38.280302 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.280284 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d"} err="failed to get container status \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": rpc error: code = NotFound desc = could not find container \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": container with ID starting with 97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d not found: ID does not exist" Sep 09 23:50:38.280354 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.280302 2556 scope.go:117] "RemoveContainer" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" Sep 09 23:50:38.280512 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.280495 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c"} err="failed to get container status \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": rpc error: code = NotFound desc = could not find container \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": container with ID starting with fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c not found: ID does not exist" Sep 09 23:50:38.280553 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.280512 2556 scope.go:117] "RemoveContainer" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" Sep 09 23:50:38.280781 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.280754 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc"} err="failed to get container status \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": rpc error: code = NotFound desc = could not find container \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": container with ID starting with 4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc not found: ID does not exist" Sep 09 23:50:38.280834 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.280783 2556 scope.go:117] "RemoveContainer" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" Sep 09 23:50:38.281020 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281003 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7"} err="failed to get container status \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": rpc error: code = NotFound desc = could not find container \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": container with ID starting with 56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7 not found: ID does not exist" Sep 09 23:50:38.281083 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281021 2556 scope.go:117] "RemoveContainer" containerID="21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790" Sep 09 23:50:38.281262 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281242 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790"} err="failed to get container status \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": rpc error: code = NotFound desc = could not find container \"21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790\": container with ID starting with 21dbdc4e6ffd8797b2d97a6536746b969b5e382e035b5dd7fd8d84689329e790 not found: ID does not exist" Sep 09 23:50:38.281312 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281264 2556 scope.go:117] "RemoveContainer" containerID="f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce" Sep 09 23:50:38.281474 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281458 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce"} err="failed to get container status \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": rpc error: code = NotFound desc = could not find container \"f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce\": container with ID starting with f00fcfe488279392ab12c3d00ef30ec1f04939748c55afcafecca77d335194ce not found: ID does not exist" Sep 09 23:50:38.281520 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281474 2556 scope.go:117] "RemoveContainer" containerID="1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806" Sep 09 23:50:38.281695 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281671 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806"} err="failed to get container status \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": rpc error: code = NotFound desc = could not find container \"1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806\": container with ID starting with 1908f5085ac559de3cfaa442adb36368bb5613588cb2f4dea5fe266c68cdc806 not found: ID does not exist" Sep 09 23:50:38.281796 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281695 2556 scope.go:117] "RemoveContainer" containerID="97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d" Sep 09 23:50:38.282016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.281995 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d"} err="failed to get container status \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": rpc error: code = NotFound desc = could not find container \"97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d\": container with ID starting with 97dd9ac871797ab8cacd89b468b182b7bf936c8420a93fa3c27af011bc8deb2d not found: ID does not exist" Sep 09 23:50:38.282016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.282014 2556 scope.go:117] "RemoveContainer" containerID="fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c" Sep 09 23:50:38.282273 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.282256 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c"} err="failed to get container status \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": rpc error: code = NotFound desc = could not find container \"fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c\": container with ID starting with fbe280891540bde7695cea0192ea65c2860f7b270d107f41328d80cf65be7c9c not found: ID does not exist" Sep 09 23:50:38.282273 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.282272 2556 scope.go:117] "RemoveContainer" containerID="4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc" Sep 09 23:50:38.282499 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.282477 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc"} err="failed to get container status \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": rpc error: code = NotFound desc = could not find container \"4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc\": container with ID starting with 4ab221ca9cd3ef41c02d60bbcde6d48f9a2a6f463144012faea43bacbb637ccc not found: ID does not exist" Sep 09 23:50:38.282566 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.282501 2556 scope.go:117] "RemoveContainer" containerID="56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7" Sep 09 23:50:38.282741 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.282722 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7"} err="failed to get container status \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": rpc error: code = NotFound desc = could not find container \"56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7\": container with ID starting with 56b08b0840f3f060244674bc5ecdc6cd9ac735e5e6c98dd3e54e6bfe2c4e7ac7 not found: ID does not exist" Sep 09 23:50:38.353303 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353267 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-2\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353494 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353310 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-grpc-tls\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353494 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353336 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-db\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353494 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353356 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-trusted-ca-bundle\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353494 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353375 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-serving-certs-ca-bundle\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353494 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353401 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-tls\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353494 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353439 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353494 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353475 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-0\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353502 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-config\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353529 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-thanos-prometheus-http-client-file\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353564 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-kubelet-serving-ca-bundle\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353596 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rmvg\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-kube-api-access-2rmvg\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353621 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-config-out\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353674 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-1\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353700 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353715 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353731 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-web-config\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353791 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-metrics-client-ca\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353805 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353814 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353820 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-metrics-client-certs\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.353882 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353879 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-tls-assets\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.354812 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.353946 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-kube-rbac-proxy\") pod \"524d7631-b466-4ed9-99ca-695b92757da5\" (UID: \"524d7631-b466-4ed9-99ca-695b92757da5\") " Sep 09 23:50:38.354812 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.354692 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:38.354812 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.354777 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:50:38.355073 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.355050 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-metrics-client-ca\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.355138 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.355080 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.355138 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.355097 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-db\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.355138 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.355111 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.355138 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.355127 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.355333 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.355148 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:38.355998 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.355971 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:38.356746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.356719 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:50:38.357252 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.357231 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-kube-api-access-2rmvg" (OuterVolumeSpecName: "kube-api-access-2rmvg") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "kube-api-access-2rmvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:50:38.357737 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.357701 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.358036 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.357998 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.358221 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.358147 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.358378 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.358349 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.358474 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.358454 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-config" (OuterVolumeSpecName: "config") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.358742 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.358720 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.359090 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.359064 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-config-out" (OuterVolumeSpecName: "config-out") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:50:38.359213 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.359124 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.359442 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.359424 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:50:38.359511 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.359451 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.367618 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.367593 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-web-config" (OuterVolumeSpecName: "web-config") pod "524d7631-b466-4ed9-99ca-695b92757da5" (UID: "524d7631-b466-4ed9-99ca-695b92757da5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456107 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456151 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rmvg\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-kube-api-access-2rmvg\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456163 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/524d7631-b466-4ed9-99ca-695b92757da5-config-out\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456173 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456183 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456193 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-web-config\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456201 2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-metrics-client-certs\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456208 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/524d7631-b466-4ed9-99ca-695b92757da5-tls-assets\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456203 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456217 2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-kube-rbac-proxy\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456224 2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-grpc-tls\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456232 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456240 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456250 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/524d7631-b466-4ed9-99ca-695b92757da5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456259 2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-config\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:38.456569 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:38.456268 2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/524d7631-b466-4ed9-99ca-695b92757da5-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-250.ec2.internal\" DevicePath \"\"" Sep 09 23:50:39.209583 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.209500 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.231608 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.231576 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:50:39.235635 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.235608 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:50:39.262605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262579 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:50:39.262845 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262832 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy-web" Sep 09 23:50:39.262910 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262846 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy-web" Sep 09 23:50:39.262910 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262858 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="config-reloader" Sep 09 23:50:39.262910 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262864 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="config-reloader" Sep 09 23:50:39.262910 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262873 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy" Sep 09 23:50:39.262910 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262878 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262914 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy-thanos" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262920 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy-thanos" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262928 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="init-config-reloader" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262933 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="init-config-reloader" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262940 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="prometheus" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262945 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="prometheus" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262950 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="thanos-sidecar" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262955 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="thanos-sidecar" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.262994 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy-thanos" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.263000 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.263008 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="thanos-sidecar" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.263014 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="prometheus" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.263020 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="config-reloader" Sep 09 23:50:39.263055 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.263025 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="524d7631-b466-4ed9-99ca-695b92757da5" containerName="kube-rbac-proxy-web" Sep 09 23:50:39.266556 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.266540 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.268934 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.268912 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 23:50:39.269059 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.268947 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 23:50:39.269059 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.269027 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-blnfsfe0dusji\"" Sep 09 23:50:39.269312 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.269283 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 23:50:39.269312 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.269301 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 23:50:39.269645 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.269314 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 23:50:39.269645 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.269370 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 23:50:39.269645 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.269533 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:50:39.269916 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.269752 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 23:50:39.269916 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.269821 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 23:50:39.270126 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.270110 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 23:50:39.270195 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.270126 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 23:50:39.270420 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.270401 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 23:50:39.270670 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.270653 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xgzsx\"" Sep 09 23:50:39.270758 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.270653 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 23:50:39.271956 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.271939 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 23:50:39.274808 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.274791 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 23:50:39.284500 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.284478 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:50:39.365238 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365199 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365409 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365409 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365273 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365409 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365409 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365354 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d7e740f-f3da-4f30-99e0-8425c70c7f11-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365409 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365409 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365409 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365405 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365623 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365623 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365623 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365623 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365623 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365566 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-config\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365623 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365582 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d7e740f-f3da-4f30-99e0-8425c70c7f11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365623 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365820 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365639 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365820 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365666 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365820 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365820 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8967v\" (UniqueName: \"kubernetes.io/projected/3d7e740f-f3da-4f30-99e0-8425c70c7f11-kube-api-access-8967v\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.365820 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.365764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466196 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466196 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466414 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466414 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466414 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d7e740f-f3da-4f30-99e0-8425c70c7f11-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466414 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466414 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466414 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466391 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466426 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-config\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466541 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d7e740f-f3da-4f30-99e0-8425c70c7f11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466561 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466654 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.466702 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8967v\" (UniqueName: \"kubernetes.io/projected/3d7e740f-f3da-4f30-99e0-8425c70c7f11-kube-api-access-8967v\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.467259 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.466708 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.467259 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.467034 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.467259 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.467125 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.467436 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.467410 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.469663 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.469297 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.469663 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.469432 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.469855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.469767 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.470950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.470062 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.470950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.470080 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d7e740f-f3da-4f30-99e0-8425c70c7f11-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.470950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.470479 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.470950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.470623 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.470950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.470631 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.470950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.470635 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.470950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.470814 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d7e740f-f3da-4f30-99e0-8425c70c7f11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.470950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.470907 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d7e740f-f3da-4f30-99e0-8425c70c7f11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.471412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.471101 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.471841 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.471818 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.472388 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.472368 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.472755 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.472735 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d7e740f-f3da-4f30-99e0-8425c70c7f11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.472946 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.472928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d7e740f-f3da-4f30-99e0-8425c70c7f11-config\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.477983 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.477963 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8967v\" (UniqueName: \"kubernetes.io/projected/3d7e740f-f3da-4f30-99e0-8425c70c7f11-kube-api-access-8967v\") pod \"prometheus-k8s-0\" (UID: \"3d7e740f-f3da-4f30-99e0-8425c70c7f11\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.576536 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.576496 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:39.856081 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:39.856047 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:50:39.858114 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:50:39.858086 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7e740f_f3da_4f30_99e0_8425c70c7f11.slice/crio-3efa0547cbb8d0e8e0972077eece8b98bf4ff1e37e1762bb31b01de8627799ca WatchSource:0}: Error finding container 3efa0547cbb8d0e8e0972077eece8b98bf4ff1e37e1762bb31b01de8627799ca: Status 404 returned error can't find the container with id 3efa0547cbb8d0e8e0972077eece8b98bf4ff1e37e1762bb31b01de8627799ca Sep 09 23:50:40.214778 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:40.214742 2556 generic.go:356] "Generic (PLEG): container finished" podID="3d7e740f-f3da-4f30-99e0-8425c70c7f11" containerID="e612061ed87fc86909929602e77a16203b88ef06931f9e12d8fd6fa53df3c829" exitCode=0 Sep 09 23:50:40.215151 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:40.214783 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d7e740f-f3da-4f30-99e0-8425c70c7f11","Type":"ContainerDied","Data":"e612061ed87fc86909929602e77a16203b88ef06931f9e12d8fd6fa53df3c829"} Sep 09 23:50:40.215151 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:40.214833 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d7e740f-f3da-4f30-99e0-8425c70c7f11","Type":"ContainerStarted","Data":"3efa0547cbb8d0e8e0972077eece8b98bf4ff1e37e1762bb31b01de8627799ca"} Sep 09 23:50:40.509950 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:40.509920 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="524d7631-b466-4ed9-99ca-695b92757da5" path="/var/lib/kubelet/pods/524d7631-b466-4ed9-99ca-695b92757da5/volumes" Sep 09 23:50:41.222124 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.222086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d7e740f-f3da-4f30-99e0-8425c70c7f11","Type":"ContainerStarted","Data":"b34f75cdd29917864fb97da37e16ea3dac1df5f466886fb17dd83a8e52ef9fb0"} Sep 09 23:50:41.222559 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.222151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d7e740f-f3da-4f30-99e0-8425c70c7f11","Type":"ContainerStarted","Data":"c04946e84ab9d67ff9b9c6ec2a544009a24cc2d557bd9cb07e64329586b31df0"} Sep 09 23:50:41.222559 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.222177 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d7e740f-f3da-4f30-99e0-8425c70c7f11","Type":"ContainerStarted","Data":"218b20403183b495b8e2055b479033ae93c957a9b0bb4e67a3e7f39879a93d3b"} Sep 09 23:50:41.222559 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.222201 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d7e740f-f3da-4f30-99e0-8425c70c7f11","Type":"ContainerStarted","Data":"fd2f838df81a53cc228bf77dc4b8482e844bf4aa4aec1cd92a3cb249d1c411da"} Sep 09 23:50:41.222559 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.222223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d7e740f-f3da-4f30-99e0-8425c70c7f11","Type":"ContainerStarted","Data":"d04a9297c16aed2efbbfc933669fe34187d6217e5a9ccfd247a3e4a14c6a269f"} Sep 09 23:50:41.222559 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.222251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d7e740f-f3da-4f30-99e0-8425c70c7f11","Type":"ContainerStarted","Data":"a14616536d86e78b68bdeff97a74263e26ffc78f5dfc6072600f7ba21e7b1815"} Sep 09 23:50:41.248604 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.248546 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.229776533 podStartE2EDuration="2.248524044s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.747511ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:50:41.246819941 +0000 UTC m=+147.229553622" watchObservedRunningTime="2026-09-09 23:50:41.248524044 +0000 UTC m=+147.231257751" Sep 09 23:50:41.386373 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.386342 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:41.438093 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:41.438063 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:44.577651 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:44.577617 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:50:48.184315 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:48.184266 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:48.233408 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:48.233380 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:48.287442 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:48.287414 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:50.811425 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:50.811379 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:50.910990 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:50.910953 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:50:59.002065 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:50:59.002030 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:26.040519 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:26.040488 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:26.141149 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:26.141116 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:39.577385 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:39.577344 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:51:39.592660 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:39.592630 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:51:40.463447 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:40.463419 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:51:52.710383 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:52.710344 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:53.505115 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:53.505072 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:55.179042 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:55.179007 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:56.508371 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:56.508339 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:56.609634 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:56.609599 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:57.683275 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:57.683229 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:57.805643 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:57.805605 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:58.216974 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:58.216926 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:51:58.315013 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:51:58.314985 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:00.617039 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:00.616999 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:01.226653 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:01.226625 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:03.113608 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:03.113574 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:03.168806 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:03.168777 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:07.841114 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:07.840998 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:09.669197 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.669162 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pd88d"] Sep 09 23:52:09.672265 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.672245 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pd88d" Sep 09 23:52:09.674658 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.674639 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-m5gld\"" Sep 09 23:52:09.674760 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.674673 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:52:09.675499 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.675486 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:52:09.681521 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.681498 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pd88d"] Sep 09 23:52:09.812316 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.812284 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fec1e3cc-7836-4502-9a6e-df931c6f43d8-bound-sa-token\") pod \"cert-manager-55b4d954d5-pd88d\" (UID: \"fec1e3cc-7836-4502-9a6e-df931c6f43d8\") " pod="cert-manager/cert-manager-55b4d954d5-pd88d" Sep 09 23:52:09.812316 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.812315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdc5\" (UniqueName: \"kubernetes.io/projected/fec1e3cc-7836-4502-9a6e-df931c6f43d8-kube-api-access-2hdc5\") pod \"cert-manager-55b4d954d5-pd88d\" (UID: \"fec1e3cc-7836-4502-9a6e-df931c6f43d8\") " pod="cert-manager/cert-manager-55b4d954d5-pd88d" Sep 09 23:52:09.913676 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.913647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fec1e3cc-7836-4502-9a6e-df931c6f43d8-bound-sa-token\") pod \"cert-manager-55b4d954d5-pd88d\" (UID: \"fec1e3cc-7836-4502-9a6e-df931c6f43d8\") " pod="cert-manager/cert-manager-55b4d954d5-pd88d" Sep 09 23:52:09.913676 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.913678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdc5\" (UniqueName: \"kubernetes.io/projected/fec1e3cc-7836-4502-9a6e-df931c6f43d8-kube-api-access-2hdc5\") pod \"cert-manager-55b4d954d5-pd88d\" (UID: \"fec1e3cc-7836-4502-9a6e-df931c6f43d8\") " pod="cert-manager/cert-manager-55b4d954d5-pd88d" Sep 09 23:52:09.921367 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.921305 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fec1e3cc-7836-4502-9a6e-df931c6f43d8-bound-sa-token\") pod \"cert-manager-55b4d954d5-pd88d\" (UID: \"fec1e3cc-7836-4502-9a6e-df931c6f43d8\") " pod="cert-manager/cert-manager-55b4d954d5-pd88d" Sep 09 23:52:09.921521 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.921502 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdc5\" (UniqueName: \"kubernetes.io/projected/fec1e3cc-7836-4502-9a6e-df931c6f43d8-kube-api-access-2hdc5\") pod \"cert-manager-55b4d954d5-pd88d\" (UID: \"fec1e3cc-7836-4502-9a6e-df931c6f43d8\") " pod="cert-manager/cert-manager-55b4d954d5-pd88d" Sep 09 23:52:09.995461 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:09.995429 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pd88d" Sep 09 23:52:10.263042 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:10.262864 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pd88d"] Sep 09 23:52:10.265744 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:52:10.265716 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec1e3cc_7836_4502_9a6e_df931c6f43d8.slice/crio-0d166045446f9435285486fd7c9c90498af862cae6d762c51c53ccd79cdee767 WatchSource:0}: Error finding container 0d166045446f9435285486fd7c9c90498af862cae6d762c51c53ccd79cdee767: Status 404 returned error can't find the container with id 0d166045446f9435285486fd7c9c90498af862cae6d762c51c53ccd79cdee767 Sep 09 23:52:10.560706 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:10.560619 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pd88d" event={"ID":"fec1e3cc-7836-4502-9a6e-df931c6f43d8","Type":"ContainerStarted","Data":"0d166045446f9435285486fd7c9c90498af862cae6d762c51c53ccd79cdee767"} Sep 09 23:52:13.329519 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:13.329481 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:13.429258 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:13.429233 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:13.574064 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:13.574031 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pd88d" event={"ID":"fec1e3cc-7836-4502-9a6e-df931c6f43d8","Type":"ContainerStarted","Data":"f05943c369d737bb0d1cbb6c5dab5baf5b6ca5787fc66db709373d0d8863ddb1"} Sep 09 23:52:13.590442 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:13.590361 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pd88d" podStartSLOduration=1.474302765 podStartE2EDuration="4.590346831s" totalImagesPullingTime="3.116044066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:52:13.588770682 +0000 UTC m=+239.571504367" watchObservedRunningTime="2026-09-09 23:52:13.590346831 +0000 UTC m=+239.573080512" Sep 09 23:52:20.064341 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:20.064303 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:20.164724 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:20.164698 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:22.174592 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:22.174561 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:29.258938 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:29.258901 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:29.307163 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:29.307129 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:33.910837 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:33.910805 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:34.008697 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.008666 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:34.481728 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.481687 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:34.631799 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.631769 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:34.734186 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.734102 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:34.760163 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.760131 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z"] Sep 09 23:52:34.765261 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.765242 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.767651 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.767633 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:52:34.768000 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.767986 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:52:34.768115 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.768092 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hsxhq\"" Sep 09 23:52:34.768318 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.768302 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:52:34.768366 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.768350 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:52:34.790872 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.790846 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z"] Sep 09 23:52:34.814323 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.814299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.814448 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.814332 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-manifests\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.814448 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.814370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.814448 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.814413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-tmp\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.814549 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.814464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np4rh\" (UniqueName: \"kubernetes.io/projected/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-kube-api-access-np4rh\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.912626 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.912597 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:34.915701 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.915679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.915771 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.915731 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-tmp\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.915771 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.915758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np4rh\" (UniqueName: \"kubernetes.io/projected/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-kube-api-access-np4rh\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.915864 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.915786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.915864 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.915806 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-manifests\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.916246 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.916221 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-manifests\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.917844 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.917817 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-tmp\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.918134 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.918117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.918228 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.918209 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:34.924461 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:34.924437 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np4rh\" (UniqueName: \"kubernetes.io/projected/9eb6ca31-c22b-4ede-b2bd-3809459fad5b-kube-api-access-np4rh\") pod \"opendatahub-operator-controller-manager-7547cdb9fd-s7s2z\" (UID: \"9eb6ca31-c22b-4ede-b2bd-3809459fad5b\") " pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:35.013360 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:35.013283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:35.075337 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:35.075308 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:35.116957 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:35.116916 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:35.226812 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:35.226770 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:35.320031 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:35.319926 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:35.354703 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:35.354680 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z"] Sep 09 23:52:35.357338 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:52:35.357309 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb6ca31_c22b_4ede_b2bd_3809459fad5b.slice/crio-fe5bfcd61792d2e2328d68d8600f0c6a1f79bedf7cded6c6d6d0c3b670c973b1 WatchSource:0}: Error finding container fe5bfcd61792d2e2328d68d8600f0c6a1f79bedf7cded6c6d6d0c3b670c973b1: Status 404 returned error can't find the container with id fe5bfcd61792d2e2328d68d8600f0c6a1f79bedf7cded6c6d6d0c3b670c973b1 Sep 09 23:52:35.418386 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:35.418355 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:35.656723 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:35.656695 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" event={"ID":"9eb6ca31-c22b-4ede-b2bd-3809459fad5b","Type":"ContainerStarted","Data":"fe5bfcd61792d2e2328d68d8600f0c6a1f79bedf7cded6c6d6d0c3b670c973b1"} Sep 09 23:52:36.475362 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:36.475283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:36.555358 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:36.555317 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:38.672217 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:38.672188 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" event={"ID":"9eb6ca31-c22b-4ede-b2bd-3809459fad5b","Type":"ContainerStarted","Data":"ef4032500aaad54af9a9acec8c2ffeae189f7f083980de3744275ab4de823d52"} Sep 09 23:52:39.678011 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:39.677977 2556 generic.go:356] "Generic (PLEG): container finished" podID="9eb6ca31-c22b-4ede-b2bd-3809459fad5b" containerID="ef4032500aaad54af9a9acec8c2ffeae189f7f083980de3744275ab4de823d52" exitCode=0 Sep 09 23:52:39.678408 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:39.678067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" event={"ID":"9eb6ca31-c22b-4ede-b2bd-3809459fad5b","Type":"ContainerDied","Data":"ef4032500aaad54af9a9acec8c2ffeae189f7f083980de3744275ab4de823d52"} Sep 09 23:52:40.683534 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:40.683503 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" event={"ID":"9eb6ca31-c22b-4ede-b2bd-3809459fad5b","Type":"ContainerStarted","Data":"5bc1c7d9b4cf4bcf42897e79d43219797e05285a47226e0fd7f81ba112386112"} Sep 09 23:52:40.683953 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:40.683610 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:40.703467 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:40.703422 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" podStartSLOduration=2.166350355 podStartE2EDuration="6.703408771s" totalImagesPullingTime="3.459884956s" totalInitContainerRuntime="1.07717346s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:52:40.701934733 +0000 UTC m=+266.684668415" watchObservedRunningTime="2026-09-09 23:52:40.703408771 +0000 UTC m=+266.686142451" Sep 09 23:52:48.385269 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:48.385231 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:48.449011 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:48.448973 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:51.690016 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:51.689984 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7547cdb9fd-s7s2z" Sep 09 23:52:53.708796 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:53.708761 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:53.807978 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:53.807949 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:54.036785 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.036710 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:54.067568 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.067529 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-947759788-dm7xb"] Sep 09 23:52:54.077087 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.077060 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.077601 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.077574 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-947759788-dm7xb"] Sep 09 23:52:54.079776 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.079753 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:52:54.079909 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.079775 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:52:54.079909 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.079864 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-txx8m\"" Sep 09 23:52:54.080023 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.080005 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 09 23:52:54.080068 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.080020 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 09 23:52:54.162687 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.162653 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e631e214-6de7-4de1-8f2f-afd785bf0b9d-tmp\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.162845 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.162704 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e631e214-6de7-4de1-8f2f-afd785bf0b9d-tls-certs\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.162845 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.162787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27w52\" (UniqueName: \"kubernetes.io/projected/e631e214-6de7-4de1-8f2f-afd785bf0b9d-kube-api-access-27w52\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.212717 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.212685 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:54.263528 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.263497 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27w52\" (UniqueName: \"kubernetes.io/projected/e631e214-6de7-4de1-8f2f-afd785bf0b9d-kube-api-access-27w52\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.263631 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.263539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e631e214-6de7-4de1-8f2f-afd785bf0b9d-tmp\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.263631 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.263577 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e631e214-6de7-4de1-8f2f-afd785bf0b9d-tls-certs\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.265825 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.265798 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e631e214-6de7-4de1-8f2f-afd785bf0b9d-tmp\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.265946 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.265931 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e631e214-6de7-4de1-8f2f-afd785bf0b9d-tls-certs\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.271916 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.271875 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27w52\" (UniqueName: \"kubernetes.io/projected/e631e214-6de7-4de1-8f2f-afd785bf0b9d-kube-api-access-27w52\") pod \"kube-auth-proxy-947759788-dm7xb\" (UID: \"e631e214-6de7-4de1-8f2f-afd785bf0b9d\") " pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.387241 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.387161 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" Sep 09 23:52:54.653696 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.653664 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-947759788-dm7xb"] Sep 09 23:52:54.656799 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:52:54.656771 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode631e214_6de7_4de1_8f2f_afd785bf0b9d.slice/crio-1619fc5653159fdb2c64631d4480e484929f41efb87f679465459aef39ca9c01 WatchSource:0}: Error finding container 1619fc5653159fdb2c64631d4480e484929f41efb87f679465459aef39ca9c01: Status 404 returned error can't find the container with id 1619fc5653159fdb2c64631d4480e484929f41efb87f679465459aef39ca9c01 Sep 09 23:52:54.742008 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:54.741964 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" event={"ID":"e631e214-6de7-4de1-8f2f-afd785bf0b9d","Type":"ContainerStarted","Data":"1619fc5653159fdb2c64631d4480e484929f41efb87f679465459aef39ca9c01"} Sep 09 23:52:55.252516 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:55.252482 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:55.313617 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:55.313577 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:56.276424 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:56.276392 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:52:57.756992 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:57.756937 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" event={"ID":"e631e214-6de7-4de1-8f2f-afd785bf0b9d","Type":"ContainerStarted","Data":"6b423745df281b6203b6102ad91c396dfa575ff0076aac666e43bc3e75a8c981"} Sep 09 23:52:57.775944 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:52:57.775884 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-947759788-dm7xb" podStartSLOduration=0.890594803 podStartE2EDuration="3.775868994s" totalImagesPullingTime="2.885274191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:52:57.774536444 +0000 UTC m=+283.757270125" watchObservedRunningTime="2026-09-09 23:52:57.775868994 +0000 UTC m=+283.758602674" Sep 09 23:53:00.047484 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.047445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:00.112463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.112434 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:00.343931 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.343844 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf"] Sep 09 23:53:00.347033 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.347010 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.349759 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.349737 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-phn8f\"" Sep 09 23:53:00.350119 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.350103 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:53:00.366025 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.366006 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf"] Sep 09 23:53:00.395281 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.395253 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:00.415384 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.415509 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.415553 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.415553 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415528 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.415628 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4qhv\" (UniqueName: \"kubernetes.io/projected/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-kube-api-access-z4qhv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.415628 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.415628 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415608 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.415746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.415746 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.415677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.512509 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.512447 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:00.516573 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.516714 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516580 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.516714 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.516714 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4qhv\" (UniqueName: \"kubernetes.io/projected/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-kube-api-access-z4qhv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.516714 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516651 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.516714 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.516714 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.517079 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516733 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.517079 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.516769 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.517245 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.517218 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.517309 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.517278 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.517364 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.517323 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.517364 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.517347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.517534 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.517516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.518952 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.518931 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.519151 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.519135 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.527093 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.527071 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.527237 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.527220 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4qhv\" (UniqueName: \"kubernetes.io/projected/97a2d869-15f1-46e7-a034-a8e62f5dbbfb-kube-api-access-z4qhv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf\" (UID: \"97a2d869-15f1-46e7-a034-a8e62f5dbbfb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.656377 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.656338 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:00.773502 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.773472 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:00.939630 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:00.939525 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf"] Sep 09 23:53:00.942164 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:53:00.942137 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a2d869_15f1_46e7_a034_a8e62f5dbbfb.slice/crio-679f03aa915c72a58f46f17ccb1f17e7b3db1f549d2b3e30eef3b28aeb2044c4 WatchSource:0}: Error finding container 679f03aa915c72a58f46f17ccb1f17e7b3db1f549d2b3e30eef3b28aeb2044c4: Status 404 returned error can't find the container with id 679f03aa915c72a58f46f17ccb1f17e7b3db1f549d2b3e30eef3b28aeb2044c4 Sep 09 23:53:01.773117 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:01.773085 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" event={"ID":"97a2d869-15f1-46e7-a034-a8e62f5dbbfb","Type":"ContainerStarted","Data":"679f03aa915c72a58f46f17ccb1f17e7b3db1f549d2b3e30eef3b28aeb2044c4"} Sep 09 23:53:04.064433 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.064345 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:53:04.064693 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.064476 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:53:04.064693 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.064506 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:53:04.786720 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.786687 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" event={"ID":"97a2d869-15f1-46e7-a034-a8e62f5dbbfb","Type":"ContainerStarted","Data":"3eab102220dd1b61b9a5622996ccedbc9aa289b71196c18edb117f2617868305"} Sep 09 23:53:04.811449 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.811399 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" podStartSLOduration=1.691359486 podStartE2EDuration="4.811382842s" totalImagesPullingTime="3.120023356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:04.809936695 +0000 UTC m=+290.792670376" watchObservedRunningTime="2026-09-09 23:53:04.811382842 +0000 UTC m=+290.794116522" Sep 09 23:53:04.888312 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.888279 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rfjjm"] Sep 09 23:53:04.891424 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.891407 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:04.894627 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.894605 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 09 23:53:04.894784 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.894766 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m6dhq\"" Sep 09 23:53:04.902718 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.902696 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rfjjm"] Sep 09 23:53:04.909768 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.909747 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:04.962409 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.962373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/123c4e43-ec05-49b5-b019-0b11e1c046e7-cert\") pod \"odh-model-controller-7998c67dc4-rfjjm\" (UID: \"123c4e43-ec05-49b5-b019-0b11e1c046e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:04.962563 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.962434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jngk\" (UniqueName: \"kubernetes.io/projected/123c4e43-ec05-49b5-b019-0b11e1c046e7-kube-api-access-8jngk\") pod \"odh-model-controller-7998c67dc4-rfjjm\" (UID: \"123c4e43-ec05-49b5-b019-0b11e1c046e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:04.968302 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:04.968269 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:05.063207 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.063126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/123c4e43-ec05-49b5-b019-0b11e1c046e7-cert\") pod \"odh-model-controller-7998c67dc4-rfjjm\" (UID: \"123c4e43-ec05-49b5-b019-0b11e1c046e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:05.063207 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.063173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jngk\" (UniqueName: \"kubernetes.io/projected/123c4e43-ec05-49b5-b019-0b11e1c046e7-kube-api-access-8jngk\") pod \"odh-model-controller-7998c67dc4-rfjjm\" (UID: \"123c4e43-ec05-49b5-b019-0b11e1c046e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:05.065192 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.065166 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:05.065734 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.065715 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/123c4e43-ec05-49b5-b019-0b11e1c046e7-cert\") pod \"odh-model-controller-7998c67dc4-rfjjm\" (UID: \"123c4e43-ec05-49b5-b019-0b11e1c046e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:05.070109 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.070082 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jngk\" (UniqueName: \"kubernetes.io/projected/123c4e43-ec05-49b5-b019-0b11e1c046e7-kube-api-access-8jngk\") pod \"odh-model-controller-7998c67dc4-rfjjm\" (UID: \"123c4e43-ec05-49b5-b019-0b11e1c046e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:05.166196 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.166156 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:05.201344 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.201317 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:05.385162 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.385083 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:05.406064 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.406032 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kzz8l"] Sep 09 23:53:05.410458 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.410442 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:05.412705 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.412685 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gjpjz\"" Sep 09 23:53:05.412705 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.412684 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 09 23:53:05.418614 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.418595 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kzz8l"] Sep 09 23:53:05.468999 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.468977 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rfjjm"] Sep 09 23:53:05.471282 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:53:05.471256 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123c4e43_ec05_49b5_b019_0b11e1c046e7.slice/crio-4f3e64d8874108660bff8bd96b91029e38e9cf21bf0d8340a3960f2f56a12d9d WatchSource:0}: Error finding container 4f3e64d8874108660bff8bd96b91029e38e9cf21bf0d8340a3960f2f56a12d9d: Status 404 returned error can't find the container with id 4f3e64d8874108660bff8bd96b91029e38e9cf21bf0d8340a3960f2f56a12d9d Sep 09 23:53:05.567903 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.567867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hv84\" (UniqueName: \"kubernetes.io/projected/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-kube-api-access-4hv84\") pod \"model-serving-api-54d89bd5fc-kzz8l\" (UID: \"831c8b42-8a6a-40a2-8c0d-0dd2a4831986\") " pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:05.568051 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.567952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-tls-certs\") pod \"model-serving-api-54d89bd5fc-kzz8l\" (UID: \"831c8b42-8a6a-40a2-8c0d-0dd2a4831986\") " pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:05.657280 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.657255 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:05.661435 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.661410 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:05.668670 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.668649 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hv84\" (UniqueName: \"kubernetes.io/projected/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-kube-api-access-4hv84\") pod \"model-serving-api-54d89bd5fc-kzz8l\" (UID: \"831c8b42-8a6a-40a2-8c0d-0dd2a4831986\") " pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:05.668740 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.668703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-tls-certs\") pod \"model-serving-api-54d89bd5fc-kzz8l\" (UID: \"831c8b42-8a6a-40a2-8c0d-0dd2a4831986\") " pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:05.668818 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:53:05.668807 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 09 23:53:05.668872 ip-10-0-131-250 kubenswrapper[2556]: E0909 23:53:05.668855 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-tls-certs podName:831c8b42-8a6a-40a2-8c0d-0dd2a4831986 nodeName:}" failed. No retries permitted until 2026-09-09 23:53:06.168841025 +0000 UTC m=+292.151574683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-tls-certs") pod "model-serving-api-54d89bd5fc-kzz8l" (UID: "831c8b42-8a6a-40a2-8c0d-0dd2a4831986") : secret "model-serving-api-tls" not found Sep 09 23:53:05.676304 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.676281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hv84\" (UniqueName: \"kubernetes.io/projected/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-kube-api-access-4hv84\") pod \"model-serving-api-54d89bd5fc-kzz8l\" (UID: \"831c8b42-8a6a-40a2-8c0d-0dd2a4831986\") " pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:05.795478 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.795449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" event={"ID":"123c4e43-ec05-49b5-b019-0b11e1c046e7","Type":"ContainerStarted","Data":"4f3e64d8874108660bff8bd96b91029e38e9cf21bf0d8340a3960f2f56a12d9d"} Sep 09 23:53:05.795737 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.795721 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:05.796570 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.796553 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf" Sep 09 23:53:05.831628 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:05.831593 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:06.172577 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:06.172539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-tls-certs\") pod \"model-serving-api-54d89bd5fc-kzz8l\" (UID: \"831c8b42-8a6a-40a2-8c0d-0dd2a4831986\") " pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:06.175099 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:06.175074 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/831c8b42-8a6a-40a2-8c0d-0dd2a4831986-tls-certs\") pod \"model-serving-api-54d89bd5fc-kzz8l\" (UID: \"831c8b42-8a6a-40a2-8c0d-0dd2a4831986\") " pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:06.321999 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:06.321966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:06.605834 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:06.605726 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kzz8l"] Sep 09 23:53:06.618989 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:53:06.618946 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831c8b42_8a6a_40a2_8c0d_0dd2a4831986.slice/crio-cb3aadc8033d282170f40606f323159914d2fd641e0b5860dcd771aecdb4e2be WatchSource:0}: Error finding container cb3aadc8033d282170f40606f323159914d2fd641e0b5860dcd771aecdb4e2be: Status 404 returned error can't find the container with id cb3aadc8033d282170f40606f323159914d2fd641e0b5860dcd771aecdb4e2be Sep 09 23:53:06.803594 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:06.803547 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" event={"ID":"831c8b42-8a6a-40a2-8c0d-0dd2a4831986","Type":"ContainerStarted","Data":"cb3aadc8033d282170f40606f323159914d2fd641e0b5860dcd771aecdb4e2be"} Sep 09 23:53:08.814220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:08.814185 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" event={"ID":"123c4e43-ec05-49b5-b019-0b11e1c046e7","Type":"ContainerStarted","Data":"a47f115f26bac0e946123b09d3dfa4b41a6ff527eea31a3012748dbbfe2012a8"} Sep 09 23:53:08.814604 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:08.814259 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:08.829013 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:08.828967 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" podStartSLOduration=1.977100684 podStartE2EDuration="4.828952354s" totalImagesPullingTime="2.85185167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:08.827958868 +0000 UTC m=+294.810692550" watchObservedRunningTime="2026-09-09 23:53:08.828952354 +0000 UTC m=+294.811686035" Sep 09 23:53:09.820374 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:09.820332 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" event={"ID":"831c8b42-8a6a-40a2-8c0d-0dd2a4831986","Type":"ContainerStarted","Data":"64464938ccf98e138638932c01ec25b30e34e45abed0e7f38c03cdd627bcbc25"} Sep 09 23:53:09.820835 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:09.820674 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:09.836706 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:09.836666 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" podStartSLOduration=2.154549605 podStartE2EDuration="4.836652639s" totalImagesPullingTime="2.682103034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:09.835409144 +0000 UTC m=+295.818142826" watchObservedRunningTime="2026-09-09 23:53:09.836652639 +0000 UTC m=+295.819386319" Sep 09 23:53:11.359963 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.359930 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv"] Sep 09 23:53:11.365444 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.365423 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.369594 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.369574 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 23:53:11.369694 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.369577 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 23:53:11.370456 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.370440 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5zmbg\"" Sep 09 23:53:11.371175 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.371159 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 23:53:11.409447 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.409419 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv"] Sep 09 23:53:11.522386 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.522351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.522386 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.522387 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.522568 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.522417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.522568 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.522525 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.522568 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.522554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.522664 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.522616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4phx\" (UniqueName: \"kubernetes.io/projected/e1568a86-5991-43b2-800d-3a6b74ec5891-kube-api-access-r4phx\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.522664 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.522645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1568a86-5991-43b2-800d-3a6b74ec5891-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.623144 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.623063 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.623144 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.623103 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.623327 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.623279 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.623385 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.623343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.623446 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.623402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.623560 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.623538 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4phx\" (UniqueName: \"kubernetes.io/projected/e1568a86-5991-43b2-800d-3a6b74ec5891-kube-api-access-r4phx\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.623629 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.623598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1568a86-5991-43b2-800d-3a6b74ec5891-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.624086 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.623981 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.625980 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.625946 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.626094 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.625985 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.626255 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.626236 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1568a86-5991-43b2-800d-3a6b74ec5891-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.626453 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.626436 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.631627 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.631605 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1568a86-5991-43b2-800d-3a6b74ec5891-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.632225 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.632195 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4phx\" (UniqueName: \"kubernetes.io/projected/e1568a86-5991-43b2-800d-3a6b74ec5891-kube-api-access-r4phx\") pod \"istiod-openshift-gateway-5677ccb49b-sgdmv\" (UID: \"e1568a86-5991-43b2-800d-3a6b74ec5891\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.674880 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.674853 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:11.972021 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:11.971986 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv"] Sep 09 23:53:11.979145 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:53:11.979114 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1568a86_5991_43b2_800d_3a6b74ec5891.slice/crio-abcba81437e5e020bc5ab5ca0f84a3497df4499d83c2cbb8d80ad3423b3b9385 WatchSource:0}: Error finding container abcba81437e5e020bc5ab5ca0f84a3497df4499d83c2cbb8d80ad3423b3b9385: Status 404 returned error can't find the container with id abcba81437e5e020bc5ab5ca0f84a3497df4499d83c2cbb8d80ad3423b3b9385 Sep 09 23:53:12.836643 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.836605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" event={"ID":"e1568a86-5991-43b2-800d-3a6b74ec5891","Type":"ContainerStarted","Data":"abcba81437e5e020bc5ab5ca0f84a3497df4499d83c2cbb8d80ad3423b3b9385"} Sep 09 23:53:12.853255 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.853224 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-758756f974-mdc9s"] Sep 09 23:53:12.855734 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.855709 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:12.859730 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.859699 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-shcl2\"" Sep 09 23:53:12.859855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.859746 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:53:12.860068 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.860023 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:53:12.860068 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.860027 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:53:12.860068 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.860058 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:53:12.860380 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.860029 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:53:12.869296 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.869272 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758756f974-mdc9s"] Sep 09 23:53:12.935297 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.935267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-cert\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:12.935442 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.935317 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-metrics-cert\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:12.935442 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.935430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqddp\" (UniqueName: \"kubernetes.io/projected/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-kube-api-access-zqddp\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:12.935546 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:12.935452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-manager-config\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.036611 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.036572 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqddp\" (UniqueName: \"kubernetes.io/projected/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-kube-api-access-zqddp\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.036611 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.036615 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-manager-config\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.036839 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.036756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-cert\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.036839 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.036807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-metrics-cert\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.037428 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.037398 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-manager-config\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.039574 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.039551 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-metrics-cert\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.039661 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.039571 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-cert\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.045555 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.045531 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqddp\" (UniqueName: \"kubernetes.io/projected/2ca14f29-5d10-4709-8fd3-680ecc1d21ae-kube-api-access-zqddp\") pod \"lws-controller-manager-758756f974-mdc9s\" (UID: \"2ca14f29-5d10-4709-8fd3-680ecc1d21ae\") " pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.167545 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.167506 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:13.450465 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.450430 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758756f974-mdc9s"] Sep 09 23:53:13.905249 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:13.905215 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:14.006039 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.006006 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:14.085371 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.085340 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:14.195962 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.195870 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:14.204430 ip-10-0-131-250 kubenswrapper[2556]: W0909 23:53:14.204402 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca14f29_5d10_4709_8fd3_680ecc1d21ae.slice/crio-a8a0a509a83548ffca7f7b55d50b7d4a9623580e635cab8b6c625ea1dafeba41 WatchSource:0}: Error finding container a8a0a509a83548ffca7f7b55d50b7d4a9623580e635cab8b6c625ea1dafeba41: Status 404 returned error can't find the container with id a8a0a509a83548ffca7f7b55d50b7d4a9623580e635cab8b6c625ea1dafeba41 Sep 09 23:53:14.241220 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.241189 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:53:14.241295 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.241251 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:53:14.420166 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.420138 2556 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:53:14.791357 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.791320 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:14.861840 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.861627 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" event={"ID":"2ca14f29-5d10-4709-8fd3-680ecc1d21ae","Type":"ContainerStarted","Data":"a8a0a509a83548ffca7f7b55d50b7d4a9623580e635cab8b6c625ea1dafeba41"} Sep 09 23:53:14.865038 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.865009 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" event={"ID":"e1568a86-5991-43b2-800d-3a6b74ec5891","Type":"ContainerStarted","Data":"ddcea7dc8635d6c0f7c7b803f261eed7ebddf490413f60020d020ff023da34c2"} Sep 09 23:53:14.865921 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.865869 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:14.901531 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:14.901464 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" podStartSLOduration=1.641931571 podStartE2EDuration="3.901445935s" totalImagesPullingTime="2.259514364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:14.899520626 +0000 UTC m=+300.882254310" watchObservedRunningTime="2026-09-09 23:53:14.901445935 +0000 UTC m=+300.884179617" Sep 09 23:53:15.190082 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:15.190045 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:15.293731 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:15.293680 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:15.427427 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:15.427391 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:15.873013 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:15.872957 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sgdmv" Sep 09 23:53:16.876463 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:16.876426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" event={"ID":"2ca14f29-5d10-4709-8fd3-680ecc1d21ae","Type":"ContainerStarted","Data":"49928ed6317664a259a2b7abe2183a206df2c69996135332ed50c397570dc026"} Sep 09 23:53:16.876855 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:16.876770 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:19.822738 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:19.822707 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rfjjm" Sep 09 23:53:19.838468 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:19.838375 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" podStartSLOduration=5.657605689 podStartE2EDuration="7.838355669s" totalImagesPullingTime="2.18074998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:53:16.896097998 +0000 UTC m=+302.878831674" watchObservedRunningTime="2026-09-09 23:53:19.838355669 +0000 UTC m=+305.821089352" Sep 09 23:53:20.829804 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:20.829774 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-kzz8l" Sep 09 23:53:27.882817 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:27.882788 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-758756f974-mdc9s" Sep 09 23:53:49.552758 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:49.552722 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:49.611819 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:49.611789 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:53:56.984637 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:53:56.984603 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:05.911384 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:05.911345 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:06.014346 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:06.014310 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:08.454663 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:08.454624 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:08.554868 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:08.554838 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:19.433618 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:19.433585 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:19.534186 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:19.534142 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:23.377671 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:23.377636 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:23.434953 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:23.434923 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:34.252244 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:34.252206 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:34.300794 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:34.300759 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:34.355066 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:34.355037 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:34.412743 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:34.412717 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:47.547377 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:47.547343 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:48.327670 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:48.327636 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:51.343310 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:51.343279 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:51.584521 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:51.584472 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:51.744536 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:51.744506 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:52.340105 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:52.340074 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:54.197807 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:54.197775 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:54.305158 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:54.305123 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:55.563670 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:55.563634 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:56.185107 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:56.185069 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:57.758694 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:57.758653 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:54:57.864514 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:54:57.864488 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:00.957771 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:00.957739 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:01.054392 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:01.054357 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:02.183695 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:02.183657 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:02.255486 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:02.255452 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:04.462739 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:04.462707 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:04.661134 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:04.661103 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:08.142530 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:08.142489 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:08.194849 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:08.194816 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:08.741805 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:08.741772 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:08.796212 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:08.796184 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:09.339784 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:09.339753 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:09.441132 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:09.441096 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:16.565109 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:16.565068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:16.666977 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:16.666940 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:20.737446 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:20.737409 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:20.838797 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:20.838763 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:24.338973 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:24.338940 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:24.438595 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:24.438559 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:24.538907 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:24.538853 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:24.596854 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:24.596779 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:30.138715 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:30.138677 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:30.189059 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:30.189028 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:30.538412 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:30.538380 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:30.589642 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:30.589612 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:30.948317 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:30.948286 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:31.001852 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:31.001819 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:35.593148 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:35.593108 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:35.650833 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:35.650802 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:36.595673 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:36.595638 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:36.649508 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:36.649475 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:41.356406 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:41.356316 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:41.462343 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:41.462312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:48.203218 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:48.203182 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:48.354669 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:48.354636 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:55:50.291713 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:55:50.291675 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:02.807101 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:02.807063 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:02.890029 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:02.889983 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:02.989901 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:02.989858 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:03.390027 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:03.389993 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:03.495899 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:03.495848 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:03.625788 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:03.625755 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:03.721448 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:03.721411 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:07.258068 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:07.258040 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:20.234499 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:20.234468 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:20.337384 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:20.337352 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:20.687138 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:20.687113 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:32.820303 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:32.820272 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:33.489298 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:33.489261 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:33.741726 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:33.741643 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:40.437643 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:40.437609 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:40.532226 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:40.532195 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:40.632488 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:40.632454 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:40.692713 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:40.692634 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:43.919754 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:43.919720 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:56:44.018361 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:56:44.018329 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:07.708127 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:07.708049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:15.668045 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:15.668010 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:15.763271 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:15.763221 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:17.243465 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:17.243433 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:17.347523 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:17.347488 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:17.497009 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:17.496874 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:17.611717 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:17.611663 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:18.033205 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:18.033170 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:18.178718 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:18.178683 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:28.371173 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:28.371128 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:28.465316 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:28.465283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:32.698319 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:32.698284 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:40.895605 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:40.895569 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:57:55.302695 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:57:55.302661 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:58:09.191424 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:58:09.191392 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:58:24.093630 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:58:24.093586 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:58:28.586028 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:58:28.585990 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 09 23:58:36.392673 ip-10-0-131-250 kubenswrapper[2556]: I0909 23:58:36.392642 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 10 00:00:00.137864 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:00.137826 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5"] Sep 10 00:00:00.141700 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:00.141679 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5" Sep 10 00:00:00.144291 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:00.144268 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zqh8t\"" Sep 10 00:00:00.148196 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:00.148171 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5"] Sep 10 00:00:00.177921 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:00.177883 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5" Sep 10 00:00:00.448770 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:00.448736 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5"] Sep 10 00:00:00.452256 ip-10-0-131-250 kubenswrapper[2556]: W0910 00:00:00.452230 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171bdfd9_1ce0_4c8d_9337_14bebbc038d3.slice/crio-b100ee9e2e3c4993e8aec722080d81595796e5c58822dbe6df64eea470912450 WatchSource:0}: Error finding container b100ee9e2e3c4993e8aec722080d81595796e5c58822dbe6df64eea470912450: Status 404 returned error can't find the container with id b100ee9e2e3c4993e8aec722080d81595796e5c58822dbe6df64eea470912450 Sep 10 00:00:00.454359 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:00.454340 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 00:00:00.665486 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:00.665448 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5" event={"ID":"171bdfd9-1ce0-4c8d-9337-14bebbc038d3","Type":"ContainerStarted","Data":"b100ee9e2e3c4993e8aec722080d81595796e5c58822dbe6df64eea470912450"} Sep 10 00:00:05.689799 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:05.689770 2556 generic.go:356] "Generic (PLEG): container finished" podID="171bdfd9-1ce0-4c8d-9337-14bebbc038d3" containerID="cdc06608adee98c804b3655b1fb63f959ad5744e62bbc619d42d86f0b38af346" exitCode=0 Sep 10 00:00:05.690129 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:05.689826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5" event={"ID":"171bdfd9-1ce0-4c8d-9337-14bebbc038d3","Type":"ContainerDied","Data":"cdc06608adee98c804b3655b1fb63f959ad5744e62bbc619d42d86f0b38af346"} Sep 10 00:00:06.816277 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:06.816252 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5" Sep 10 00:00:07.700879 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:07.700797 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5" Sep 10 00:00:07.700879 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:07.700804 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816640-gv4v5" event={"ID":"171bdfd9-1ce0-4c8d-9337-14bebbc038d3","Type":"ContainerDied","Data":"b100ee9e2e3c4993e8aec722080d81595796e5c58822dbe6df64eea470912450"} Sep 10 00:00:07.700879 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:00:07.700849 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b100ee9e2e3c4993e8aec722080d81595796e5c58822dbe6df64eea470912450" Sep 10 00:01:11.486060 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:01:11.486024 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 10 00:01:56.820917 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:01:56.820790 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 10 00:02:38.134812 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:38.134777 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kzz8l_831c8b42-8a6a-40a2-8c0d-0dd2a4831986/server/0.log" Sep 10 00:02:38.257523 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:38.257487 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rfjjm_123c4e43-ec05-49b5-b019-0b11e1c046e7/manager/0.log" Sep 10 00:02:38.503802 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:38.503771 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7547cdb9fd-s7s2z_9eb6ca31-c22b-4ede-b2bd-3809459fad5b/manager/0.log" Sep 10 00:02:38.509478 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:38.509453 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7547cdb9fd-s7s2z_9eb6ca31-c22b-4ede-b2bd-3809459fad5b/copy-manifests/0.log" Sep 10 00:02:39.086344 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:39.086315 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816640-gv4v5_171bdfd9-1ce0-4c8d-9337-14bebbc038d3/cleanup/0.log" Sep 10 00:02:41.063175 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:41.063141 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf_97a2d869-15f1-46e7-a034-a8e62f5dbbfb/istio-proxy/0.log" Sep 10 00:02:41.184905 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:41.184864 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sgdmv_e1568a86-5991-43b2-800d-3a6b74ec5891/discovery/0.log" Sep 10 00:02:41.302233 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:41.302202 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-947759788-dm7xb_e631e214-6de7-4de1-8f2f-afd785bf0b9d/kube-auth-proxy/0.log" Sep 10 00:02:48.756349 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:48.756312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 10 00:02:48.854404 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:48.854366 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" limit=1024 Sep 10 00:02:51.682367 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:51.682324 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-766j4_1d726466-e0ff-499c-94bf-0219bf7ba099/global-pull-secret-syncer/0.log" Sep 10 00:02:51.806679 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:51.806649 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-957mh_d5719a4b-0bf4-489d-a77a-9181bf0dedb1/konnectivity-agent/0.log" Sep 10 00:02:51.899437 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:51.899408 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-250.ec2.internal_b918f93a5380fe0ffc07a388ced93b00/haproxy/0.log" Sep 10 00:02:58.196226 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.196195 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7754092-94ef-4a13-b60d-2645af1e9f07/alertmanager/0.log" Sep 10 00:02:58.218215 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.218186 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7754092-94ef-4a13-b60d-2645af1e9f07/config-reloader/0.log" Sep 10 00:02:58.241014 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.240991 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7754092-94ef-4a13-b60d-2645af1e9f07/kube-rbac-proxy-web/0.log" Sep 10 00:02:58.262859 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.262833 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7754092-94ef-4a13-b60d-2645af1e9f07/kube-rbac-proxy/0.log" Sep 10 00:02:58.281966 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.281941 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7754092-94ef-4a13-b60d-2645af1e9f07/kube-rbac-proxy-metric/0.log" Sep 10 00:02:58.303864 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.303842 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7754092-94ef-4a13-b60d-2645af1e9f07/prom-label-proxy/0.log" Sep 10 00:02:58.328430 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.328404 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7754092-94ef-4a13-b60d-2645af1e9f07/init-config-reloader/0.log" Sep 10 00:02:58.417647 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.417617 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-sdk8k_6d8cd6e3-5e0c-4526-856b-ef3aaef836fc/kube-state-metrics/0.log" Sep 10 00:02:58.432962 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.432883 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-sdk8k_6d8cd6e3-5e0c-4526-856b-ef3aaef836fc/kube-rbac-proxy-main/0.log" Sep 10 00:02:58.451508 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.451483 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-sdk8k_6d8cd6e3-5e0c-4526-856b-ef3aaef836fc/kube-rbac-proxy-self/0.log" Sep 10 00:02:58.613226 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.613199 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hltj2_5a6dd675-7be7-4015-9094-c851e648f97e/node-exporter/0.log" Sep 10 00:02:58.633176 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.633140 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hltj2_5a6dd675-7be7-4015-9094-c851e648f97e/kube-rbac-proxy/0.log" Sep 10 00:02:58.653959 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.653935 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hltj2_5a6dd675-7be7-4015-9094-c851e648f97e/init-textfile/0.log" Sep 10 00:02:58.874063 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.874037 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d7e740f-f3da-4f30-99e0-8425c70c7f11/prometheus/0.log" Sep 10 00:02:58.894834 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.894805 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d7e740f-f3da-4f30-99e0-8425c70c7f11/config-reloader/0.log" Sep 10 00:02:58.916270 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.916242 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d7e740f-f3da-4f30-99e0-8425c70c7f11/thanos-sidecar/0.log" Sep 10 00:02:58.937006 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.936977 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d7e740f-f3da-4f30-99e0-8425c70c7f11/kube-rbac-proxy-web/0.log" Sep 10 00:02:58.955758 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.955739 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d7e740f-f3da-4f30-99e0-8425c70c7f11/kube-rbac-proxy/0.log" Sep 10 00:02:58.975105 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.975081 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d7e740f-f3da-4f30-99e0-8425c70c7f11/kube-rbac-proxy-thanos/0.log" Sep 10 00:02:58.994383 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:58.994340 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d7e740f-f3da-4f30-99e0-8425c70c7f11/init-config-reloader/0.log" Sep 10 00:02:59.022739 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.022655 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-68cdn_922cf429-3bd5-4d86-a3a3-cc15d16ffa35/prometheus-operator/0.log" Sep 10 00:02:59.038972 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.038946 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-68cdn_922cf429-3bd5-4d86-a3a3-cc15d16ffa35/kube-rbac-proxy/0.log" Sep 10 00:02:59.063345 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.063314 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-8mgq9_6c040b47-6e07-4e41-9528-72c18d174f81/prometheus-operator-admission-webhook/0.log" Sep 10 00:02:59.174550 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.174524 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd894fbb9-rzc8g_8a1d052d-2854-40bb-b13a-4759cc96a16e/thanos-query/0.log" Sep 10 00:02:59.193594 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.193568 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd894fbb9-rzc8g_8a1d052d-2854-40bb-b13a-4759cc96a16e/kube-rbac-proxy-web/0.log" Sep 10 00:02:59.213920 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.213878 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd894fbb9-rzc8g_8a1d052d-2854-40bb-b13a-4759cc96a16e/kube-rbac-proxy/0.log" Sep 10 00:02:59.233139 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.233116 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd894fbb9-rzc8g_8a1d052d-2854-40bb-b13a-4759cc96a16e/prom-label-proxy/0.log" Sep 10 00:02:59.252658 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.252634 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd894fbb9-rzc8g_8a1d052d-2854-40bb-b13a-4759cc96a16e/kube-rbac-proxy-rules/0.log" Sep 10 00:02:59.271413 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:02:59.271394 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd894fbb9-rzc8g_8a1d052d-2854-40bb-b13a-4759cc96a16e/kube-rbac-proxy-metrics/0.log" Sep 10 00:03:02.324497 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.324460 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8"] Sep 10 00:03:02.324990 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.324842 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="171bdfd9-1ce0-4c8d-9337-14bebbc038d3" containerName="cleanup" Sep 10 00:03:02.324990 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.324856 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="171bdfd9-1ce0-4c8d-9337-14bebbc038d3" containerName="cleanup" Sep 10 00:03:02.324990 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.324935 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="171bdfd9-1ce0-4c8d-9337-14bebbc038d3" containerName="cleanup" Sep 10 00:03:02.328115 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.328094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.330530 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.330504 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6zkw7\"/\"openshift-service-ca.crt\"" Sep 10 00:03:02.330626 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.330505 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6zkw7\"/\"kube-root-ca.crt\"" Sep 10 00:03:02.330626 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.330552 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6zkw7\"/\"default-dockercfg-rgfzf\"" Sep 10 00:03:02.334188 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.334166 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8"] Sep 10 00:03:02.491092 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.491059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-podres\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.491092 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.491095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-lib-modules\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.491273 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.491135 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-sys\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.491273 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.491170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv45j\" (UniqueName: \"kubernetes.io/projected/fef61d19-36a2-42eb-9360-4b6f7436926f-kube-api-access-fv45j\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.491273 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.491259 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-proc\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592148 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-sys\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592148 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592098 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv45j\" (UniqueName: \"kubernetes.io/projected/fef61d19-36a2-42eb-9360-4b6f7436926f-kube-api-access-fv45j\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592530 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-proc\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592530 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592198 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-sys\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592530 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-podres\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592530 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-proc\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592530 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592295 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-lib-modules\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592530 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592360 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-podres\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.592530 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.592443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fef61d19-36a2-42eb-9360-4b6f7436926f-lib-modules\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.599863 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.599843 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv45j\" (UniqueName: \"kubernetes.io/projected/fef61d19-36a2-42eb-9360-4b6f7436926f-kube-api-access-fv45j\") pod \"perf-node-gather-daemonset-rfmr8\" (UID: \"fef61d19-36a2-42eb-9360-4b6f7436926f\") " pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.662038 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.662010 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:02.930634 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:02.930601 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8"] Sep 10 00:03:02.934267 ip-10-0-131-250 kubenswrapper[2556]: W0910 00:03:02.934239 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfef61d19_36a2_42eb_9360_4b6f7436926f.slice/crio-823d9f4c58e38b7a4a2dbc114f5785f0dfcf7a21f486ce320c5cee7171cff3bc WatchSource:0}: Error finding container 823d9f4c58e38b7a4a2dbc114f5785f0dfcf7a21f486ce320c5cee7171cff3bc: Status 404 returned error can't find the container with id 823d9f4c58e38b7a4a2dbc114f5785f0dfcf7a21f486ce320c5cee7171cff3bc Sep 10 00:03:03.496060 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:03.496017 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8pb49_44c8780f-62ae-4022-8f81-3882e138ea9b/dns/0.log" Sep 10 00:03:03.501698 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:03.501669 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" event={"ID":"fef61d19-36a2-42eb-9360-4b6f7436926f","Type":"ContainerStarted","Data":"1d4dd2a894e4c72973e53d23a6ba52488d9eec6b8c5410be453fe45a0126dcfe"} Sep 10 00:03:03.501840 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:03.501718 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" event={"ID":"fef61d19-36a2-42eb-9360-4b6f7436926f","Type":"ContainerStarted","Data":"823d9f4c58e38b7a4a2dbc114f5785f0dfcf7a21f486ce320c5cee7171cff3bc"} Sep 10 00:03:03.501840 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:03.501760 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:03.518919 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:03.518845 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8pb49_44c8780f-62ae-4022-8f81-3882e138ea9b/kube-rbac-proxy/0.log" Sep 10 00:03:03.519132 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:03.519100 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" podStartSLOduration=1.519086804 podStartE2EDuration="1.519086804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 00:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 00:03:03.517443979 +0000 UTC m=+889.500177662" watchObservedRunningTime="2026-09-10 00:03:03.519086804 +0000 UTC m=+889.501820484" Sep 10 00:03:03.540137 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:03.540112 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6gfn_d6257ca7-5c53-45da-8525-315f9698cf0a/dns-node-resolver/0.log" Sep 10 00:03:04.182126 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:04.182091 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjs7w_107b0c9c-1d8b-444e-a779-6a7eb2e99815/node-ca/0.log" Sep 10 00:03:05.062524 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:05.062488 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf_97a2d869-15f1-46e7-a034-a8e62f5dbbfb/istio-proxy/0.log" Sep 10 00:03:05.124506 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:05.124470 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sgdmv_e1568a86-5991-43b2-800d-3a6b74ec5891/discovery/0.log" Sep 10 00:03:05.145324 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:05.145284 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-947759788-dm7xb_e631e214-6de7-4de1-8f2f-afd785bf0b9d/kube-auth-proxy/0.log" Sep 10 00:03:05.883111 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:05.883083 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bv79j_39418259-15c3-4964-a968-fc94cdb1d7bd/serve-healthcheck-canary/0.log" Sep 10 00:03:06.406699 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:06.406665 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n6d22_22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8/kube-rbac-proxy/0.log" Sep 10 00:03:06.424966 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:06.424938 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n6d22_22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8/exporter/0.log" Sep 10 00:03:06.444336 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:06.444315 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n6d22_22d9f2d4-0aff-4e0f-9aff-6e5d39f9d6a8/extractor/0.log" Sep 10 00:03:08.615699 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:08.615611 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kzz8l_831c8b42-8a6a-40a2-8c0d-0dd2a4831986/server/0.log" Sep 10 00:03:08.679773 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:08.679741 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rfjjm_123c4e43-ec05-49b5-b019-0b11e1c046e7/manager/0.log" Sep 10 00:03:08.777555 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:08.777525 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7547cdb9fd-s7s2z_9eb6ca31-c22b-4ede-b2bd-3809459fad5b/manager/0.log" Sep 10 00:03:08.796236 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:08.796214 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7547cdb9fd-s7s2z_9eb6ca31-c22b-4ede-b2bd-3809459fad5b/copy-manifests/0.log" Sep 10 00:03:09.516585 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:09.516560 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6zkw7/perf-node-gather-daemonset-rfmr8" Sep 10 00:03:09.900783 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:09.900753 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-758756f974-mdc9s_2ca14f29-5d10-4709-8fd3-680ecc1d21ae/manager/0.log" Sep 10 00:03:11.840939 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:11.840905 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf_97a2d869-15f1-46e7-a034-a8e62f5dbbfb/istio-proxy/0.log" Sep 10 00:03:11.900029 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:11.899987 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sgdmv_e1568a86-5991-43b2-800d-3a6b74ec5891/discovery/0.log" Sep 10 00:03:11.921378 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:11.921351 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-947759788-dm7xb_e631e214-6de7-4de1-8f2f-afd785bf0b9d/kube-auth-proxy/0.log" Sep 10 00:03:13.085823 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:13.085791 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cvlwhf_97a2d869-15f1-46e7-a034-a8e62f5dbbfb/istio-proxy/0.log" Sep 10 00:03:13.141751 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:13.141712 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sgdmv_e1568a86-5991-43b2-800d-3a6b74ec5891/discovery/0.log" Sep 10 00:03:13.156282 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:13.156258 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-947759788-dm7xb_e631e214-6de7-4de1-8f2f-afd785bf0b9d/kube-auth-proxy/0.log" Sep 10 00:03:16.455642 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:16.455603 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-76k75_ed104fe1-52de-450d-8d73-3e58d95f0efc/kube-multus/0.log" Sep 10 00:03:16.622369 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:16.622340 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsg52_5fb7d427-1679-4bbd-ab39-f38f8a7d78b5/kube-multus-additional-cni-plugins/0.log" Sep 10 00:03:16.641305 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:16.641269 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsg52_5fb7d427-1679-4bbd-ab39-f38f8a7d78b5/egress-router-binary-copy/0.log" Sep 10 00:03:16.660589 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:16.660566 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsg52_5fb7d427-1679-4bbd-ab39-f38f8a7d78b5/cni-plugins/0.log" Sep 10 00:03:16.679824 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:16.679800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsg52_5fb7d427-1679-4bbd-ab39-f38f8a7d78b5/bond-cni-plugin/0.log" Sep 10 00:03:16.697582 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:16.697557 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsg52_5fb7d427-1679-4bbd-ab39-f38f8a7d78b5/routeoverride-cni/0.log" Sep 10 00:03:16.715827 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:16.715760 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsg52_5fb7d427-1679-4bbd-ab39-f38f8a7d78b5/whereabouts-cni-bincopy/0.log" Sep 10 00:03:16.734042 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:16.734013 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsg52_5fb7d427-1679-4bbd-ab39-f38f8a7d78b5/whereabouts-cni/0.log" Sep 10 00:03:17.036707 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:17.036617 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ntvrv_7b1da39f-2765-4aa1-88a8-0fcec7475d0d/network-metrics-daemon/0.log" Sep 10 00:03:17.054712 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:17.054682 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ntvrv_7b1da39f-2765-4aa1-88a8-0fcec7475d0d/kube-rbac-proxy/0.log" Sep 10 00:03:17.968010 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:17.967973 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgdds_26ff3f59-387b-47ae-9e72-a9923f65f688/ovn-controller/0.log" Sep 10 00:03:17.983253 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:17.983231 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgdds_26ff3f59-387b-47ae-9e72-a9923f65f688/ovn-acl-logging/0.log" Sep 10 00:03:18.004015 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:18.003991 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgdds_26ff3f59-387b-47ae-9e72-a9923f65f688/kube-rbac-proxy-node/0.log" Sep 10 00:03:18.022368 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:18.022336 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgdds_26ff3f59-387b-47ae-9e72-a9923f65f688/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 00:03:18.039748 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:18.039726 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgdds_26ff3f59-387b-47ae-9e72-a9923f65f688/northd/0.log" Sep 10 00:03:18.058310 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:18.058292 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgdds_26ff3f59-387b-47ae-9e72-a9923f65f688/nbdb/0.log" Sep 10 00:03:18.083329 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:18.083306 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgdds_26ff3f59-387b-47ae-9e72-a9923f65f688/sbdb/0.log" Sep 10 00:03:18.136597 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:18.136564 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sgdds_26ff3f59-387b-47ae-9e72-a9923f65f688/ovnkube-controller/0.log" Sep 10 00:03:19.403120 ip-10-0-131-250 kubenswrapper[2556]: I0910 00:03:19.403087 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ssd6p_28b2275d-0a9b-4951-8a24-0de2e9e81490/network-check-target-container/0.log"