Sep 10 17:41:23.476047 ip-10-0-131-165 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 17:41:23.476057 ip-10-0-131-165 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 17:41:23.476064 ip-10-0-131-165 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 17:41:23.476213 ip-10-0-131-165 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 17:41:33.631028 ip-10-0-131-165 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 17:41:33.631044 ip-10-0-131-165 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 538a2e52c14b4b47a03a9810331e8957 -- Sep 10 17:43:20.714673 ip-10-0-131-165 systemd[1]: Starting Kubernetes Kubelet... Sep 10 17:43:21.138075 ip-10-0-131-165 kubenswrapper[2588]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:43:21.138075 ip-10-0-131-165 kubenswrapper[2588]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 17:43:21.138075 ip-10-0-131-165 kubenswrapper[2588]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:43:21.138075 ip-10-0-131-165 kubenswrapper[2588]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 17:43:21.138075 ip-10-0-131-165 kubenswrapper[2588]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:43:21.140179 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.140089 2588 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 17:43:21.144294 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144280 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:21.144294 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144294 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144298 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144302 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144304 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144307 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144310 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144313 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144318 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144323 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144326 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144329 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144332 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144336 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144339 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144342 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144345 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144347 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144350 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144352 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:21.144364 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144355 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144358 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144361 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144364 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144366 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144369 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144372 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144375 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144377 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144380 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:21.144831 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.144383 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:21.145300 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145290 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:21.145300 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145300 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145304 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145307 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145310 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145313 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145316 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145319 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145322 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145324 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145327 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145329 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145332 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145334 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145337 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145340 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145343 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145345 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145348 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145350 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145353 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:21.145356 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145355 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145359 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145362 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145364 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145368 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145371 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145373 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145376 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145387 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145391 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145394 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145398 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145402 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145405 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145408 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145411 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145414 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145426 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145429 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145432 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:21.145946 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145435 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145438 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145441 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145443 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145446 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145448 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145451 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145453 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145456 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145458 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145461 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145464 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145466 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145470 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145476 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145479 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145482 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145485 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145488 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145490 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:21.146504 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145493 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145496 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145499 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145501 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145504 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145507 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.145509 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146219 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146226 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146229 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146231 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146234 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146238 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146241 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146243 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146246 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146249 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146251 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146254 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146256 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:21.146984 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146259 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146262 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146264 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146267 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146269 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146272 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146276 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146279 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146281 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146284 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146287 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146289 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146292 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146295 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146297 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146300 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146302 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146305 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146307 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:21.147508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146310 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146312 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146315 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146317 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146320 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146322 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146326 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146328 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146330 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146333 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146335 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146338 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146340 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146342 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146345 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146348 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146351 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146354 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146357 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146359 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:21.147981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146364 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146368 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146371 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146374 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146379 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146383 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146386 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146389 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146392 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146394 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146397 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146399 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146402 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146405 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146407 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146409 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146413 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146432 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146435 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:21.148493 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146439 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146442 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146444 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146447 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146450 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146453 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146456 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146459 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146461 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146464 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146467 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146470 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146472 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146475 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146478 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146480 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146483 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146485 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146489 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146492 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:21.148956 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146494 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146497 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146499 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146502 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146505 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146507 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146510 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146512 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146892 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146897 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146900 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146903 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146907 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146909 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146912 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146915 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146918 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146920 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146923 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146925 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:21.149472 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146928 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146930 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146933 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146937 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146939 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146942 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146945 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146947 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146950 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146952 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146955 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146958 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146960 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146964 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146966 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146969 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146971 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146974 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146976 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146979 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:21.149966 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146981 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146984 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146986 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146989 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146991 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146994 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.146997 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147000 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147002 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147005 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147007 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147011 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147015 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147017 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147020 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147023 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147026 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147029 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147031 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:21.150474 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147034 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147036 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147039 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147041 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147044 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147046 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147049 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147051 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147053 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147056 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147059 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147062 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147064 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147067 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147069 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147072 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147074 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147077 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147079 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147082 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:21.150963 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147085 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147087 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147090 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147093 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147096 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147098 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147100 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147104 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147110 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147113 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147116 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147119 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147122 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147124 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147127 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147130 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147133 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147135 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147138 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147140 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:21.151508 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147143 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147145 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147149 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147152 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147155 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147158 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147161 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147164 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147227 2588 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147263 2588 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147273 2588 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147278 2588 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147283 2588 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147286 2588 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147291 2588 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147295 2588 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147298 2588 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147301 2588 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147305 2588 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147308 2588 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147313 2588 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147316 2588 flags.go:64] FLAG: --cgroup-root="" Sep 10 17:43:21.151993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147319 2588 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147322 2588 flags.go:64] FLAG: --client-ca-file="" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147325 2588 flags.go:64] FLAG: --cloud-provider="external" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147328 2588 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147332 2588 flags.go:64] FLAG: --cluster-domain="" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147335 2588 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147338 2588 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147341 2588 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147344 2588 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147348 2588 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147351 2588 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147354 2588 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147357 2588 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147360 2588 flags.go:64] FLAG: --contention-profiling="false" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147363 2588 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147366 2588 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147369 2588 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147372 2588 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147375 2588 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147379 2588 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147381 2588 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147384 2588 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147387 2588 flags.go:64] FLAG: --enable-server="true" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147391 2588 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147396 2588 flags.go:64] FLAG: --event-burst="100" Sep 10 17:43:21.152531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147399 2588 flags.go:64] FLAG: --event-qps="50" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147402 2588 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147405 2588 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147408 2588 flags.go:64] FLAG: --eviction-hard="" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147411 2588 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147429 2588 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147432 2588 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147435 2588 flags.go:64] FLAG: --eviction-soft="" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147438 2588 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147441 2588 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147444 2588 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147447 2588 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147450 2588 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147452 2588 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147455 2588 flags.go:64] FLAG: --feature-gates="" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147459 2588 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147462 2588 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147465 2588 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147468 2588 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147471 2588 flags.go:64] FLAG: --healthz-port="10248" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147474 2588 flags.go:64] FLAG: --help="false" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147477 2588 flags.go:64] FLAG: --hostname-override="ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147480 2588 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147483 2588 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 17:43:21.153139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147486 2588 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147489 2588 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147492 2588 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147495 2588 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147498 2588 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147500 2588 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147503 2588 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147506 2588 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147510 2588 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147513 2588 flags.go:64] FLAG: --kube-reserved="" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147516 2588 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147519 2588 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147522 2588 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147527 2588 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147530 2588 flags.go:64] FLAG: --lock-file="" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147532 2588 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147551 2588 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147555 2588 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147561 2588 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147565 2588 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147568 2588 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147571 2588 flags.go:64] FLAG: --logging-format="text" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147574 2588 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147577 2588 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 17:43:21.153755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147580 2588 flags.go:64] FLAG: --manifest-url="" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147583 2588 flags.go:64] FLAG: --manifest-url-header="" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147588 2588 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147591 2588 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147595 2588 flags.go:64] FLAG: --max-pods="110" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147598 2588 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147601 2588 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147603 2588 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147606 2588 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147609 2588 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147612 2588 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147615 2588 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147622 2588 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147625 2588 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147628 2588 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147631 2588 flags.go:64] FLAG: --pod-cidr="" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147635 2588 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147641 2588 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147644 2588 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147647 2588 flags.go:64] FLAG: --pods-per-core="0" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147650 2588 flags.go:64] FLAG: --port="10250" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147654 2588 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147658 2588 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06d842d2b9a4429fa" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147661 2588 flags.go:64] FLAG: --qos-reserved="" Sep 10 17:43:21.154337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147664 2588 flags.go:64] FLAG: --read-only-port="10255" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147667 2588 flags.go:64] FLAG: --register-node="true" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147670 2588 flags.go:64] FLAG: --register-with-taints="" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147673 2588 flags.go:64] FLAG: --registry-burst="10" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147676 2588 flags.go:64] FLAG: --registry-qps="5" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147679 2588 flags.go:64] FLAG: --reserved-cpus="" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147682 2588 flags.go:64] FLAG: --reserved-memory="" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147685 2588 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147688 2588 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147691 2588 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147694 2588 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147697 2588 flags.go:64] FLAG: --runonce="false" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147700 2588 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147703 2588 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147706 2588 flags.go:64] FLAG: --seccomp-default="false" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147709 2588 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147711 2588 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147714 2588 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147717 2588 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147720 2588 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147723 2588 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147725 2588 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147728 2588 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147731 2588 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147734 2588 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 17:43:21.155028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147739 2588 flags.go:64] FLAG: --system-cgroups="" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147742 2588 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147747 2588 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147750 2588 flags.go:64] FLAG: --tls-cert-file="" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147755 2588 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147760 2588 flags.go:64] FLAG: --tls-min-version="" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147763 2588 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147765 2588 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147768 2588 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147771 2588 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147774 2588 flags.go:64] FLAG: --v="2" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147778 2588 flags.go:64] FLAG: --version="false" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147782 2588 flags.go:64] FLAG: --vmodule="" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147788 2588 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.147792 2588 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147904 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147908 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147911 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147914 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147917 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147920 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147923 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147926 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:21.155722 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147929 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147931 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147934 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147937 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147939 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147942 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147944 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147947 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147949 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147952 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147955 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147957 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147961 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147965 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147969 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147971 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147974 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147976 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147979 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147981 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:21.156283 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147984 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147986 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147989 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147992 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147994 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.147997 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148000 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148004 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148007 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148010 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148013 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148016 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148018 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148021 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148024 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148026 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148029 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148032 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148034 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148037 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:21.156782 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148039 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148042 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148044 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148047 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148050 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148053 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148057 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148060 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148062 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148064 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148067 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148070 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148072 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148075 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148077 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148080 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148082 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148085 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148087 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148090 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:21.157268 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148092 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148095 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148097 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148100 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148102 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148105 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148107 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148110 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148112 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148115 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148117 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148120 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148124 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148127 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148130 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148133 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148136 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148140 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:21.157796 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148146 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148150 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148153 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148155 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148158 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148161 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148164 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148166 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148170 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148174 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148179 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148183 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.148186 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.148895 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.156545 2588 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.156560 2588 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 17:43:21.158279 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.157505 2588 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.157513 2588 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157569 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157575 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157578 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157583 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157587 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157590 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157593 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157596 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157599 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157602 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157605 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157608 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157611 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157614 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157617 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157620 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:21.158714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157623 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157627 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157631 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157634 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157637 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157640 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157643 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157646 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157649 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157652 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157655 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157658 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157661 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157665 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157668 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157671 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157673 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157676 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157679 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:21.159152 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157681 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157684 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157687 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157689 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157692 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157694 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157697 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157699 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157703 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157706 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157710 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157713 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157715 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157718 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157720 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157723 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157725 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157728 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157732 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:21.159714 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157735 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157738 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157741 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157744 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157747 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157750 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157753 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157757 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157760 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157763 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157766 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157768 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157771 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157773 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157776 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157778 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157781 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157783 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157786 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157788 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:21.160170 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157791 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157794 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157797 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157800 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157802 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157805 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157808 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157811 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157813 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157816 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157818 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157821 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157824 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157826 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157829 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157831 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157834 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157837 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157840 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157843 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:21.160689 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157845 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157848 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157851 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157853 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157856 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.157861 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157975 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157979 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157982 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157985 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157988 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157991 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157994 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157997 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.157999 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:21.161180 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158002 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158004 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158007 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158010 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158013 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158015 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158018 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158021 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158024 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158026 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158029 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158033 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158035 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158038 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158040 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158044 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158047 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158049 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158053 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158056 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:21.161563 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158073 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158077 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158081 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158083 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158088 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158091 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158094 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158097 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158099 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158102 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158105 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158107 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158110 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158112 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158115 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158118 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158121 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158123 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158126 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158128 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:21.162069 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158131 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158133 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158136 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158138 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158141 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158144 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158146 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158149 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158152 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158154 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158157 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158160 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158163 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158166 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158168 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158171 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158175 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158178 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158181 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:21.162594 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158184 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158187 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158189 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158192 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158194 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158197 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158199 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158202 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158205 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158207 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158210 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158212 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158215 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158217 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158220 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158222 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158226 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158228 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158231 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158233 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:21.163068 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158236 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158239 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158242 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158244 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158247 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158249 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158252 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158255 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158257 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158260 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:21.158262 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.158267 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.158374 2588 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.161843 2588 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 17:43:21.163654 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.162873 2588 server.go:1019] "Starting client certificate rotation" Sep 10 17:43:21.164052 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.162972 2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:43:21.164052 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.163884 2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:43:21.167917 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.167895 2588 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:43:21.169105 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.169080 2588 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:43:21.177769 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.177755 2588 log.go:25] "Validated CRI v1 runtime API" Sep 10 17:43:21.180907 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.180890 2588 log.go:25] "Validated CRI v1 image API" Sep 10 17:43:21.182738 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.182710 2588 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 17:43:21.187512 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.187491 2588 fs.go:135] Filesystem UUIDs: map[578fbdc6-d055-4a3f-92c8-10cda9da3ea4:/dev/nvme0n1p3 5f2cacb7-14c1-4e30-98f5-c18e89e032bb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 10 17:43:21.187586 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.187510 2588 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 17:43:21.192723 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.192615 2588 manager.go:216] Machine: {Timestamp:2026-09-10 17:43:21.191201114 +0000 UTC m=+0.369543521 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098800 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec288fd05bcd0fa9695a854c8fd83713 SystemUUID:ec288fd0-5bcd-0fa9-695a-854c8fd83713 BootID:538a2e52-c14b-4b47-a03a-9810331e8957 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:cb:9b:64:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:cb:9b:64:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:ae:e3:79:1d:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 17:43:21.192723 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.192722 2588 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 17:43:21.192832 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.192804 2588 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 17:43:21.196563 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.196543 2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:43:21.196697 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.196669 2588 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 17:43:21.196845 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.196701 2588 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 17:43:21.198283 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.198272 2588 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 17:43:21.198325 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.198287 2588 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 17:43:21.198325 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.198295 2588 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:43:21.199096 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.199085 2588 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:43:21.200948 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.200937 2588 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 17:43:21.205481 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.205467 2588 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:43:21.205601 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.205591 2588 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 17:43:21.205634 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.205622 2588 kubelet.go:486] "Attempting to sync node with API server" Sep 10 17:43:21.205634 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.205632 2588 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 17:43:21.205692 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.205644 2588 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 17:43:21.205692 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.205653 2588 kubelet.go:398] "Adding apiserver pod source" Sep 10 17:43:21.205692 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.205662 2588 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 17:43:21.206077 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.206061 2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:43:21.206118 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.206101 2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:43:21.210264 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.210243 2588 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 17:43:21.213174 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.213159 2588 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 17:43:21.213255 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.213198 2588 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 17:43:21.214162 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214148 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 17:43:21.214219 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214166 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 17:43:21.214219 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214174 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 17:43:21.214219 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214179 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 17:43:21.214219 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214188 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 17:43:21.214219 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214194 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 17:43:21.214219 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214207 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 17:43:21.214219 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214213 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 17:43:21.214219 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214220 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 17:43:21.214436 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214226 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 17:43:21.214436 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214235 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 17:43:21.214436 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.214241 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 17:43:21.215946 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.215924 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 17:43:21.216001 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.215979 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 17:43:21.216057 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.216047 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 17:43:21.216086 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.216059 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 17:43:21.219925 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.219898 2588 server.go:1268] "Started kubelet" Sep 10 17:43:21.220059 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.220007 2588 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 17:43:21.220158 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.220110 2588 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 17:43:21.220271 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.220177 2588 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 17:43:21.220771 ip-10-0-131-165 systemd[1]: Started Kubernetes Kubelet. Sep 10 17:43:21.221275 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.221259 2588 server.go:310] "Adding debug handlers to kubelet server" Sep 10 17:43:21.221934 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.221738 2588 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 17:43:21.225242 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.225099 2588 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 17:43:21.226488 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.226469 2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pvs9m" Sep 10 17:43:21.227733 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.227713 2588 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 17:43:21.228958 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.227751 2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-165.ec2.internal.18d40697d8c9ebde default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-165.ec2.internal,UID:ip-10-0-131-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-165.ec2.internal,},FirstTimestamp:2026-09-10 17:43:21.219869662 +0000 UTC m=+0.398212068,LastTimestamp:2026-09-10 17:43:21.219869662 +0000 UTC m=+0.398212068,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-165.ec2.internal,}" Sep 10 17:43:21.232768 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.232744 2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 17:43:21.233665 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.233444 2588 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 17:43:21.233665 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.233631 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:21.234183 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234167 2588 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 17:43:21.234183 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234168 2588 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 17:43:21.234316 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234200 2588 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 17:43:21.234365 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234334 2588 reconstruct.go:97] "Volume reconstruction finished" Sep 10 17:43:21.234365 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234340 2588 reconciler.go:29] "Reconciler: start to sync state" Sep 10 17:43:21.234659 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234637 2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pvs9m" Sep 10 17:43:21.234927 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234909 2588 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 17:43:21.234972 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234932 2588 factory.go:55] Registering systemd factory Sep 10 17:43:21.234972 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.234943 2588 factory.go:223] Registration of the systemd container factory successfully Sep 10 17:43:21.235165 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.235151 2588 factory.go:153] Registering CRI-O factory Sep 10 17:43:21.235165 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.235165 2588 factory.go:223] Registration of the crio container factory successfully Sep 10 17:43:21.235307 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.235177 2588 factory.go:103] Registering Raw factory Sep 10 17:43:21.235307 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.235186 2588 manager.go:1196] Started watching for new ooms in manager Sep 10 17:43:21.235580 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.235555 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 17:43:21.235670 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.235583 2588 manager.go:349] Starting recovery of all containers Sep 10 17:43:21.235670 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.235613 2588 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 17:43:21.246191 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.246019 2588 manager.go:354] Recovery completed Sep 10 17:43:21.251216 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.251200 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:21.253201 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.253186 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:21.253284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.253213 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:21.253284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.253222 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:21.253770 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.253758 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:21.253846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.253757 2588 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 17:43:21.253846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.253801 2588 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 17:43:21.253846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.253820 2588 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:43:21.254459 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.254409 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:21.254517 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.254461 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:21.254517 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.254470 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:21.255979 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.255963 2588 policy_none.go:49] "None policy: Start" Sep 10 17:43:21.255979 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.255980 2588 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 17:43:21.256116 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.255989 2588 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 17:43:21.258001 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.257988 2588 policy_none.go:47] "Start" Sep 10 17:43:21.289042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.289025 2588 manager.go:337] "Starting Device Plugin manager" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.289070 2588 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.289081 2588 server.go:87] "Starting device plugin registration server" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.289508 2588 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.289522 2588 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.289607 2588 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.289702 2588 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.289711 2588 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.290253 2588 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 17:43:21.312043 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.290305 2588 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:21.331547 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.331503 2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 17:43:21.332757 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.332737 2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 17:43:21.332871 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.332790 2588 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 17:43:21.332871 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.332817 2588 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 17:43:21.332953 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.332920 2588 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 17:43:21.335326 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.335307 2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:21.390282 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.390197 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:21.391140 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.391119 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:21.391244 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.391157 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:21.391244 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.391173 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:21.391244 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.391205 2588 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.399465 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.399449 2588 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.399565 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.399474 2588 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-165.ec2.internal\": node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:21.421238 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.421213 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:21.433305 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.433282 2588 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"] Sep 10 17:43:21.433364 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.433351 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:21.434291 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.434275 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:21.434378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.434307 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:21.434378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.434320 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:21.434504 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.434486 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31df2fb96023e0c5ede7770b34c7bcbb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"31df2fb96023e0c5ede7770b34c7bcbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.434562 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.434520 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31df2fb96023e0c5ede7770b34c7bcbb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"31df2fb96023e0c5ede7770b34c7bcbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.436599 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.436588 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:21.436707 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.436694 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.436746 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.436722 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:21.437284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.437262 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:21.437284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.437281 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:21.437390 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.437289 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:21.437390 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.437294 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:21.437390 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.437317 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:21.437390 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.437329 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:21.439541 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.439525 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.439618 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.439547 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:21.440216 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.440201 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:21.440277 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.440228 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:21.440277 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.440243 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:21.455967 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.455946 2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-165.ec2.internal\" not found" node="ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.459986 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.459971 2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-165.ec2.internal\" not found" node="ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.521362 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.521330 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:21.535332 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.535303 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5907c737389965eebb4c3a73e149b012-config\") pod \"kube-apiserver-proxy-ip-10-0-131-165.ec2.internal\" (UID: \"5907c737389965eebb4c3a73e149b012\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.535481 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.535343 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31df2fb96023e0c5ede7770b34c7bcbb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"31df2fb96023e0c5ede7770b34c7bcbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.535481 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.535360 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31df2fb96023e0c5ede7770b34c7bcbb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"31df2fb96023e0c5ede7770b34c7bcbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.535481 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.535394 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31df2fb96023e0c5ede7770b34c7bcbb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"31df2fb96023e0c5ede7770b34c7bcbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.535481 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.535465 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31df2fb96023e0c5ede7770b34c7bcbb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"31df2fb96023e0c5ede7770b34c7bcbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.621657 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:21.621624 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:21.635909 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.635890 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5907c737389965eebb4c3a73e149b012-config\") pod \"kube-apiserver-proxy-ip-10-0-131-165.ec2.internal\" (UID: \"5907c737389965eebb4c3a73e149b012\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" Sep 10 17:43:21.636020 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:21.635925 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5907c737389965eebb4c3a73e149b012-config\") pod \"kube-apiserver-proxy-ip-10-0-131-165.ec2.internal\" (UID: \"5907c737389965eebb4c3a73e149b012\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" Sep 10 17:43:23.506259 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:23.506230 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:23.542716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.542676 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:23.546115 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.546097 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" Sep 10 17:43:23.607349 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:23.607303 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:23.707763 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:23.707736 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:23.808417 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:23.808331 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found" Sep 10 17:43:23.873113 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.873084 2588 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:23.917984 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.917957 2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" Sep 10 17:43:23.929180 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.929158 2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:43:23.930522 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.930506 2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" Sep 10 17:43:23.939329 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.939293 2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:43:23.942256 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.942237 2588 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:23.946177 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.946155 2588 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 17:43:23.946322 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.946284 2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:43:23.946422 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.946331 2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:43:23.946422 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.946395 2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:43:23.990493 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:23.990465 2588 apiserver.go:52] "Watching apiserver" Sep 10 17:43:24.004401 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.003648 2588 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 17:43:24.006035 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.006004 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-x54pr","openshift-network-operator/iptables-alerter-fvsfm","openshift-ovn-kubernetes/ovnkube-node-n4swb","kube-system/global-pull-secret-syncer-rjnqb","kube-system/konnectivity-agent-drpl9","kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff","openshift-image-registry/node-ca-tt7rv","openshift-multus/multus-7jzcr","openshift-multus/network-metrics-daemon-qmzql","openshift-network-diagnostics/network-check-target-xdckl","openshift-cluster-node-tuning-operator/tuned-d8c49","openshift-dns/node-resolver-n6zbr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"] Sep 10 17:43:24.008426 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.008405 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.010543 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.010475 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.010927 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.010637 2588 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:24.010927 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.010763 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 17:43:24.010927 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.010778 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 17:43:24.010927 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.010763 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 17:43:24.010927 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.010829 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 17:43:24.010927 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.010839 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-blmsv\"" Sep 10 17:43:24.010927 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.010847 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 17:43:24.013408 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.013389 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.015233 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.015215 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9r54c\"" Sep 10 17:43:24.015395 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.015272 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 17:43:24.015395 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.015273 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:43:24.015519 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.015439 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 17:43:24.015639 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.015626 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.015698 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.015683 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:24.016737 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.016720 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 17:43:24.016832 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.016735 2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 17:43:24.017082 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.017061 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 17:43:24.017082 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.017084 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 17:43:24.017228 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.017134 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 17:43:24.017295 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.017277 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6m6w9\"" Sep 10 17:43:24.017569 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.017553 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 17:43:24.017754 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.017740 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:24.017936 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.017920 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 17:43:24.019768 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.019752 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 17:43:24.019871 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.019836 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vkhkk\"" Sep 10 17:43:24.019956 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.019942 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 17:43:24.020187 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.020158 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.021891 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.021853 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 17:38:23 +0000 UTC" deadline="2028-04-28 10:13:40.409238392 +0000 UTC" Sep 10 17:43:24.022027 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.021891 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14296h30m16.387350543s" Sep 10 17:43:24.022252 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022232 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 17:43:24.022252 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022247 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 17:43:24.022389 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022232 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h9ncw\"" Sep 10 17:43:24.022872 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022854 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-device-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.022938 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022872 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 17:43:24.022938 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022877 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.022938 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022893 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3641af0-5402-41af-bccb-f8361f7b08dc-host-slash\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.022938 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022929 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-var-lib-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023144 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.022948 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-etc-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023144 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023025 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.023144 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023028 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-node-log\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023144 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023062 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-systemd\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023144 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023087 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023144 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023108 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-cni-netd\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023144 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023131 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76889f62-c935-47d0-a249-35a7650c5a03-kubelet-config\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023153 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76889f62-c935-47d0-a249-35a7650c5a03-dbus\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023205 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee7b9c0a-0b03-4069-94f5-e4375b835807-konnectivity-ca\") pod \"konnectivity-agent-drpl9\" (UID: \"ee7b9c0a-0b03-4069-94f5-e4375b835807\") " pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023239 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-run-netns\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023260 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023294 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-cnibin\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023335 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023356 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023372 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2mvs\" (UniqueName: \"kubernetes.io/projected/19f47f90-d4c7-40d8-97b5-21447400a63d-kube-api-access-c2mvs\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023393 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-kubelet\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023408 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-slash\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023420 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-log-socket\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023435 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023460 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-socket-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023497 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-sys-fs\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023539 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-system-cni-dir\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023569 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3641af0-5402-41af-bccb-f8361f7b08dc-iptables-alerter-script\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023593 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-systemd-units\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023617 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-ovn\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023643 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-registration-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023668 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovnkube-script-lib\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023693 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023716 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg849\" (UniqueName: \"kubernetes.io/projected/4f319c89-92c0-4fc7-809d-cff513bffc67-kube-api-access-bg849\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023738 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023761 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovn-node-metrics-cert\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023784 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdb4q\" (UniqueName: \"kubernetes.io/projected/ff8923a5-5a5e-4d30-8368-4caf0a95424c-kube-api-access-rdb4q\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023811 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzh5x\" (UniqueName: \"kubernetes.io/projected/f3641af0-5402-41af-bccb-f8361f7b08dc-kube-api-access-kzh5x\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023826 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-cni-bin\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.023846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023847 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovnkube-config\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.024530 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023870 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-env-overrides\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.024530 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023892 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.024530 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023915 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee7b9c0a-0b03-4069-94f5-e4375b835807-agent-certs\") pod \"konnectivity-agent-drpl9\" (UID: \"ee7b9c0a-0b03-4069-94f5-e4375b835807\") " pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:24.024530 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.023944 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.025645 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.025029 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 17:43:24.025645 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.025329 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.025753 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.025679 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8n8bx\"" Sep 10 17:43:24.025753 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.025695 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 17:43:24.025753 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.025722 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 17:43:24.027223 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.027205 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 17:43:24.027287 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.027269 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lvwjp\"" Sep 10 17:43:24.027769 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.027751 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:24.027838 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.027806 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:24.029626 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.029609 2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:43:24.029939 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.029927 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:24.030015 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.029976 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:24.032208 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.032193 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.034504 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.034483 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.034591 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.034511 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 17:43:24.034591 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.034560 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7sshg\"" Sep 10 17:43:24.034828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.034812 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:43:24.037857 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.037520 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 17:43:24.037857 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.037569 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 17:43:24.038942 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.038004 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v9xrr\"" Sep 10 17:43:24.058786 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.058731 2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l7vcd" Sep 10 17:43:24.069514 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.069495 2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l7vcd" Sep 10 17:43:24.088887 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.088846 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5907c737389965eebb4c3a73e149b012.slice/crio-48927142d9edf84a045c5206254cb37912716f2dc4f6fe2d848d348fa6c3151b WatchSource:0}: Error finding container 48927142d9edf84a045c5206254cb37912716f2dc4f6fe2d848d348fa6c3151b: Status 404 returned error can't find the container with id 48927142d9edf84a045c5206254cb37912716f2dc4f6fe2d848d348fa6c3151b Sep 10 17:43:24.089119 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.089096 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31df2fb96023e0c5ede7770b34c7bcbb.slice/crio-d46d828457ec443aa681d74ea2504243ac8c5718f0eebdfce5cc011e24ef0409 WatchSource:0}: Error finding container d46d828457ec443aa681d74ea2504243ac8c5718f0eebdfce5cc011e24ef0409: Status 404 returned error can't find the container with id d46d828457ec443aa681d74ea2504243ac8c5718f0eebdfce5cc011e24ef0409 Sep 10 17:43:24.093139 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.093122 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:43:24.118966 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.118944 2588 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 17:43:24.120123 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.120088 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" event={"ID":"31df2fb96023e0c5ede7770b34c7bcbb","Type":"ContainerStarted","Data":"d46d828457ec443aa681d74ea2504243ac8c5718f0eebdfce5cc011e24ef0409"} Sep 10 17:43:24.121045 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.121021 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" event={"ID":"5907c737389965eebb4c3a73e149b012","Type":"ContainerStarted","Data":"48927142d9edf84a045c5206254cb37912716f2dc4f6fe2d848d348fa6c3151b"} Sep 10 17:43:24.124247 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124227 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovn-node-metrics-cert\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124361 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124254 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysconfig\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.124361 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124269 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzh5x\" (UniqueName: \"kubernetes.io/projected/f3641af0-5402-41af-bccb-f8361f7b08dc-kube-api-access-kzh5x\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.124361 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124284 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovnkube-config\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124494 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124421 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-env-overrides\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124494 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124448 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-run\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.124494 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124467 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee7b9c0a-0b03-4069-94f5-e4375b835807-agent-certs\") pod \"konnectivity-agent-drpl9\" (UID: \"ee7b9c0a-0b03-4069-94f5-e4375b835807\") " pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:24.124494 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124481 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124495 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-device-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124531 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124562 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-etc-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124577 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124607 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-node-log\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124579 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-node-log\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124625 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-etc-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124633 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-device-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124633 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-cni-netd\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124651 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-cni-netd\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124674 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-hostroot\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.124684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124692 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-systemd\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124707 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76889f62-c935-47d0-a249-35a7650c5a03-kubelet-config\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124716 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124724 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76889f62-c935-47d0-a249-35a7650c5a03-dbus\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124756 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76889f62-c935-47d0-a249-35a7650c5a03-kubelet-config\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124769 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76889f62-c935-47d0-a249-35a7650c5a03-dbus\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124787 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-modprobe-d\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124804 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-host\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124820 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-systemd\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124823 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh46l\" (UniqueName: \"kubernetes.io/projected/f0343c02-3302-4ecc-b884-702a0026c0cb-kube-api-access-lh46l\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124852 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-serviceca\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124880 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee7b9c0a-0b03-4069-94f5-e4375b835807-konnectivity-ca\") pod \"konnectivity-agent-drpl9\" (UID: \"ee7b9c0a-0b03-4069-94f5-e4375b835807\") " pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124896 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-run-netns\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124912 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124932 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61acebda-4243-4f37-b852-1584bbe917bc-tmp-dir\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124956 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-cnibin\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124963 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-run-netns\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.125385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124975 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.124990 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-cni-bin\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125018 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysctl-d\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125041 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-sys\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125064 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-cnibin\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125090 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125130 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-cnibin\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125162 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125189 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2mvs\" (UniqueName: \"kubernetes.io/projected/19f47f90-d4c7-40d8-97b5-21447400a63d-kube-api-access-c2mvs\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125213 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-slash\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125252 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-log-socket\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125277 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-host\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125336 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-socket-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125363 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3641af0-5402-41af-bccb-f8361f7b08dc-iptables-alerter-script\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125386 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-systemd-units\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125411 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125434 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovnkube-script-lib\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125441 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee7b9c0a-0b03-4069-94f5-e4375b835807-konnectivity-ca\") pod \"konnectivity-agent-drpl9\" (UID: \"ee7b9c0a-0b03-4069-94f5-e4375b835807\") " pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125435 2588 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125506 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-slash\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125561 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-systemd-units\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125462 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-netns\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125600 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-multus-certs\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125615 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-env-overrides\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125623 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-etc-kubernetes\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125670 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125675 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125698 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-log-socket\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125695 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdb4q\" (UniqueName: \"kubernetes.io/projected/ff8923a5-5a5e-4d30-8368-4caf0a95424c-kube-api-access-rdb4q\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125779 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-socket-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125824 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-cni-multus\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125852 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2dc63600-b198-4c68-b838-a40560abc448-multus-daemon-config\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125897 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-cni-bin\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125929 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.126804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125969 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vjb\" (UniqueName: \"kubernetes.io/projected/61acebda-4243-4f37-b852-1584bbe917bc-kube-api-access-74vjb\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125993 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-tuned\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.125993 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovnkube-script-lib\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126033 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3641af0-5402-41af-bccb-f8361f7b08dc-host-slash\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126041 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126048 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3641af0-5402-41af-bccb-f8361f7b08dc-iptables-alerter-script\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.126087 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126112 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-var-lib-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.126166 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret podName:76889f62-c935-47d0-a249-35a7650c5a03 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:24.626129239 +0000 UTC m=+2.020578493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret") pod "global-pull-secret-syncer-rjnqb" (UID: "76889f62-c935-47d0-a249-35a7650c5a03") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126175 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-var-lib-openvswitch\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126184 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-k8s-cni-cncf-io\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126206 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-cni-bin\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126208 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3641af0-5402-41af-bccb-f8361f7b08dc-host-slash\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126223 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19f47f90-d4c7-40d8-97b5-21447400a63d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126237 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysctl-conf\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126262 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126296 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-socket-dir-parent\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.127606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126350 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovnkube-config\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126364 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126394 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-conf-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126422 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4zrn\" (UniqueName: \"kubernetes.io/projected/2dc63600-b198-4c68-b838-a40560abc448-kube-api-access-t4zrn\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126443 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-system-cni-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126469 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-cni-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126491 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dc63600-b198-4c68-b838-a40560abc448-cni-binary-copy\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126507 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-kubelet\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126523 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126544 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61acebda-4243-4f37-b852-1584bbe917bc-hosts-file\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126567 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0343c02-3302-4ecc-b884-702a0026c0cb-tmp\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126570 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-kubelet\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126581 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126597 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126626 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-sys-fs\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126648 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-system-cni-dir\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126668 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-ovn\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.128454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126675 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-sys-fs\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126691 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-kubelet\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126716 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-kubernetes\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126738 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhm2b\" (UniqueName: \"kubernetes.io/projected/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-kube-api-access-fhm2b\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126731 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19f47f90-d4c7-40d8-97b5-21447400a63d-system-cni-dir\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126717 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff8923a5-5a5e-4d30-8368-4caf0a95424c-run-ovn\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126765 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-registration-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126797 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-systemd\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126837 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-lib-modules\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126845 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-registration-dir\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126857 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-var-lib-kubelet\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126912 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s54hs\" (UniqueName: \"kubernetes.io/projected/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-kube-api-access-s54hs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126940 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126976 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg849\" (UniqueName: \"kubernetes.io/projected/4f319c89-92c0-4fc7-809d-cff513bffc67-kube-api-access-bg849\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.126999 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f319c89-92c0-4fc7-809d-cff513bffc67-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.129095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.128834 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff8923a5-5a5e-4d30-8368-4caf0a95424c-ovn-node-metrics-cert\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.129577 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.129136 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee7b9c0a-0b03-4069-94f5-e4375b835807-agent-certs\") pod \"konnectivity-agent-drpl9\" (UID: \"ee7b9c0a-0b03-4069-94f5-e4375b835807\") " pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:24.132655 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.132629 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzh5x\" (UniqueName: \"kubernetes.io/projected/f3641af0-5402-41af-bccb-f8361f7b08dc-kube-api-access-kzh5x\") pod \"iptables-alerter-fvsfm\" (UID: \"f3641af0-5402-41af-bccb-f8361f7b08dc\") " pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.133302 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.133283 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2mvs\" (UniqueName: \"kubernetes.io/projected/19f47f90-d4c7-40d8-97b5-21447400a63d-kube-api-access-c2mvs\") pod \"multus-additional-cni-plugins-x54pr\" (UID: \"19f47f90-d4c7-40d8-97b5-21447400a63d\") " pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.134944 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.134918 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdb4q\" (UniqueName: \"kubernetes.io/projected/ff8923a5-5a5e-4d30-8368-4caf0a95424c-kube-api-access-rdb4q\") pod \"ovnkube-node-n4swb\" (UID: \"ff8923a5-5a5e-4d30-8368-4caf0a95424c\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.135125 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.135108 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg849\" (UniqueName: \"kubernetes.io/projected/4f319c89-92c0-4fc7-809d-cff513bffc67-kube-api-access-bg849\") pod \"aws-ebs-csi-driver-node-fdnff\" (UID: \"4f319c89-92c0-4fc7-809d-cff513bffc67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.227854 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227821 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-socket-dir-parent\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.227854 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227854 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-conf-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227870 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4zrn\" (UniqueName: \"kubernetes.io/projected/2dc63600-b198-4c68-b838-a40560abc448-kube-api-access-t4zrn\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227886 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-system-cni-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227900 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-cni-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227933 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-conf-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227939 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-socket-dir-parent\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227974 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-multus-cni-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.227977 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-system-cni-dir\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228017 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dc63600-b198-4c68-b838-a40560abc448-cni-binary-copy\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228054 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61acebda-4243-4f37-b852-1584bbe917bc-hosts-file\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228084 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0343c02-3302-4ecc-b884-702a0026c0cb-tmp\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228109 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228132 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61acebda-4243-4f37-b852-1584bbe917bc-hosts-file\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228137 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-kubelet\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228154 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-kubernetes\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228170 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhm2b\" (UniqueName: \"kubernetes.io/projected/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-kube-api-access-fhm2b\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228191 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-systemd\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228214 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-lib-modules\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228237 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-var-lib-kubelet\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228248 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-kubernetes\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228261 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s54hs\" (UniqueName: \"kubernetes.io/projected/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-kube-api-access-s54hs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228214 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-kubelet\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228288 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysconfig\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228330 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-run\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228340 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-var-lib-kubelet\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228285 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-systemd\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228343 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-lib-modules\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.228551 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228374 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-hostroot\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228391 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-run\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228375 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysconfig\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228404 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-hostroot\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228405 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-modprobe-d\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228436 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-host\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228455 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh46l\" (UniqueName: \"kubernetes.io/projected/f0343c02-3302-4ecc-b884-702a0026c0cb-kube-api-access-lh46l\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228476 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-serviceca\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228490 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-modprobe-d\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228501 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61acebda-4243-4f37-b852-1584bbe917bc-tmp-dir\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228505 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-host\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228525 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-cnibin\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228543 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-cni-bin\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228557 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysctl-d\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228570 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-sys\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228607 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-host\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228613 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-cni-bin\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228634 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:24.229378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228659 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-netns\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228679 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-multus-certs\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228707 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-etc-kubernetes\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228714 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysctl-d\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228718 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-sys\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228679 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-cnibin\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228734 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-cni-multus\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228743 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-netns\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228716 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dc63600-b198-4c68-b838-a40560abc448-cni-binary-copy\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228768 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-host\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228768 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-multus-certs\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228785 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-var-lib-cni-multus\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.228805 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228839 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-etc-kubernetes\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228803 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61acebda-4243-4f37-b852-1584bbe917bc-tmp-dir\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.228858 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:43:24.728841389 +0000 UTC m=+2.123290626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228787 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2dc63600-b198-4c68-b838-a40560abc448-multus-daemon-config\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228929 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74vjb\" (UniqueName: \"kubernetes.io/projected/61acebda-4243-4f37-b852-1584bbe917bc-kube-api-access-74vjb\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.229865 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228932 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-serviceca\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.230393 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.228954 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-tuned\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.230393 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.229016 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-k8s-cni-cncf-io\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.230393 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.229041 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysctl-conf\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.230393 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.229084 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2dc63600-b198-4c68-b838-a40560abc448-host-run-k8s-cni-cncf-io\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.230393 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.229187 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-sysctl-conf\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.230393 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.229228 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2dc63600-b198-4c68-b838-a40560abc448-multus-daemon-config\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.230637 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.230617 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0343c02-3302-4ecc-b884-702a0026c0cb-tmp\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.230935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.230920 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0343c02-3302-4ecc-b884-702a0026c0cb-etc-tuned\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.236870 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.236845 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:24.236870 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.236870 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:24.237020 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.236881 2588 projected.go:196] Error preparing data for projected volume kube-api-access-b64zh for pod openshift-network-diagnostics/network-check-target-xdckl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:24.237020 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.236929 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh podName:83b0692a-de58-4ff7-8efa-5beab6c7b949 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:24.736916617 +0000 UTC m=+2.131365850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b64zh" (UniqueName: "kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh") pod "network-check-target-xdckl" (UID: "83b0692a-de58-4ff7-8efa-5beab6c7b949") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:24.238815 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.238787 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4zrn\" (UniqueName: \"kubernetes.io/projected/2dc63600-b198-4c68-b838-a40560abc448-kube-api-access-t4zrn\") pod \"multus-7jzcr\" (UID: \"2dc63600-b198-4c68-b838-a40560abc448\") " pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.240094 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.240066 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vjb\" (UniqueName: \"kubernetes.io/projected/61acebda-4243-4f37-b852-1584bbe917bc-kube-api-access-74vjb\") pod \"node-resolver-n6zbr\" (UID: \"61acebda-4243-4f37-b852-1584bbe917bc\") " pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.240496 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.240477 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhm2b\" (UniqueName: \"kubernetes.io/projected/bed09fa0-af01-4f59-91e0-a6c7c7d9ff07-kube-api-access-fhm2b\") pod \"node-ca-tt7rv\" (UID: \"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07\") " pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.240656 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.240641 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh46l\" (UniqueName: \"kubernetes.io/projected/f0343c02-3302-4ecc-b884-702a0026c0cb-kube-api-access-lh46l\") pod \"tuned-d8c49\" (UID: \"f0343c02-3302-4ecc-b884-702a0026c0cb\") " pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.241726 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.241710 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s54hs\" (UniqueName: \"kubernetes.io/projected/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-kube-api-access-s54hs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:24.335731 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.335652 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x54pr" Sep 10 17:43:24.345463 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.345437 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f47f90_d4c7_40d8_97b5_21447400a63d.slice/crio-da6cc8e4491402092af5cbe2ad614b980a1b0030ea5461f33a6c469dbaaa4085 WatchSource:0}: Error finding container da6cc8e4491402092af5cbe2ad614b980a1b0030ea5461f33a6c469dbaaa4085: Status 404 returned error can't find the container with id da6cc8e4491402092af5cbe2ad614b980a1b0030ea5461f33a6c469dbaaa4085 Sep 10 17:43:24.351088 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.351065 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fvsfm" Sep 10 17:43:24.359119 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.359094 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3641af0_5402_41af_bccb_f8361f7b08dc.slice/crio-41a790e392310eee2ccf6c41ba6280ffc642a14cb211bbca4047303cf761d2a9 WatchSource:0}: Error finding container 41a790e392310eee2ccf6c41ba6280ffc642a14cb211bbca4047303cf761d2a9: Status 404 returned error can't find the container with id 41a790e392310eee2ccf6c41ba6280ffc642a14cb211bbca4047303cf761d2a9 Sep 10 17:43:24.365845 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.365827 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:24.373790 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.373765 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8923a5_5a5e_4d30_8368_4caf0a95424c.slice/crio-08e8aaa7e80063e50afc7a2e241f3d844ac2fb38c4abe375355dc377c94eb6bc WatchSource:0}: Error finding container 08e8aaa7e80063e50afc7a2e241f3d844ac2fb38c4abe375355dc377c94eb6bc: Status 404 returned error can't find the container with id 08e8aaa7e80063e50afc7a2e241f3d844ac2fb38c4abe375355dc377c94eb6bc Sep 10 17:43:24.374983 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.374963 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:24.383543 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.383517 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7b9c0a_0b03_4069_94f5_e4375b835807.slice/crio-8d903801db953b6b015544fd9cbb50d07ec339b3f2b23d1690bea9c4a234e887 WatchSource:0}: Error finding container 8d903801db953b6b015544fd9cbb50d07ec339b3f2b23d1690bea9c4a234e887: Status 404 returned error can't find the container with id 8d903801db953b6b015544fd9cbb50d07ec339b3f2b23d1690bea9c4a234e887 Sep 10 17:43:24.393585 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.393568 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" Sep 10 17:43:24.399387 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.399369 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tt7rv" Sep 10 17:43:24.401994 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.401971 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f319c89_92c0_4fc7_809d_cff513bffc67.slice/crio-2e3f3f830d221119f187647bfc7cdb273676649d63aabb8a2afc447572357083 WatchSource:0}: Error finding container 2e3f3f830d221119f187647bfc7cdb273676649d63aabb8a2afc447572357083: Status 404 returned error can't find the container with id 2e3f3f830d221119f187647bfc7cdb273676649d63aabb8a2afc447572357083 Sep 10 17:43:24.404414 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.404400 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7jzcr" Sep 10 17:43:24.407904 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.407885 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed09fa0_af01_4f59_91e0_a6c7c7d9ff07.slice/crio-2ed7a60ec063390b6b16f192eb3aea81ddd52ad1fac334b66ea95189c467d69d WatchSource:0}: Error finding container 2ed7a60ec063390b6b16f192eb3aea81ddd52ad1fac334b66ea95189c467d69d: Status 404 returned error can't find the container with id 2ed7a60ec063390b6b16f192eb3aea81ddd52ad1fac334b66ea95189c467d69d Sep 10 17:43:24.409848 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.409823 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d8c49" Sep 10 17:43:24.414456 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.414436 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n6zbr" Sep 10 17:43:24.415341 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.415301 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc63600_b198_4c68_b838_a40560abc448.slice/crio-8dbd1163c1ced4800a6eab08cae5623f48c6dc7a266847ae9152165a440bbed0 WatchSource:0}: Error finding container 8dbd1163c1ced4800a6eab08cae5623f48c6dc7a266847ae9152165a440bbed0: Status 404 returned error can't find the container with id 8dbd1163c1ced4800a6eab08cae5623f48c6dc7a266847ae9152165a440bbed0 Sep 10 17:43:24.421272 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.421234 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0343c02_3302_4ecc_b884_702a0026c0cb.slice/crio-2d27ebc6ab1afad176596c04dc89d94e619c3b41c7fc6c5aeafd92bbe6485f85 WatchSource:0}: Error finding container 2d27ebc6ab1afad176596c04dc89d94e619c3b41c7fc6c5aeafd92bbe6485f85: Status 404 returned error can't find the container with id 2d27ebc6ab1afad176596c04dc89d94e619c3b41c7fc6c5aeafd92bbe6485f85 Sep 10 17:43:24.424698 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:24.424674 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61acebda_4243_4f37_b852_1584bbe917bc.slice/crio-c5581c0e141f5e3c42c80bb600b84946ed885eb4939e003690145d879509a887 WatchSource:0}: Error finding container c5581c0e141f5e3c42c80bb600b84946ed885eb4939e003690145d879509a887: Status 404 returned error can't find the container with id c5581c0e141f5e3c42c80bb600b84946ed885eb4939e003690145d879509a887 Sep 10 17:43:24.632214 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.632132 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:24.632391 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.632297 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:24.632391 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.632385 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret podName:76889f62-c935-47d0-a249-35a7650c5a03 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:25.632365486 +0000 UTC m=+3.026814724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret") pod "global-pull-secret-syncer-rjnqb" (UID: "76889f62-c935-47d0-a249-35a7650c5a03") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:24.733411 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.733374 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:24.733589 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.733574 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:24.734014 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.733645 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:43:25.733627542 +0000 UTC m=+3.128076777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:24.834757 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:24.834104 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:24.834757 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.834336 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:24.834757 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.834359 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:24.834757 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.834371 2588 projected.go:196] Error preparing data for projected volume kube-api-access-b64zh for pod openshift-network-diagnostics/network-check-target-xdckl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:24.834757 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:24.834437 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh podName:83b0692a-de58-4ff7-8efa-5beab6c7b949 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:25.834409315 +0000 UTC m=+3.228858560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b64zh" (UniqueName: "kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh") pod "network-check-target-xdckl" (UID: "83b0692a-de58-4ff7-8efa-5beab6c7b949") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:25.081560 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.081427 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:38:24 +0000 UTC" deadline="2028-04-11 05:05:05.068841011 +0000 UTC" Sep 10 17:43:25.081560 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.081475 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13883h21m39.987370667s" Sep 10 17:43:25.140808 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.140699 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d8c49" event={"ID":"f0343c02-3302-4ecc-b884-702a0026c0cb","Type":"ContainerStarted","Data":"2d27ebc6ab1afad176596c04dc89d94e619c3b41c7fc6c5aeafd92bbe6485f85"} Sep 10 17:43:25.158448 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.158234 2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:25.165556 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.165521 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tt7rv" event={"ID":"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07","Type":"ContainerStarted","Data":"2ed7a60ec063390b6b16f192eb3aea81ddd52ad1fac334b66ea95189c467d69d"} Sep 10 17:43:25.175960 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.175923 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drpl9" event={"ID":"ee7b9c0a-0b03-4069-94f5-e4375b835807","Type":"ContainerStarted","Data":"8d903801db953b6b015544fd9cbb50d07ec339b3f2b23d1690bea9c4a234e887"} Sep 10 17:43:25.180726 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.180693 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"08e8aaa7e80063e50afc7a2e241f3d844ac2fb38c4abe375355dc377c94eb6bc"} Sep 10 17:43:25.186813 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.186778 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fvsfm" event={"ID":"f3641af0-5402-41af-bccb-f8361f7b08dc","Type":"ContainerStarted","Data":"41a790e392310eee2ccf6c41ba6280ffc642a14cb211bbca4047303cf761d2a9"} Sep 10 17:43:25.198811 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.198726 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n6zbr" event={"ID":"61acebda-4243-4f37-b852-1584bbe917bc","Type":"ContainerStarted","Data":"c5581c0e141f5e3c42c80bb600b84946ed885eb4939e003690145d879509a887"} Sep 10 17:43:25.205403 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.205371 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7jzcr" event={"ID":"2dc63600-b198-4c68-b838-a40560abc448","Type":"ContainerStarted","Data":"8dbd1163c1ced4800a6eab08cae5623f48c6dc7a266847ae9152165a440bbed0"} Sep 10 17:43:25.208186 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.208157 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" event={"ID":"4f319c89-92c0-4fc7-809d-cff513bffc67","Type":"ContainerStarted","Data":"2e3f3f830d221119f187647bfc7cdb273676649d63aabb8a2afc447572357083"} Sep 10 17:43:25.230277 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.230191 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x54pr" event={"ID":"19f47f90-d4c7-40d8-97b5-21447400a63d","Type":"ContainerStarted","Data":"da6cc8e4491402092af5cbe2ad614b980a1b0030ea5461f33a6c469dbaaa4085"} Sep 10 17:43:25.618582 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.618302 2588 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:25.641168 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.641122 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:25.641354 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:25.641263 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:25.641354 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:25.641347 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret podName:76889f62-c935-47d0-a249-35a7650c5a03 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:27.64130592 +0000 UTC m=+5.035755173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret") pod "global-pull-secret-syncer-rjnqb" (UID: "76889f62-c935-47d0-a249-35a7650c5a03") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:25.742109 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.742056 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:25.742286 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:25.742240 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:25.742371 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:25.742305 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:43:27.742286379 +0000 UTC m=+5.136735617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:25.842872 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:25.842833 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:25.843065 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:25.843047 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:25.843132 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:25.843074 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:25.843132 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:25.843086 2588 projected.go:196] Error preparing data for projected volume kube-api-access-b64zh for pod openshift-network-diagnostics/network-check-target-xdckl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:25.843230 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:25.843144 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh podName:83b0692a-de58-4ff7-8efa-5beab6c7b949 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:27.843126522 +0000 UTC m=+5.237575759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b64zh" (UniqueName: "kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh") pod "network-check-target-xdckl" (UID: "83b0692a-de58-4ff7-8efa-5beab6c7b949") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:26.082494 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:26.082378 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:38:24 +0000 UTC" deadline="2028-03-19 01:30:12.731052304 +0000 UTC" Sep 10 17:43:26.082494 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:26.082443 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13327h46m46.648614058s" Sep 10 17:43:26.098274 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:26.098242 2588 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:26.117372 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:26.117339 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:26.117533 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:26.117470 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:26.117885 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:26.117866 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:26.117990 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:26.117971 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:26.118056 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:26.118035 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:26.118114 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:26.118098 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:27.657433 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:27.657243 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:27.657433 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:27.657418 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:27.658325 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:27.657481 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret podName:76889f62-c935-47d0-a249-35a7650c5a03 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:31.657463154 +0000 UTC m=+9.051912397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret") pod "global-pull-secret-syncer-rjnqb" (UID: "76889f62-c935-47d0-a249-35a7650c5a03") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:27.757863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:27.757823 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:27.758110 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:27.758037 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:27.758110 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:27.758098 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:43:31.758081498 +0000 UTC m=+9.152530737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:27.858602 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:27.858561 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:27.858768 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:27.858749 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:27.858844 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:27.858776 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:27.858844 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:27.858790 2588 projected.go:196] Error preparing data for projected volume kube-api-access-b64zh for pod openshift-network-diagnostics/network-check-target-xdckl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:27.858949 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:27.858852 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh podName:83b0692a-de58-4ff7-8efa-5beab6c7b949 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:31.85883369 +0000 UTC m=+9.253282936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b64zh" (UniqueName: "kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh") pod "network-check-target-xdckl" (UID: "83b0692a-de58-4ff7-8efa-5beab6c7b949") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:28.117878 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:28.117790 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:28.117878 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:28.117827 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:28.118094 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:28.117790 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:28.118094 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:28.117930 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:28.118094 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:28.117975 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:28.118094 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:28.118053 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:30.117035 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:30.116930 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:30.117035 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:30.116963 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:30.117035 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:30.116930 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:30.117635 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:30.117097 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:30.117635 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:30.117190 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:30.117635 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:30.117306 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:31.690776 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:31.690712 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:31.691353 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:31.690880 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:31.691353 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:31.690938 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret podName:76889f62-c935-47d0-a249-35a7650c5a03 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:39.690925591 +0000 UTC m=+17.085374829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret") pod "global-pull-secret-syncer-rjnqb" (UID: "76889f62-c935-47d0-a249-35a7650c5a03") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:31.792436 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:31.791846 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:31.792436 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:31.792011 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:31.792436 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:31.792075 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:43:39.792055525 +0000 UTC m=+17.186504775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:31.892428 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:31.892261 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:31.892594 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:31.892459 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:31.892594 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:31.892482 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:31.892594 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:31.892495 2588 projected.go:196] Error preparing data for projected volume kube-api-access-b64zh for pod openshift-network-diagnostics/network-check-target-xdckl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:31.892594 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:31.892553 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh podName:83b0692a-de58-4ff7-8efa-5beab6c7b949 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:39.892541074 +0000 UTC m=+17.286990311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b64zh" (UniqueName: "kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh") pod "network-check-target-xdckl" (UID: "83b0692a-de58-4ff7-8efa-5beab6c7b949") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:32.117521 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:32.117485 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:32.117683 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:32.117613 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:32.117882 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:32.117858 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:32.118003 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:32.117981 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:32.118066 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:32.117994 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:32.118116 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:32.118095 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:34.117746 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:34.117709 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:34.117746 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:34.117744 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:34.118195 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:34.117744 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:34.118195 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:34.117833 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:34.118195 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:34.117916 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:34.118195 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:34.117974 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:36.117559 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:36.117530 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:36.118017 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:36.117597 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:36.118017 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:36.117719 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:36.118017 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:36.117714 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:36.118017 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:36.117852 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:36.118017 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:36.117926 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:38.117400 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:38.117364 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:38.117957 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:38.117376 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:38.117957 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:38.117511 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:38.117957 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:38.117382 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:38.117957 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:38.117561 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:38.117957 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:38.117663 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:39.750406 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:39.750362 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:39.750906 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:39.750519 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:39.750906 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:39.750596 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret podName:76889f62-c935-47d0-a249-35a7650c5a03 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:55.750575936 +0000 UTC m=+33.145025183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret") pod "global-pull-secret-syncer-rjnqb" (UID: "76889f62-c935-47d0-a249-35a7650c5a03") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:39.851104 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:39.851063 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:39.851290 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:39.851243 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:39.851375 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:39.851334 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:43:55.851299247 +0000 UTC m=+33.245748497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:39.951904 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:39.951862 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:39.952090 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:39.952056 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:39.952090 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:39.952083 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:39.952190 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:39.952096 2588 projected.go:196] Error preparing data for projected volume kube-api-access-b64zh for pod openshift-network-diagnostics/network-check-target-xdckl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:39.952190 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:39.952160 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh podName:83b0692a-de58-4ff7-8efa-5beab6c7b949 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:55.952141943 +0000 UTC m=+33.346591176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b64zh" (UniqueName: "kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh") pod "network-check-target-xdckl" (UID: "83b0692a-de58-4ff7-8efa-5beab6c7b949") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:40.117433 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:40.117341 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:40.117597 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:40.117458 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:40.117597 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:40.117482 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:40.117597 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:40.117558 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:40.117597 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:40.117463 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:40.117782 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:40.117663 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:42.117077 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:42.117037 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:42.117077 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:42.117075 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:42.117077 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:42.117079 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:42.117648 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:42.117166 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:42.117648 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:42.117221 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:42.117648 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:42.117326 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:43.274198 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.274029 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" event={"ID":"5907c737389965eebb4c3a73e149b012","Type":"ContainerStarted","Data":"e7337da880e203bac423a19feff29f81ffef2544052942a2b59e79754723bca4"} Sep 10 17:43:43.280978 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.280944 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d8c49" event={"ID":"f0343c02-3302-4ecc-b884-702a0026c0cb","Type":"ContainerStarted","Data":"efcbd6deb83359b0a3f565cd7bf3a993262daa2708a49786d78f2938cdcdecdf"} Sep 10 17:43:43.287374 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.287349 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:43:43.287758 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.287732 2588 generic.go:356] "Generic (PLEG): container finished" podID="ff8923a5-5a5e-4d30-8368-4caf0a95424c" containerID="deae093cf0775152cc65383bd8a3a08f2e094512e89f8bfe7b24f096765f9df4" exitCode=1 Sep 10 17:43:43.287836 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.287777 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"a38c5b15ac0b87f27d5f18d36cbd039e441f93644632ee3d4f39833008b0901e"} Sep 10 17:43:43.287836 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.287827 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"ba9c2c389b0a831afb74e11283a88db48b77279f5413cab7bf783b7396717f87"} Sep 10 17:43:43.287910 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.287889 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerDied","Data":"deae093cf0775152cc65383bd8a3a08f2e094512e89f8bfe7b24f096765f9df4"} Sep 10 17:43:43.287959 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.287924 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"6b33c27d7fe2143e74963d0b6a12818aedf0a30567902400e3d3e351979bf869"} Sep 10 17:43:43.289808 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.289731 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" podStartSLOduration=20.289717616 podStartE2EDuration="20.289717616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:43.28940026 +0000 UTC m=+20.683849516" watchObservedRunningTime="2026-09-10 17:43:43.289717616 +0000 UTC m=+20.684166874" Sep 10 17:43:43.307302 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:43.307106 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d8c49" podStartSLOduration=2.218844414 podStartE2EDuration="20.307083961s" totalImagesPullingTime="18.088239547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:43.306361777 +0000 UTC m=+20.700811032" watchObservedRunningTime="2026-09-10 17:43:43.307083961 +0000 UTC m=+20.701533216" Sep 10 17:43:44.117717 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.117528 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:44.117872 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.117598 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:44.117872 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:44.117792 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:44.117964 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:44.117888 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:44.117964 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.117598 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:44.118027 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:44.117965 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:44.292336 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.292271 2588 generic.go:356] "Generic (PLEG): container finished" podID="31df2fb96023e0c5ede7770b34c7bcbb" containerID="7c5788686691d5fd51e81d313fd87961c2e1c9a2bd0ac56eb608948b93e0af28" exitCode=0 Sep 10 17:43:44.293114 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.292350 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" event={"ID":"31df2fb96023e0c5ede7770b34c7bcbb","Type":"ContainerDied","Data":"7c5788686691d5fd51e81d313fd87961c2e1c9a2bd0ac56eb608948b93e0af28"} Sep 10 17:43:44.294208 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.294172 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tt7rv" event={"ID":"bed09fa0-af01-4f59-91e0-a6c7c7d9ff07","Type":"ContainerStarted","Data":"1d308ed576fc998f26549c86f9123fd628fe55b7e5bd0d7f21172fe01d9c25d2"} Sep 10 17:43:44.295936 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.295910 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drpl9" event={"ID":"ee7b9c0a-0b03-4069-94f5-e4375b835807","Type":"ContainerStarted","Data":"7bb7975253368ce7e8b2a250b7d31fbfa24edcf831159633df3efef89d53b4a0"} Sep 10 17:43:44.299084 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.299066 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:43:44.299480 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.299459 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"6a25f227d6dc92c2bd69699f2fa5a22653e3e8ffa34d76a071be7c5fd84612a7"} Sep 10 17:43:44.299567 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.299521 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"4d4d5c908773077689aac0e5dc002e2b3c83104b0bf60d40a27acb4c70dea791"} Sep 10 17:43:44.301109 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.301083 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fvsfm" event={"ID":"f3641af0-5402-41af-bccb-f8361f7b08dc","Type":"ContainerStarted","Data":"a19e59406dcb28ea65f27ca15f87c6d60ae60c6d8a576c98d302592c77e40bce"} Sep 10 17:43:44.302653 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.302631 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n6zbr" event={"ID":"61acebda-4243-4f37-b852-1584bbe917bc","Type":"ContainerStarted","Data":"426aeca157af96f62b09eec1e62f267c776f782fbe40e711be7928533dcf8f4e"} Sep 10 17:43:44.304202 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.304174 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7jzcr" event={"ID":"2dc63600-b198-4c68-b838-a40560abc448","Type":"ContainerStarted","Data":"fc220b9f94889caa6ad37f04a2f09de420a697fb3c909d262a7b96528e28f809"} Sep 10 17:43:44.305957 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.305937 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" event={"ID":"4f319c89-92c0-4fc7-809d-cff513bffc67","Type":"ContainerStarted","Data":"8322cba7b1a6bcf3d4c04122680b9df1c0fd9277d2401d9a6673604d5f668d6a"} Sep 10 17:43:44.307850 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.307827 2588 generic.go:356] "Generic (PLEG): container finished" podID="19f47f90-d4c7-40d8-97b5-21447400a63d" containerID="f8b2030f790d79ed59e32f50f05a0b0c6c35d31f663c7b5317a30ab2ac621fec" exitCode=0 Sep 10 17:43:44.307928 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.307860 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x54pr" event={"ID":"19f47f90-d4c7-40d8-97b5-21447400a63d","Type":"ContainerDied","Data":"f8b2030f790d79ed59e32f50f05a0b0c6c35d31f663c7b5317a30ab2ac621fec"} Sep 10 17:43:44.336141 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.336097 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tt7rv" podStartSLOduration=3.307576518 podStartE2EDuration="21.336082924s" totalImagesPullingTime="18.028506406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:44.335983575 +0000 UTC m=+21.730432841" watchObservedRunningTime="2026-09-10 17:43:44.336082924 +0000 UTC m=+21.730532179" Sep 10 17:43:44.336545 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.336515 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fvsfm" podStartSLOduration=3.257078522 podStartE2EDuration="21.336506936s" totalImagesPullingTime="18.079428414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:44.32113195 +0000 UTC m=+21.715581208" watchObservedRunningTime="2026-09-10 17:43:44.336506936 +0000 UTC m=+21.730956190" Sep 10 17:43:44.354076 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.354037 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7jzcr" podStartSLOduration=2.52125795 podStartE2EDuration="21.3540211s" totalImagesPullingTime="18.83276315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:44.353612583 +0000 UTC m=+21.748061838" watchObservedRunningTime="2026-09-10 17:43:44.3540211 +0000 UTC m=+21.748470354" Sep 10 17:43:44.369630 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.369550 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-drpl9" podStartSLOduration=3.273912968 podStartE2EDuration="21.369532547s" totalImagesPullingTime="18.095619579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:44.369401849 +0000 UTC m=+21.763851117" watchObservedRunningTime="2026-09-10 17:43:44.369532547 +0000 UTC m=+21.763981802" Sep 10 17:43:44.383839 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.383785 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n6zbr" podStartSLOduration=3.294106639 podStartE2EDuration="21.38376735s" totalImagesPullingTime="18.089660711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:44.383257147 +0000 UTC m=+21.777706404" watchObservedRunningTime="2026-09-10 17:43:44.38376735 +0000 UTC m=+21.778216607" Sep 10 17:43:44.499793 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:44.499770 2588 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 17:43:45.092710 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.092604 2588 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T17:43:44.499787958Z","UUID":"73f7731f-7e90-43c1-bd74-d4dc936e7b08","Handler":null,"Name":"","Endpoint":""} Sep 10 17:43:45.097015 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.096991 2588 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 17:43:45.097207 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.097029 2588 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 17:43:45.150470 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.150437 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:45.151241 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.151212 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:45.312745 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.312710 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" event={"ID":"4f319c89-92c0-4fc7-809d-cff513bffc67","Type":"ContainerStarted","Data":"944840031c76db59d75f29517f9aa9d387575fac707070203bf86a0b6004681b"} Sep 10 17:43:45.315161 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.315113 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" event={"ID":"31df2fb96023e0c5ede7770b34c7bcbb","Type":"ContainerStarted","Data":"cc0388865129647398235040e1f7869794c839a590e632695f9fd099cd61544a"} Sep 10 17:43:45.315763 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.315739 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:45.316621 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.316580 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-drpl9" Sep 10 17:43:45.348116 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:45.348009 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" podStartSLOduration=22.347990917 podStartE2EDuration="22.347990917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:45.331175704 +0000 UTC m=+22.725624961" watchObservedRunningTime="2026-09-10 17:43:45.347990917 +0000 UTC m=+22.742440175" Sep 10 17:43:46.117260 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:46.117059 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:46.117464 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:46.117121 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:46.117464 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:46.117382 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:46.117464 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:46.117130 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:46.117464 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:46.117436 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:46.117620 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:46.117530 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:46.320977 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:46.320949 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:43:46.321555 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:46.321385 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"3cd67d2a4e5457f23ff07012288c92d94ed2d8dc34d75063341ea9f33a714e7f"} Sep 10 17:43:46.323832 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:46.323805 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" event={"ID":"4f319c89-92c0-4fc7-809d-cff513bffc67","Type":"ContainerStarted","Data":"ec07b67812ecdeb7818962ef8c6579f0b1a072b12883666394c2eef79cdf881a"} Sep 10 17:43:46.343798 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:46.343741 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdnff" podStartSLOduration=3.58529762 podStartE2EDuration="23.343725793s" totalImagesPullingTime="19.758428173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:46.342971357 +0000 UTC m=+23.737420623" watchObservedRunningTime="2026-09-10 17:43:46.343725793 +0000 UTC m=+23.738175048" Sep 10 17:43:48.117293 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:48.117246 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:48.117293 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:48.117289 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:48.117748 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:48.117261 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:48.117748 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:48.117380 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:48.117748 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:48.117429 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:48.117748 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:48.117500 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:49.331374 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:49.331177 2588 generic.go:356] "Generic (PLEG): container finished" podID="19f47f90-d4c7-40d8-97b5-21447400a63d" containerID="dcdb53be84040bbdcab7c30b1fb2fac395a646a3f711fce8685b2ae365b6a9a7" exitCode=0 Sep 10 17:43:49.331822 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:49.331256 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x54pr" event={"ID":"19f47f90-d4c7-40d8-97b5-21447400a63d","Type":"ContainerDied","Data":"dcdb53be84040bbdcab7c30b1fb2fac395a646a3f711fce8685b2ae365b6a9a7"} Sep 10 17:43:49.335351 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:49.335334 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:43:49.335675 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:49.335657 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"08b5940b49f45c846dca9c81ad54e3c779b27f34ecfef3cb81f6605eedcd998e"} Sep 10 17:43:49.335851 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:49.335835 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:49.335950 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:49.335878 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:49.336063 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:49.336042 2588 scope.go:117] "RemoveContainer" containerID="deae093cf0775152cc65383bd8a3a08f2e094512e89f8bfe7b24f096765f9df4" Sep 10 17:43:49.351916 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:49.351892 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:50.117418 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.117362 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:50.117605 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.117395 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:50.117605 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:50.117486 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:50.117605 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.117398 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:50.117605 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:50.117561 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:50.117734 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:50.117652 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:50.341786 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.341762 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:43:50.342491 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.342157 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" event={"ID":"ff8923a5-5a5e-4d30-8368-4caf0a95424c","Type":"ContainerStarted","Data":"77ccf89dcec04314f22cf2ddbf70ef5c5779e8610565bbabfb6a1b91ab79961c"} Sep 10 17:43:50.342491 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.342442 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:50.344241 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.344215 2588 generic.go:356] "Generic (PLEG): container finished" podID="19f47f90-d4c7-40d8-97b5-21447400a63d" containerID="c2509aedf018d165b59cde8ed667e94ba896c3824461221227e208591bb3ed2b" exitCode=0 Sep 10 17:43:50.344355 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.344266 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x54pr" event={"ID":"19f47f90-d4c7-40d8-97b5-21447400a63d","Type":"ContainerDied","Data":"c2509aedf018d165b59cde8ed667e94ba896c3824461221227e208591bb3ed2b"} Sep 10 17:43:50.357295 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.357273 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:43:50.383546 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.383465 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" podStartSLOduration=8.915890182 podStartE2EDuration="27.383426509s" totalImagesPullingTime="18.467536327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:50.379798727 +0000 UTC m=+27.774247992" watchObservedRunningTime="2026-09-10 17:43:50.383426509 +0000 UTC m=+27.777875763" Sep 10 17:43:50.514133 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.514046 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdckl"] Sep 10 17:43:50.514346 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.514178 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:50.514346 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:50.514281 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:50.526416 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.526382 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qmzql"] Sep 10 17:43:50.526545 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.526498 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:50.526635 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:50.526611 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:50.527078 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.527055 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjnqb"] Sep 10 17:43:50.527169 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:50.527128 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:50.527241 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:50.527221 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:51.348940 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:51.348846 2588 generic.go:356] "Generic (PLEG): container finished" podID="19f47f90-d4c7-40d8-97b5-21447400a63d" containerID="102e02834d754dbfcf1dce70174718d2484efed9867d67fd8e423b4eed7ad013" exitCode=0 Sep 10 17:43:51.349325 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:51.348931 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x54pr" event={"ID":"19f47f90-d4c7-40d8-97b5-21447400a63d","Type":"ContainerDied","Data":"102e02834d754dbfcf1dce70174718d2484efed9867d67fd8e423b4eed7ad013"} Sep 10 17:43:52.117640 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:52.117278 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:52.117640 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:52.117278 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:52.117640 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:52.117613 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:52.117937 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:52.117682 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:52.117937 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:52.117374 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:52.117937 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:52.117780 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:54.116980 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:54.116942 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:54.117507 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:54.117062 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:54.117507 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:54.117081 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdckl" podUID="83b0692a-de58-4ff7-8efa-5beab6c7b949" Sep 10 17:43:54.117507 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:54.117210 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjnqb" podUID="76889f62-c935-47d0-a249-35a7650c5a03" Sep 10 17:43:54.117507 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:54.117231 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:54.117507 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:54.117359 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:43:55.417619 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.417349 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeReady" Sep 10 17:43:55.417619 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.417512 2588 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 17:43:55.452217 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.452182 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-766b8d745b-k8b4f"] Sep 10 17:43:55.497623 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.497593 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-59p25"] Sep 10 17:43:55.497803 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.497681 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.500245 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.500218 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 17:43:55.500580 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.500560 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsfqd\"" Sep 10 17:43:55.500776 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.500758 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 17:43:55.500893 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.500817 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 17:43:55.505814 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.505792 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 17:43:55.526696 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.526664 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2gmwm"] Sep 10 17:43:55.526853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.526800 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.529369 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.529345 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 17:43:55.529496 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.529369 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f22bv\"" Sep 10 17:43:55.529496 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.529352 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 17:43:55.552306 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.552275 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-766b8d745b-k8b4f"] Sep 10 17:43:55.552474 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.552338 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-59p25"] Sep 10 17:43:55.552474 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.552362 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2gmwm"] Sep 10 17:43:55.552474 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.552370 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2gmwm" Sep 10 17:43:55.555228 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.555082 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 17:43:55.555228 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.555100 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 17:43:55.555228 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.555160 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ck4tw\"" Sep 10 17:43:55.555228 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.555196 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 17:43:55.563544 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.563518 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6gsk\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-kube-api-access-j6gsk\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.563650 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.563558 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-trusted-ca\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.563650 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.563610 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-bound-sa-token\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.563650 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.563640 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-certificates\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.563773 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.563688 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-installation-pull-secrets\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.563773 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.563738 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-image-registry-private-configuration\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.563863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.563792 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.563863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.563829 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6d0fec2-74f7-43f0-b26d-9499f106e54c-ca-trust-extracted\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.668926 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.668827 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6d0fec2-74f7-43f0-b26d-9499f106e54c-ca-trust-extracted\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.669075 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.668948 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-config-volume\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.669428 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669396 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.669560 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669434 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bsxc\" (UniqueName: \"kubernetes.io/projected/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-kube-api-access-2bsxc\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.669560 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669482 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6gsk\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-kube-api-access-j6gsk\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.669560 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669522 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-trusted-ca\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.669716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669566 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-bound-sa-token\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.669716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669581 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-tmp-dir\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.669716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669594 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f5fe123-739a-4e69-a7b2-33312d784386-cert\") pod \"ingress-canary-2gmwm\" (UID: \"3f5fe123-739a-4e69-a7b2-33312d784386\") " pod="openshift-ingress-canary/ingress-canary-2gmwm" Sep 10 17:43:55.669716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669623 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-certificates\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.669716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669647 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-installation-pull-secrets\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.669716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669683 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-image-registry-private-configuration\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.669716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669683 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6d0fec2-74f7-43f0-b26d-9499f106e54c-ca-trust-extracted\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.670056 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669732 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.670056 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.669761 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6cxw\" (UniqueName: \"kubernetes.io/projected/3f5fe123-739a-4e69-a7b2-33312d784386-kube-api-access-t6cxw\") pod \"ingress-canary-2gmwm\" (UID: \"3f5fe123-739a-4e69-a7b2-33312d784386\") " pod="openshift-ingress-canary/ingress-canary-2gmwm" Sep 10 17:43:55.670056 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.669988 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:43:55.670056 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.670003 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:43:55.670056 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.670053 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:43:56.170039036 +0000 UTC m=+33.564488294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:43:55.670304 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.670261 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-certificates\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.670633 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.670611 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-trusted-ca\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.673896 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.673869 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-installation-pull-secrets\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.673982 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.673879 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-image-registry-private-configuration\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.679450 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.679425 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-bound-sa-token\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.679561 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.679469 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6gsk\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-kube-api-access-j6gsk\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:55.770623 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.770591 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-config-volume\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.770623 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.770624 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.770844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.770641 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bsxc\" (UniqueName: \"kubernetes.io/projected/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-kube-api-access-2bsxc\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.770844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.770684 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-tmp-dir\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.770844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.770698 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f5fe123-739a-4e69-a7b2-33312d784386-cert\") pod \"ingress-canary-2gmwm\" (UID: \"3f5fe123-739a-4e69-a7b2-33312d784386\") " pod="openshift-ingress-canary/ingress-canary-2gmwm" Sep 10 17:43:55.770844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.770719 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:55.770844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.770742 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6cxw\" (UniqueName: \"kubernetes.io/projected/3f5fe123-739a-4e69-a7b2-33312d784386-kube-api-access-t6cxw\") pod \"ingress-canary-2gmwm\" (UID: \"3f5fe123-739a-4e69-a7b2-33312d784386\") " pod="openshift-ingress-canary/ingress-canary-2gmwm" Sep 10 17:43:55.770844 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.770741 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:43:55.771122 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.770889 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:56.270869906 +0000 UTC m=+33.665319153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:43:55.771122 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.770890 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:55.771122 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.770961 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret podName:76889f62-c935-47d0-a249-35a7650c5a03 nodeName:}" failed. No retries permitted until 2026-09-10 17:44:27.770946948 +0000 UTC m=+65.165396195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret") pod "global-pull-secret-syncer-rjnqb" (UID: "76889f62-c935-47d0-a249-35a7650c5a03") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:55.771122 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.771072 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-tmp-dir\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.771324 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.771144 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-config-volume\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.773145 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.773126 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f5fe123-739a-4e69-a7b2-33312d784386-cert\") pod \"ingress-canary-2gmwm\" (UID: \"3f5fe123-739a-4e69-a7b2-33312d784386\") " pod="openshift-ingress-canary/ingress-canary-2gmwm" Sep 10 17:43:55.778935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.778910 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bsxc\" (UniqueName: \"kubernetes.io/projected/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-kube-api-access-2bsxc\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:55.779032 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.779021 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6cxw\" (UniqueName: \"kubernetes.io/projected/3f5fe123-739a-4e69-a7b2-33312d784386-kube-api-access-t6cxw\") pod \"ingress-canary-2gmwm\" (UID: \"3f5fe123-739a-4e69-a7b2-33312d784386\") " pod="openshift-ingress-canary/ingress-canary-2gmwm" Sep 10 17:43:55.861891 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.861844 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2gmwm" Sep 10 17:43:55.871131 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.871105 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:55.871218 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.871205 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:55.871261 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.871257 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:44:27.871244074 +0000 UTC m=+65.265693307 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:55.972165 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:55.972000 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:55.972305 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.972166 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:55.972305 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.972187 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:55.972305 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.972198 2588 projected.go:196] Error preparing data for projected volume kube-api-access-b64zh for pod openshift-network-diagnostics/network-check-target-xdckl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:55.972305 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:55.972265 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh podName:83b0692a-de58-4ff7-8efa-5beab6c7b949 nodeName:}" failed. No retries permitted until 2026-09-10 17:44:27.972251257 +0000 UTC m=+65.366700490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b64zh" (UniqueName: "kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh") pod "network-check-target-xdckl" (UID: "83b0692a-de58-4ff7-8efa-5beab6c7b949") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:56.117562 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.117523 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:43:56.117700 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.117569 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:43:56.117700 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.117533 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:43:56.120160 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.120135 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:43:56.120294 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.120169 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:43:56.120412 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.120396 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:43:56.120484 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.120470 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kjkcx\"" Sep 10 17:43:56.120542 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.120516 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:43:56.120599 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.120547 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fgh9m\"" Sep 10 17:43:56.164098 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.164070 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2gmwm"] Sep 10 17:43:56.174112 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.174088 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:56.174246 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:56.174229 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:43:56.174291 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:56.174248 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:43:56.174347 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:56.174299 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:43:57.174284851 +0000 UTC m=+34.568734104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:43:56.179321 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:43:56.179288 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5fe123_739a_4e69_a7b2_33312d784386.slice/crio-364191aa770a5f6cf7fba888c54d6cae85b6d307a44b3f22bba6b76807114b12 WatchSource:0}: Error finding container 364191aa770a5f6cf7fba888c54d6cae85b6d307a44b3f22bba6b76807114b12: Status 404 returned error can't find the container with id 364191aa770a5f6cf7fba888c54d6cae85b6d307a44b3f22bba6b76807114b12 Sep 10 17:43:56.274747 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.274713 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:56.274911 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:56.274874 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:43:56.274967 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:56.274953 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:57.274932633 +0000 UTC m=+34.669381886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:43:56.363695 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.363662 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2gmwm" event={"ID":"3f5fe123-739a-4e69-a7b2-33312d784386","Type":"ContainerStarted","Data":"364191aa770a5f6cf7fba888c54d6cae85b6d307a44b3f22bba6b76807114b12"} Sep 10 17:43:56.383450 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.383422 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:56.490421 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.490391 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:56.592173 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:56.592102 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:57.181836 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:57.181799 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:57.182027 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:57.181972 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:43:57.182027 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:57.181991 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:43:57.182100 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:57.182053 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:43:59.182036994 +0000 UTC m=+36.576486227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:43:57.282765 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:57.282725 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:57.282953 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:57.282897 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:43:57.282995 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:57.282973 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:59.282952693 +0000 UTC m=+36.677401932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:43:57.372455 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:57.372422 2588 generic.go:356] "Generic (PLEG): container finished" podID="19f47f90-d4c7-40d8-97b5-21447400a63d" containerID="2085f7eaac0b3abfdb21120f39411d4e20b84b10475ce06a6843ba08d75ff865" exitCode=0 Sep 10 17:43:57.372639 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:57.372464 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x54pr" event={"ID":"19f47f90-d4c7-40d8-97b5-21447400a63d","Type":"ContainerDied","Data":"2085f7eaac0b3abfdb21120f39411d4e20b84b10475ce06a6843ba08d75ff865"} Sep 10 17:43:58.377824 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:58.377791 2588 generic.go:356] "Generic (PLEG): container finished" podID="19f47f90-d4c7-40d8-97b5-21447400a63d" containerID="77ffbe05a25c351e691da1cefbd2dfc14f8b2a9f7b188f8634cd3ae97fe17975" exitCode=0 Sep 10 17:43:58.377824 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:58.377828 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x54pr" event={"ID":"19f47f90-d4c7-40d8-97b5-21447400a63d","Type":"ContainerDied","Data":"77ffbe05a25c351e691da1cefbd2dfc14f8b2a9f7b188f8634cd3ae97fe17975"} Sep 10 17:43:58.901590 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:58.901556 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:59.000265 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.000192 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:59.058932 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.058885 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:59.198352 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.198289 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:43:59.198516 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:59.198452 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:43:59.198516 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:59.198471 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:43:59.198592 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:59.198523 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:44:03.198508466 +0000 UTC m=+40.592957705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:43:59.217873 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.217841 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:59.283626 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.283550 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:59.299492 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.299470 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:43:59.299641 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:59.299623 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:43:59.299699 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:43:59.299689 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:44:03.299675085 +0000 UTC m=+40.694124319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:43:59.383424 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.383391 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x54pr" event={"ID":"19f47f90-d4c7-40d8-97b5-21447400a63d","Type":"ContainerStarted","Data":"8e6c99b402d6fd503d0b74d4eb99fa812fb560d32f2f8ca3ae4fe3c3a07751ac"} Sep 10 17:43:59.384898 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.384872 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2gmwm" event={"ID":"3f5fe123-739a-4e69-a7b2-33312d784386","Type":"ContainerStarted","Data":"f6a9091da23c0f02efde6e8dbacc2641b9f60fe9500d6773ebb97c6a607055d2"} Sep 10 17:43:59.405411 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.405353 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x54pr" podStartSLOduration=7.73652477 podStartE2EDuration="36.40533432s" totalImagesPullingTime="28.66880955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:59.404162575 +0000 UTC m=+36.798611830" watchObservedRunningTime="2026-09-10 17:43:59.40533432 +0000 UTC m=+36.799783577" Sep 10 17:43:59.419543 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.419497 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2gmwm" podStartSLOduration=1.899829044 podStartE2EDuration="4.419479921s" totalImagesPullingTime="2.519650877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:59.419022803 +0000 UTC m=+36.813472070" watchObservedRunningTime="2026-09-10 17:43:59.419479921 +0000 UTC m=+36.813929177" Sep 10 17:43:59.532959 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.532927 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:43:59.595066 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:43:59.594989 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:00.933856 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:00.933682 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:00.987448 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:00.987416 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:03.227360 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:03.227325 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:44:03.227732 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:03.227474 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:44:03.227732 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:03.227495 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:44:03.227732 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:03.227561 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:44:11.227545017 +0000 UTC m=+48.621994253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:44:03.328415 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:03.328376 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:44:03.328551 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:03.328535 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:03.328622 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:03.328612 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:44:11.328596632 +0000 UTC m=+48.723045885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:44:04.032727 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:04.032695 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:04.087130 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:04.087105 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:07.344918 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:07.344884 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:07.399010 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:07.398981 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:11.280148 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:11.280107 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:44:11.280555 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:11.280258 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:44:11.280555 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:11.280277 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:44:11.280555 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:11.280360 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:44:27.280344006 +0000 UTC m=+64.674793239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:44:11.380939 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:11.380907 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:44:11.381022 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:11.381007 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:11.381063 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:11.381054 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:44:27.381042042 +0000 UTC m=+64.775491275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:44:12.722443 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:12.722408 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:19.887333 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:19.887279 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:19.943161 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:19.943132 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:22.361891 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:22.361861 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4swb" Sep 10 17:44:22.517348 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:22.517304 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:22.575613 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:22.575583 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:26.984412 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:26.984377 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:27.039107 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.039072 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:27.292810 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.292734 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:44:27.292955 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:27.292863 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:44:27.292955 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:27.292877 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:44:27.292955 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:27.292930 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:44:59.29291531 +0000 UTC m=+96.687364542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:44:27.393704 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.393672 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:44:27.393829 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:27.393814 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:27.393881 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:27.393872 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:44:59.393856306 +0000 UTC m=+96.788305544 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:44:27.797192 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.797154 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:44:27.799390 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.799374 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:44:27.811408 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.811379 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76889f62-c935-47d0-a249-35a7650c5a03-original-pull-secret\") pod \"global-pull-secret-syncer-rjnqb\" (UID: \"76889f62-c935-47d0-a249-35a7650c5a03\") " pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:44:27.897658 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.897616 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:44:27.900264 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.900244 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:44:27.908883 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:27.908860 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:44:27.908998 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:27.908933 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:45:31.908916847 +0000 UTC m=+129.303366085 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : secret "metrics-daemon-secret" not found Sep 10 17:44:27.937756 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.937732 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjnqb" Sep 10 17:44:27.998391 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:27.998355 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:44:28.000964 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:28.000937 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:44:28.010856 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:28.010831 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:44:28.021741 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:28.021720 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b64zh\" (UniqueName: \"kubernetes.io/projected/83b0692a-de58-4ff7-8efa-5beab6c7b949-kube-api-access-b64zh\") pod \"network-check-target-xdckl\" (UID: \"83b0692a-de58-4ff7-8efa-5beab6c7b949\") " pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:44:28.232100 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:28.232072 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjnqb"] Sep 10 17:44:28.235288 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:44:28.235260 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76889f62_c935_47d0_a249_35a7650c5a03.slice/crio-247b25959e4358149abd4fe010a9b3046d72acc2d9c65bbab5ffe3c614b8174d WatchSource:0}: Error finding container 247b25959e4358149abd4fe010a9b3046d72acc2d9c65bbab5ffe3c614b8174d: Status 404 returned error can't find the container with id 247b25959e4358149abd4fe010a9b3046d72acc2d9c65bbab5ffe3c614b8174d Sep 10 17:44:28.235401 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:28.235373 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fgh9m\"" Sep 10 17:44:28.244217 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:28.244197 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:44:28.455004 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:28.454966 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjnqb" event={"ID":"76889f62-c935-47d0-a249-35a7650c5a03","Type":"ContainerStarted","Data":"247b25959e4358149abd4fe010a9b3046d72acc2d9c65bbab5ffe3c614b8174d"} Sep 10 17:44:28.533567 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:28.533478 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdckl"] Sep 10 17:44:28.536938 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:44:28.536913 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b0692a_de58_4ff7_8efa_5beab6c7b949.slice/crio-6fb8103a082117803765ba5e4324fce3c0d1ccd7fa4a8b6b480fa20ef082ecf0 WatchSource:0}: Error finding container 6fb8103a082117803765ba5e4324fce3c0d1ccd7fa4a8b6b480fa20ef082ecf0: Status 404 returned error can't find the container with id 6fb8103a082117803765ba5e4324fce3c0d1ccd7fa4a8b6b480fa20ef082ecf0 Sep 10 17:44:29.458975 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:29.458924 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdckl" event={"ID":"83b0692a-de58-4ff7-8efa-5beab6c7b949","Type":"ContainerStarted","Data":"6fb8103a082117803765ba5e4324fce3c0d1ccd7fa4a8b6b480fa20ef082ecf0"} Sep 10 17:44:30.982491 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:30.982459 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:33.471205 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:33.471166 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjnqb" event={"ID":"76889f62-c935-47d0-a249-35a7650c5a03","Type":"ContainerStarted","Data":"9543ff5a9e0d5aaec2feb9121fdca1ec130e3a7d63a3fe0496ff4048099bc90a"} Sep 10 17:44:33.472613 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:33.472590 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdckl" event={"ID":"83b0692a-de58-4ff7-8efa-5beab6c7b949","Type":"ContainerStarted","Data":"51f5cb09ccba21a5f0a5787d97d3ad3d9cd9faeffc9bcb2de2d76bf28c083df2"} Sep 10 17:44:33.472733 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:33.472715 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:44:33.485753 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:33.485702 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rjnqb" podStartSLOduration=65.935622534 podStartE2EDuration="1m10.485687212s" totalImagesPullingTime="4.550064678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:33.485068523 +0000 UTC m=+70.879517778" watchObservedRunningTime="2026-09-10 17:44:33.485687212 +0000 UTC m=+70.880136472" Sep 10 17:44:33.498629 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:33.498589 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xdckl" podStartSLOduration=66.256144804 podStartE2EDuration="1m10.498579535s" totalImagesPullingTime="4.242434731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:33.49855684 +0000 UTC m=+70.893006096" watchObservedRunningTime="2026-09-10 17:44:33.498579535 +0000 UTC m=+70.893028787" Sep 10 17:44:34.039588 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:34.039556 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:34.093593 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:34.093563 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:44:42.690680 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.690644 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc"] Sep 10 17:44:42.693496 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.693479 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" Sep 10 17:44:42.696960 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.696925 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 17:44:42.697221 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.697204 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 17:44:42.697475 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.697459 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 17:44:42.697721 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.697706 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kwq5v\"" Sep 10 17:44:42.697962 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.697947 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 17:44:42.702560 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.702535 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc"] Sep 10 17:44:42.793502 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.793469 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2e85e83-14ec-4e25-b1a6-2243dc359f5a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6d755f94-6wgzc\" (UID: \"e2e85e83-14ec-4e25-b1a6-2243dc359f5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" Sep 10 17:44:42.793665 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.793518 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk8w7\" (UniqueName: \"kubernetes.io/projected/e2e85e83-14ec-4e25-b1a6-2243dc359f5a-kube-api-access-lk8w7\") pod \"managed-serviceaccount-addon-agent-6d6d755f94-6wgzc\" (UID: \"e2e85e83-14ec-4e25-b1a6-2243dc359f5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" Sep 10 17:44:42.893847 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.893807 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2e85e83-14ec-4e25-b1a6-2243dc359f5a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6d755f94-6wgzc\" (UID: \"e2e85e83-14ec-4e25-b1a6-2243dc359f5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" Sep 10 17:44:42.894019 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.893859 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk8w7\" (UniqueName: \"kubernetes.io/projected/e2e85e83-14ec-4e25-b1a6-2243dc359f5a-kube-api-access-lk8w7\") pod \"managed-serviceaccount-addon-agent-6d6d755f94-6wgzc\" (UID: \"e2e85e83-14ec-4e25-b1a6-2243dc359f5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" Sep 10 17:44:42.896264 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.896238 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2e85e83-14ec-4e25-b1a6-2243dc359f5a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6d755f94-6wgzc\" (UID: \"e2e85e83-14ec-4e25-b1a6-2243dc359f5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" Sep 10 17:44:42.901755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:42.901729 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk8w7\" (UniqueName: \"kubernetes.io/projected/e2e85e83-14ec-4e25-b1a6-2243dc359f5a-kube-api-access-lk8w7\") pod \"managed-serviceaccount-addon-agent-6d6d755f94-6wgzc\" (UID: \"e2e85e83-14ec-4e25-b1a6-2243dc359f5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" Sep 10 17:44:43.013422 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:43.013391 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" Sep 10 17:44:43.278324 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:43.278233 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc"] Sep 10 17:44:43.282118 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:44:43.282091 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2e85e83_14ec_4e25_b1a6_2243dc359f5a.slice/crio-5e6ab3d0b4c4142d2e2e69525bbf54bfa533032947dedbf636ed56eef9e0ee20 WatchSource:0}: Error finding container 5e6ab3d0b4c4142d2e2e69525bbf54bfa533032947dedbf636ed56eef9e0ee20: Status 404 returned error can't find the container with id 5e6ab3d0b4c4142d2e2e69525bbf54bfa533032947dedbf636ed56eef9e0ee20 Sep 10 17:44:43.495389 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:43.495353 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" event={"ID":"e2e85e83-14ec-4e25-b1a6-2243dc359f5a","Type":"ContainerStarted","Data":"5e6ab3d0b4c4142d2e2e69525bbf54bfa533032947dedbf636ed56eef9e0ee20"} Sep 10 17:44:46.505042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:46.505002 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" event={"ID":"e2e85e83-14ec-4e25-b1a6-2243dc359f5a","Type":"ContainerStarted","Data":"e07928517c9dfbd3142398e24fc469b15571a17bf7888bf7135b2c315d40b237"} Sep 10 17:44:46.519970 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:46.519919 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" podStartSLOduration=1.769931299 podStartE2EDuration="4.519904371s" totalImagesPullingTime="2.749973072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:46.519447346 +0000 UTC m=+83.913896602" watchObservedRunningTime="2026-09-10 17:44:46.519904371 +0000 UTC m=+83.914353653" Sep 10 17:44:59.301236 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:59.301185 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:44:59.301726 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:59.301372 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:44:59.301726 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:59.301389 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:44:59.301726 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:59.301456 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:46:03.301438745 +0000 UTC m=+160.695887987 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:44:59.402417 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:44:59.402381 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:44:59.402594 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:59.402534 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:59.402635 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:44:59.402616 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:46:03.402599803 +0000 UTC m=+160.797049040 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:45:04.477112 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:45:04.477082 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xdckl" Sep 10 17:45:04.652603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:45:04.652571 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:04.713465 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:45:04.713430 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:45:31.922989 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:45:31.922929 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:45:31.923512 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:45:31.923094 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:45:31.923512 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:45:31.923161 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:47:33.923145391 +0000 UTC m=+251.317594624 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : secret "metrics-daemon-secret" not found Sep 10 17:45:58.509706 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:45:58.509650 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" podUID="b6d0fec2-74f7-43f0-b26d-9499f106e54c" Sep 10 17:45:58.536486 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:45:58.536457 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-59p25" podUID="15e5fae2-6ec1-4a98-8e17-d5c7118961c0" Sep 10 17:45:58.675754 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:45:58.675726 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-59p25" Sep 10 17:45:58.675889 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:45:58.675726 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:45:59.127120 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:45:59.127089 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:46:03.332677 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:46:03.332628 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:46:03.333087 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:46:03.332776 2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 17:46:03.333087 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:46:03.332793 2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766b8d745b-k8b4f: secret "image-registry-tls" not found Sep 10 17:46:03.333087 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:46:03.332857 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls podName:b6d0fec2-74f7-43f0-b26d-9499f106e54c nodeName:}" failed. No retries permitted until 2026-09-10 17:48:05.332839874 +0000 UTC m=+282.727289113 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls") pod "image-registry-766b8d745b-k8b4f" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c") : secret "image-registry-tls" not found Sep 10 17:46:03.433609 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:46:03.433567 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:46:03.433782 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:46:03.433680 2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:46:03.433782 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:46:03.433739 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls podName:15e5fae2-6ec1-4a98-8e17-d5c7118961c0 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:05.433726851 +0000 UTC m=+282.828176084 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls") pod "dns-default-59p25" (UID: "15e5fae2-6ec1-4a98-8e17-d5c7118961c0") : secret "dns-default-metrics-tls" not found Sep 10 17:46:12.117783 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:46:12.117735 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:46:46.790506 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:46:46.790465 2588 generic.go:356] "Generic (PLEG): container finished" podID="e2e85e83-14ec-4e25-b1a6-2243dc359f5a" containerID="e07928517c9dfbd3142398e24fc469b15571a17bf7888bf7135b2c315d40b237" exitCode=255 Sep 10 17:46:46.790944 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:46:46.790524 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" event={"ID":"e2e85e83-14ec-4e25-b1a6-2243dc359f5a","Type":"ContainerDied","Data":"e07928517c9dfbd3142398e24fc469b15571a17bf7888bf7135b2c315d40b237"} Sep 10 17:46:46.795986 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:46:46.795966 2588 scope.go:117] "RemoveContainer" containerID="e07928517c9dfbd3142398e24fc469b15571a17bf7888bf7135b2c315d40b237" Sep 10 17:46:47.794950 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:46:47.794919 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6d755f94-6wgzc" event={"ID":"e2e85e83-14ec-4e25-b1a6-2243dc359f5a","Type":"ContainerStarted","Data":"feadc36a38b56fca61757dd1f59fb3e3f668236eca8c219977498bfa8fcaeeb8"} Sep 10 17:47:33.948456 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:33.948422 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:47:33.948932 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:33.948568 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:47:33.948932 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:33.948646 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs podName:aeee428e-a7c2-41dc-b6fe-f24a9a337b9d nodeName:}" failed. No retries permitted until 2026-09-10 17:49:35.948626976 +0000 UTC m=+373.343076209 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs") pod "network-metrics-daemon-qmzql" (UID: "aeee428e-a7c2-41dc-b6fe-f24a9a337b9d") : secret "metrics-daemon-secret" not found Sep 10 17:47:46.870374 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.870269 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2hxgn"] Sep 10 17:47:46.873358 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.873333 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56688c86cd-hhj85"] Sep 10 17:47:46.873515 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.873430 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-2hxgn" Sep 10 17:47:46.875689 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.875668 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nblgd\"" Sep 10 17:47:46.876163 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.876147 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:46.878353 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.878336 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pbgpc\"" Sep 10 17:47:46.878468 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.878451 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 17:47:46.878559 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.878543 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 17:47:46.878888 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.878869 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 17:47:46.879000 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.878897 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 17:47:46.879129 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.879113 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 17:47:46.879167 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.879113 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 17:47:46.882355 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.882334 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2hxgn"] Sep 10 17:47:46.888793 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.888773 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56688c86cd-hhj85"] Sep 10 17:47:46.937860 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.937831 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ksns\" (UniqueName: \"kubernetes.io/projected/5a06f66e-ce1b-46fa-9ff2-c978b950c471-kube-api-access-7ksns\") pod \"network-check-source-685456655f-2hxgn\" (UID: \"5a06f66e-ce1b-46fa-9ff2-c978b950c471\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2hxgn" Sep 10 17:47:46.938022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.937866 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-default-certificate\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:46.938022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.937886 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-stats-auth\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:46.938022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.937938 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:46.938138 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.938027 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsjn7\" (UniqueName: \"kubernetes.io/projected/df815363-cc78-4be5-978e-0d3c9f652093-kube-api-access-dsjn7\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:46.938138 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.938061 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:46.959210 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.959186 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl"] Sep 10 17:47:46.962006 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.961987 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4"] Sep 10 17:47:46.962132 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.962106 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:46.964728 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.964706 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:46.965351 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.965329 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 17:47:46.965462 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.965362 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 17:47:46.965462 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.965361 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 17:47:46.965572 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.965522 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 17:47:46.965628 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.965614 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wf5v2\"" Sep 10 17:47:46.966806 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.966785 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 17:47:46.967046 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.967030 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-f5h5h\"" Sep 10 17:47:46.967363 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.967342 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 17:47:46.967471 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.967389 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:47:46.967637 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.967606 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 17:47:46.971807 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.971786 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4"] Sep 10 17:47:46.972671 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:46.972652 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl"] Sep 10 17:47:47.039127 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039088 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eeb5f6f8-b04c-429c-8585-7a74b36969f4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.039127 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039125 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.039423 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039148 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsjn7\" (UniqueName: \"kubernetes.io/projected/df815363-cc78-4be5-978e-0d3c9f652093-kube-api-access-dsjn7\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.039423 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039167 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdss\" (UniqueName: \"kubernetes.io/projected/72ca04f0-cd13-45cf-aa3d-31ef9675c780-kube-api-access-8mdss\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.039423 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039287 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.039423 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039343 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tvh8\" (UniqueName: \"kubernetes.io/projected/eeb5f6f8-b04c-429c-8585-7a74b36969f4-kube-api-access-7tvh8\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.039423 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.039387 2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:47:47.039423 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039389 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ksns\" (UniqueName: \"kubernetes.io/projected/5a06f66e-ce1b-46fa-9ff2-c978b950c471-kube-api-access-7ksns\") pod \"network-check-source-685456655f-2hxgn\" (UID: \"5a06f66e-ce1b-46fa-9ff2-c978b950c471\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2hxgn" Sep 10 17:47:47.039423 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039418 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-default-certificate\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.039738 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.039442 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:47.539423943 +0000 UTC m=+264.933873182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : secret "router-metrics-certs-default" not found Sep 10 17:47:47.039738 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039461 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-stats-auth\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.039738 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039478 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb5f6f8-b04c-429c-8585-7a74b36969f4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.039738 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039494 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/72ca04f0-cd13-45cf-aa3d-31ef9675c780-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.039738 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.039528 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.039738 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.039642 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:47.53962194 +0000 UTC m=+264.934071176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : configmap references non-existent config key: service-ca.crt Sep 10 17:47:47.041936 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.041915 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-stats-auth\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.042055 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.041949 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-default-certificate\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.048742 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.048716 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsjn7\" (UniqueName: \"kubernetes.io/projected/df815363-cc78-4be5-978e-0d3c9f652093-kube-api-access-dsjn7\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.048742 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.048738 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ksns\" (UniqueName: \"kubernetes.io/projected/5a06f66e-ce1b-46fa-9ff2-c978b950c471-kube-api-access-7ksns\") pod \"network-check-source-685456655f-2hxgn\" (UID: \"5a06f66e-ce1b-46fa-9ff2-c978b950c471\") " pod="openshift-network-diagnostics/network-check-source-685456655f-2hxgn" Sep 10 17:47:47.110021 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.109987 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:47.140554 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.140478 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eeb5f6f8-b04c-429c-8585-7a74b36969f4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.140554 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.140510 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.140554 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.140535 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdss\" (UniqueName: \"kubernetes.io/projected/72ca04f0-cd13-45cf-aa3d-31ef9675c780-kube-api-access-8mdss\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.140802 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.140579 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tvh8\" (UniqueName: \"kubernetes.io/projected/eeb5f6f8-b04c-429c-8585-7a74b36969f4-kube-api-access-7tvh8\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.140802 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.140634 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb5f6f8-b04c-429c-8585-7a74b36969f4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.140802 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.140648 2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:47.140802 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.140659 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/72ca04f0-cd13-45cf-aa3d-31ef9675c780-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.140802 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.140720 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls podName:72ca04f0-cd13-45cf-aa3d-31ef9675c780 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:47.640701066 +0000 UTC m=+265.035150312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-qlqkl" (UID: "72ca04f0-cd13-45cf-aa3d-31ef9675c780") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:47.141081 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.141061 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eeb5f6f8-b04c-429c-8585-7a74b36969f4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.141351 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.141334 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/72ca04f0-cd13-45cf-aa3d-31ef9675c780-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.142841 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.142820 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb5f6f8-b04c-429c-8585-7a74b36969f4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.149018 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.148993 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdss\" (UniqueName: \"kubernetes.io/projected/72ca04f0-cd13-45cf-aa3d-31ef9675c780-kube-api-access-8mdss\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.149106 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.149045 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tvh8\" (UniqueName: \"kubernetes.io/projected/eeb5f6f8-b04c-429c-8585-7a74b36969f4-kube-api-access-7tvh8\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qq5r4\" (UID: \"eeb5f6f8-b04c-429c-8585-7a74b36969f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.184129 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.184082 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-2hxgn" Sep 10 17:47:47.199744 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.199716 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:47.278015 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.277973 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" Sep 10 17:47:47.452288 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.452094 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-2hxgn"] Sep 10 17:47:47.454712 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:47:47.454686 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a06f66e_ce1b_46fa_9ff2_c978b950c471.slice/crio-eff464e7b4a34c579ea3357d0467b834992d27356d50376048470326ff33699b WatchSource:0}: Error finding container eff464e7b4a34c579ea3357d0467b834992d27356d50376048470326ff33699b: Status 404 returned error can't find the container with id eff464e7b4a34c579ea3357d0467b834992d27356d50376048470326ff33699b Sep 10 17:47:47.543966 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.543935 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.544124 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.543992 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:47.544124 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.544106 2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:47:47.544229 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.544119 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:48.544103635 +0000 UTC m=+265.938552872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : configmap references non-existent config key: service-ca.crt Sep 10 17:47:47.544229 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.544181 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:48.544163673 +0000 UTC m=+265.938612921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : secret "router-metrics-certs-default" not found Sep 10 17:47:47.546322 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.546264 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4"] Sep 10 17:47:47.549525 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:47:47.549502 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb5f6f8_b04c_429c_8585_7a74b36969f4.slice/crio-1ea09a6e119bcbc366bbc6837cca4738699a5b56b1138e338d240bac0919c072 WatchSource:0}: Error finding container 1ea09a6e119bcbc366bbc6837cca4738699a5b56b1138e338d240bac0919c072: Status 404 returned error can't find the container with id 1ea09a6e119bcbc366bbc6837cca4738699a5b56b1138e338d240bac0919c072 Sep 10 17:47:47.645146 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.645103 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:47.645344 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.645249 2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:47.645344 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:47.645339 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls podName:72ca04f0-cd13-45cf-aa3d-31ef9675c780 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:48.64530069 +0000 UTC m=+266.039749924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-qlqkl" (UID: "72ca04f0-cd13-45cf-aa3d-31ef9675c780") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:47.964396 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.964362 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" event={"ID":"eeb5f6f8-b04c-429c-8585-7a74b36969f4","Type":"ContainerStarted","Data":"1ea09a6e119bcbc366bbc6837cca4738699a5b56b1138e338d240bac0919c072"} Sep 10 17:47:47.965838 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.965809 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-2hxgn" event={"ID":"5a06f66e-ce1b-46fa-9ff2-c978b950c471","Type":"ContainerStarted","Data":"9ae003f14fd5f0ed33c574a89e074f5000d2eefa55ce4283917fb56270b71259"} Sep 10 17:47:47.965932 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.965856 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-2hxgn" event={"ID":"5a06f66e-ce1b-46fa-9ff2-c978b950c471","Type":"ContainerStarted","Data":"eff464e7b4a34c579ea3357d0467b834992d27356d50376048470326ff33699b"} Sep 10 17:47:47.981238 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:47.981183 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-2hxgn" podStartSLOduration=1.981167474 podStartE2EDuration="1.981167474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:47.979989242 +0000 UTC m=+265.374438497" watchObservedRunningTime="2026-09-10 17:47:47.981167474 +0000 UTC m=+265.375616729" Sep 10 17:47:48.552964 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:48.552925 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:48.553123 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:48.553005 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:48.553123 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:48.553085 2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:47:48.553192 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:48.553148 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:50.553131613 +0000 UTC m=+267.947580852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : secret "router-metrics-certs-default" not found Sep 10 17:47:48.553192 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:48.553163 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:50.55315624 +0000 UTC m=+267.947605473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : configmap references non-existent config key: service-ca.crt Sep 10 17:47:48.653778 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:48.653732 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:48.653969 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:48.653883 2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:48.653969 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:48.653950 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls podName:72ca04f0-cd13-45cf-aa3d-31ef9675c780 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:50.653934003 +0000 UTC m=+268.048383236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-qlqkl" (UID: "72ca04f0-cd13-45cf-aa3d-31ef9675c780") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:49.438847 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:49.438817 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:49.491672 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:49.491630 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:49.974298 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:49.974260 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" event={"ID":"eeb5f6f8-b04c-429c-8585-7a74b36969f4","Type":"ContainerStarted","Data":"ebb65d8d598108c898cd5034c00eceff3b1f71169a65a54be36a176f3449897a"} Sep 10 17:47:49.989399 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:49.989353 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" podStartSLOduration=2.177562512 podStartE2EDuration="3.989337625s" totalImagesPullingTime="1.811775113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:49.988808117 +0000 UTC m=+267.383257372" watchObservedRunningTime="2026-09-10 17:47:49.989337625 +0000 UTC m=+267.383786874" Sep 10 17:47:50.570754 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:50.570717 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:50.571125 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:50.570822 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:50.571125 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:50.570891 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:54.570871475 +0000 UTC m=+271.965320720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : configmap references non-existent config key: service-ca.crt Sep 10 17:47:50.571125 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:50.570966 2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:47:50.571125 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:50.571023 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:54.571009758 +0000 UTC m=+271.965458997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : secret "router-metrics-certs-default" not found Sep 10 17:47:50.672056 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:50.672013 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:50.672209 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:50.672163 2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:50.672249 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:50.672230 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls podName:72ca04f0-cd13-45cf-aa3d-31ef9675c780 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:54.672213405 +0000 UTC m=+272.066662638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-qlqkl" (UID: "72ca04f0-cd13-45cf-aa3d-31ef9675c780") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:50.806598 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:50.806563 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:50.913531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:50.913440 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:51.732087 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.732046 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p4ssb"] Sep 10 17:47:51.735440 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.735413 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.737683 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.737659 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 17:47:51.737793 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.737679 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 17:47:51.737793 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.737700 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqhnl\"" Sep 10 17:47:51.737793 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.737769 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 17:47:51.738079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.738063 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 17:47:51.744754 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.744732 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p4ssb"] Sep 10 17:47:51.745547 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.745524 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:51.835502 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.835469 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:51.881005 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.880974 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3b6438c-5b70-4936-99f2-cf1a6ea84920-data-volume\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.881145 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.881032 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3b6438c-5b70-4936-99f2-cf1a6ea84920-crio-socket\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.881145 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.881111 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxcs\" (UniqueName: \"kubernetes.io/projected/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-api-access-tkxcs\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.881145 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.881139 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.881269 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.881171 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.894116 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.894090 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:51.982437 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.982354 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3b6438c-5b70-4936-99f2-cf1a6ea84920-data-volume\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.982437 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.982404 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3b6438c-5b70-4936-99f2-cf1a6ea84920-crio-socket\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.982621 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.982444 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxcs\" (UniqueName: \"kubernetes.io/projected/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-api-access-tkxcs\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.982621 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.982465 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.982621 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.982494 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.982621 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.982552 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3b6438c-5b70-4936-99f2-cf1a6ea84920-crio-socket\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.982621 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:51.982571 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:51.982621 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:51.982599 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:51.982836 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:51.982636 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:52.482616889 +0000 UTC m=+269.877066135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : configmap "kube-rbac-proxy" not found Sep 10 17:47:51.982836 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:51.982650 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:52.482644296 +0000 UTC m=+269.877093528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:51.982836 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.982780 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3b6438c-5b70-4936-99f2-cf1a6ea84920-data-volume\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.990590 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.990562 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxcs\" (UniqueName: \"kubernetes.io/projected/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-api-access-tkxcs\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:51.995519 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:51.995493 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:52.096597 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:52.096554 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:52.486112 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:52.486082 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:52.486255 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:52.486132 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:52.486255 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:52.486230 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:52.486370 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:52.486268 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:52.486370 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:52.486299 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:53.486283055 +0000 UTC m=+270.880732287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:52.486370 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:52.486343 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:53.486306873 +0000 UTC m=+270.880756111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : configmap "kube-rbac-proxy" not found Sep 10 17:47:52.649488 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:52.649455 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:52.751472 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:52.751404 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:53.495390 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:53.495350 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:53.495567 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:53.495417 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:53.495567 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:53.495509 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:53.495567 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:53.495526 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:53.495677 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:53.495575 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:55.495558713 +0000 UTC m=+272.890007961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:53.495677 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:53.495593 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:55.495585844 +0000 UTC m=+272.890035077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : configmap "kube-rbac-proxy" not found Sep 10 17:47:53.793353 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:53.793259 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:53.893910 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:53.893862 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:53.894581 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:53.894564 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n6zbr_61acebda-4243-4f37-b852-1584bbe917bc/dns-node-resolver/0.log" Sep 10 17:47:54.249727 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.249692 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-jn424"] Sep 10 17:47:54.252881 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.252865 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.255490 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.255466 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 17:47:54.255626 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.255545 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 17:47:54.255954 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.255940 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 17:47:54.256020 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.255977 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 17:47:54.256058 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.256047 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-q9bc2\"" Sep 10 17:47:54.261681 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.261659 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-jn424"] Sep 10 17:47:54.283215 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.283186 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:54.403510 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.403478 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dfd80091-c428-4add-b903-1a6312647216-signing-key\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.403510 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.403510 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dfd80091-c428-4add-b903-1a6312647216-signing-cabundle\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.403721 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.403527 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc6nc\" (UniqueName: \"kubernetes.io/projected/dfd80091-c428-4add-b903-1a6312647216-kube-api-access-tc6nc\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.468233 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.468197 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:54.503942 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.503853 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dfd80091-c428-4add-b903-1a6312647216-signing-key\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.503942 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.503892 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dfd80091-c428-4add-b903-1a6312647216-signing-cabundle\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.503942 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.503920 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc6nc\" (UniqueName: \"kubernetes.io/projected/dfd80091-c428-4add-b903-1a6312647216-kube-api-access-tc6nc\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.504621 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.504599 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dfd80091-c428-4add-b903-1a6312647216-signing-cabundle\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.506362 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.506337 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dfd80091-c428-4add-b903-1a6312647216-signing-key\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.513263 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.513240 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc6nc\" (UniqueName: \"kubernetes.io/projected/dfd80091-c428-4add-b903-1a6312647216-kube-api-access-tc6nc\") pod \"service-ca-75d99c484-jn424\" (UID: \"dfd80091-c428-4add-b903-1a6312647216\") " pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.562258 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.562226 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-jn424" Sep 10 17:47:54.568941 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.568911 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:54.605095 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.605055 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:54.605274 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.605224 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:47:54.605274 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:54.605225 2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 17:47:54.605399 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:54.605324 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:02.605295232 +0000 UTC m=+279.999744470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : secret "router-metrics-certs-default" not found Sep 10 17:47:54.605462 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:54.605402 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:02.605388682 +0000 UTC m=+279.999837919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : configmap references non-existent config key: service-ca.crt Sep 10 17:47:54.706119 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.706080 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:47:54.706264 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:54.706235 2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:54.706370 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:54.706300 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls podName:72ca04f0-cd13-45cf-aa3d-31ef9675c780 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:02.706286144 +0000 UTC m=+280.100735382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-qlqkl" (UID: "72ca04f0-cd13-45cf-aa3d-31ef9675c780") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:47:54.832017 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.831937 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-jn424"] Sep 10 17:47:54.834742 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:47:54.834716 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd80091_c428_4add_b903_1a6312647216.slice/crio-ddd1a8037801cce4d244dff139e94680aff908bfe257d61e477b50c5cdc44504 WatchSource:0}: Error finding container ddd1a8037801cce4d244dff139e94680aff908bfe257d61e477b50c5cdc44504: Status 404 returned error can't find the container with id ddd1a8037801cce4d244dff139e94680aff908bfe257d61e477b50c5cdc44504 Sep 10 17:47:54.895798 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.895776 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tt7rv_bed09fa0-af01-4f59-91e0-a6c7c7d9ff07/node-ca/0.log" Sep 10 17:47:54.988790 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:54.988759 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-jn424" event={"ID":"dfd80091-c428-4add-b903-1a6312647216","Type":"ContainerStarted","Data":"ddd1a8037801cce4d244dff139e94680aff908bfe257d61e477b50c5cdc44504"} Sep 10 17:47:55.188406 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:55.188300 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:55.296584 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:55.296555 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2gmwm_3f5fe123-739a-4e69-a7b2-33312d784386/serve-healthcheck-canary/0.log" Sep 10 17:47:55.512924 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:55.512886 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:55.513120 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:55.512957 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:55.513120 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:55.513058 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:55.513120 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:55.513064 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:55.513275 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:55.513127 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:59.513107393 +0000 UTC m=+276.907556641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : configmap "kube-rbac-proxy" not found Sep 10 17:47:55.513275 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:55.513145 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:59.51313709 +0000 UTC m=+276.907586323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:56.995351 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:56.995294 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-jn424" event={"ID":"dfd80091-c428-4add-b903-1a6312647216","Type":"ContainerStarted","Data":"546714d9e5617bd4ebace80ee1ccfd9ce6ab82d005da03bd0b3d3f5db1216ab2"} Sep 10 17:47:57.011331 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:57.011265 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-jn424" podStartSLOduration=0.997754319 podStartE2EDuration="3.011249465s" totalImagesPullingTime="2.013495146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:57.009875441 +0000 UTC m=+274.404324696" watchObservedRunningTime="2026-09-10 17:47:57.011249465 +0000 UTC m=+274.405698720" Sep 10 17:47:57.794535 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:57.794501 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:58.391896 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:58.391336 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:58.599735 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:58.599695 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:58.700573 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:58.700481 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:58.801876 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:58.801801 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:58.910943 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:58.910906 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:59.091967 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:59.091929 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:47:59.552910 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:59.552858 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:59.553272 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:59.552928 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:47:59.553272 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:59.552999 2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:59.553272 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:59.553012 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:59.553272 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:59.553065 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:07.553050062 +0000 UTC m=+284.947499295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : configmap "kube-rbac-proxy" not found Sep 10 17:47:59.553272 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:47:59.553081 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:07.553074212 +0000 UTC m=+284.947523445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:59.867632 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:47:59.867540 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:00.468940 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:00.468903 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:00.666328 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:00.666282 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:01.067547 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:01.067508 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:01.271133 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:01.271087 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:01.372039 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:01.371955 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:01.471564 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:01.471530 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:01.676742 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:01.676639 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" podUID="b6d0fec2-74f7-43f0-b26d-9499f106e54c" Sep 10 17:48:01.676742 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:01.676639 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-59p25" podUID="15e5fae2-6ec1-4a98-8e17-d5c7118961c0" Sep 10 17:48:02.010380 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.010348 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-59p25" Sep 10 17:48:02.010544 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.010352 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:48:02.237870 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.237833 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:02.296650 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.296569 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:02.664673 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.664584 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:02.678547 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.678522 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:02.678858 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.678586 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:02.678858 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:02.678695 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle podName:df815363-cc78-4be5-978e-0d3c9f652093 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:18.678682088 +0000 UTC m=+296.073131325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle") pod "router-default-56688c86cd-hhj85" (UID: "df815363-cc78-4be5-978e-0d3c9f652093") : configmap references non-existent config key: service-ca.crt Sep 10 17:48:02.680912 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.680895 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df815363-cc78-4be5-978e-0d3c9f652093-metrics-certs\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:02.779722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:02.779682 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:48:02.779862 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:02.779834 2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 17:48:02.779920 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:02.779898 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls podName:72ca04f0-cd13-45cf-aa3d-31ef9675c780 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:18.779879864 +0000 UTC m=+296.174329112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-qlqkl" (UID: "72ca04f0-cd13-45cf-aa3d-31ef9675c780") : secret "cluster-monitoring-operator-tls" not found Sep 10 17:48:03.065104 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:03.065073 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:03.266282 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:03.266251 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:03.664900 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:03.664852 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:03.989913 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:03.989882 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:04.267520 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:04.267435 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:04.845540 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:04.845507 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:04.907544 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:04.907505 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:05.066097 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.066055 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:05.263246 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.263215 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:05.402204 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.402166 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:48:05.404715 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.404685 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"image-registry-766b8d745b-k8b4f\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:48:05.502526 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.502482 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:48:05.504902 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.504862 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e5fae2-6ec1-4a98-8e17-d5c7118961c0-metrics-tls\") pod \"dns-default-59p25\" (UID: \"15e5fae2-6ec1-4a98-8e17-d5c7118961c0\") " pod="openshift-dns/dns-default-59p25" Sep 10 17:48:05.614345 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.614233 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsfqd\"" Sep 10 17:48:05.614345 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.614233 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f22bv\"" Sep 10 17:48:05.622142 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.622107 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-59p25" Sep 10 17:48:05.622257 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.622241 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:48:05.746228 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.746193 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:05.912360 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.912337 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-766b8d745b-k8b4f"] Sep 10 17:48:05.914798 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:05.914764 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d0fec2_74f7_43f0_b26d_9499f106e54c.slice/crio-e547700090b99e2807ef0910db331320db008a49f6d16f56768764649d644fe2 WatchSource:0}: Error finding container e547700090b99e2807ef0910db331320db008a49f6d16f56768764649d644fe2: Status 404 returned error can't find the container with id e547700090b99e2807ef0910db331320db008a49f6d16f56768764649d644fe2 Sep 10 17:48:05.927465 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:05.927441 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-59p25"] Sep 10 17:48:05.930087 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:05.930062 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e5fae2_6ec1_4a98_8e17_d5c7118961c0.slice/crio-b104a1a6f48e5c2cce05f77fe093b8f59273b3feb036a11b6f0221e0fdb70af6 WatchSource:0}: Error finding container b104a1a6f48e5c2cce05f77fe093b8f59273b3feb036a11b6f0221e0fdb70af6: Status 404 returned error can't find the container with id b104a1a6f48e5c2cce05f77fe093b8f59273b3feb036a11b6f0221e0fdb70af6 Sep 10 17:48:06.023965 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:06.023929 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" event={"ID":"b6d0fec2-74f7-43f0-b26d-9499f106e54c","Type":"ContainerStarted","Data":"914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2"} Sep 10 17:48:06.024118 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:06.023978 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" event={"ID":"b6d0fec2-74f7-43f0-b26d-9499f106e54c","Type":"ContainerStarted","Data":"e547700090b99e2807ef0910db331320db008a49f6d16f56768764649d644fe2"} Sep 10 17:48:06.024118 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:06.024061 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:48:06.025218 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:06.025194 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-59p25" event={"ID":"15e5fae2-6ec1-4a98-8e17-d5c7118961c0","Type":"ContainerStarted","Data":"b104a1a6f48e5c2cce05f77fe093b8f59273b3feb036a11b6f0221e0fdb70af6"} Sep 10 17:48:06.045733 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:06.045683 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" podStartSLOduration=283.045662677 podStartE2EDuration="4m43.045662677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:06.044532245 +0000 UTC m=+283.438981504" watchObservedRunningTime="2026-09-10 17:48:06.045662677 +0000 UTC m=+283.440111931" Sep 10 17:48:06.065930 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:06.065889 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:06.676678 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:06.676641 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:07.268548 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:07.268513 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:07.462890 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:07.462834 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:07.621459 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:07.621436 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:48:07.621608 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:07.621480 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:48:07.621608 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:07.621578 2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:48:07.621712 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:07.621643 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls podName:a3b6438c-5b70-4936-99f2-cf1a6ea84920 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:23.621628141 +0000 UTC m=+301.016077378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4ssb" (UID: "a3b6438c-5b70-4936-99f2-cf1a6ea84920") : secret "insights-runtime-extractor-tls" not found Sep 10 17:48:07.621981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:07.621960 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3b6438c-5b70-4936-99f2-cf1a6ea84920-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:48:07.666621 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:07.666582 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:07.870999 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:07.870915 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:08.032947 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:08.032915 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-59p25" event={"ID":"15e5fae2-6ec1-4a98-8e17-d5c7118961c0","Type":"ContainerStarted","Data":"2e6ea4f08fcc73e557944083b1581f3b23d4c3b1dcada48bd90b6cd50a3d946b"} Sep 10 17:48:08.033094 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:08.032965 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-59p25" event={"ID":"15e5fae2-6ec1-4a98-8e17-d5c7118961c0","Type":"ContainerStarted","Data":"c293619707e795b31f2804db0060227590969f817972d7e1c55e8cf2eea6bdc9"} Sep 10 17:48:08.033094 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:08.033041 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-59p25" Sep 10 17:48:08.052750 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:08.052697 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-59p25" podStartSLOduration=251.548696125 podStartE2EDuration="4m13.052680595s" totalImagesPullingTime="1.50398447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:08.051145669 +0000 UTC m=+285.445594924" watchObservedRunningTime="2026-09-10 17:48:08.052680595 +0000 UTC m=+285.447129852" Sep 10 17:48:08.665940 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:08.665896 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:08.866195 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:08.866145 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:09.065940 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:09.065906 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:11.346038 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:11.346007 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:11.408008 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:11.407972 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:13.332192 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:13.332158 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-766b8d745b-k8b4f"] Sep 10 17:48:13.487616 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:13.487585 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:13.566664 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:13.566628 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:15.118210 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:15.118167 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qmzql" podUID="aeee428e-a7c2-41dc-b6fe-f24a9a337b9d" Sep 10 17:48:18.039328 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:18.039284 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-59p25" Sep 10 17:48:18.713597 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:18.713549 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:18.714169 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:18.714146 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df815363-cc78-4be5-978e-0d3c9f652093-service-ca-bundle\") pod \"router-default-56688c86cd-hhj85\" (UID: \"df815363-cc78-4be5-978e-0d3c9f652093\") " pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:18.814201 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:18.814163 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:48:18.816486 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:18.816458 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/72ca04f0-cd13-45cf-aa3d-31ef9675c780-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-qlqkl\" (UID: \"72ca04f0-cd13-45cf-aa3d-31ef9675c780\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:48:18.989588 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:18.989551 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:19.072361 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:19.072287 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" Sep 10 17:48:19.301181 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:19.301158 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56688c86cd-hhj85"] Sep 10 17:48:19.303133 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:19.303110 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf815363_cc78_4be5_978e_0d3c9f652093.slice/crio-63bfc5e5e2832ca72b0edd12f317a29c3d662cbf769adb9b04dd2938e2700f1e WatchSource:0}: Error finding container 63bfc5e5e2832ca72b0edd12f317a29c3d662cbf769adb9b04dd2938e2700f1e: Status 404 returned error can't find the container with id 63bfc5e5e2832ca72b0edd12f317a29c3d662cbf769adb9b04dd2938e2700f1e Sep 10 17:48:19.355962 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:19.355930 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl"] Sep 10 17:48:19.359345 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:19.359305 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ca04f0_cd13_45cf_aa3d_31ef9675c780.slice/crio-2677e00d5428dfb7b539147d6613523600dc2a1bd8b0c99a076802abb15da7db WatchSource:0}: Error finding container 2677e00d5428dfb7b539147d6613523600dc2a1bd8b0c99a076802abb15da7db: Status 404 returned error can't find the container with id 2677e00d5428dfb7b539147d6613523600dc2a1bd8b0c99a076802abb15da7db Sep 10 17:48:20.071037 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:20.070993 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" event={"ID":"72ca04f0-cd13-45cf-aa3d-31ef9675c780","Type":"ContainerStarted","Data":"2677e00d5428dfb7b539147d6613523600dc2a1bd8b0c99a076802abb15da7db"} Sep 10 17:48:20.072896 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:20.072860 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56688c86cd-hhj85" event={"ID":"df815363-cc78-4be5-978e-0d3c9f652093","Type":"ContainerStarted","Data":"1d000a8fd27b9863cea0756fd2f7ded4fd260db0f7a3e596a74f5ca9a1845f9d"} Sep 10 17:48:20.073335 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:20.072918 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56688c86cd-hhj85" event={"ID":"df815363-cc78-4be5-978e-0d3c9f652093","Type":"ContainerStarted","Data":"63bfc5e5e2832ca72b0edd12f317a29c3d662cbf769adb9b04dd2938e2700f1e"} Sep 10 17:48:20.093880 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:20.093822 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56688c86cd-hhj85" podStartSLOduration=34.093802532 podStartE2EDuration="34.093802532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:20.092745977 +0000 UTC m=+297.487195238" watchObservedRunningTime="2026-09-10 17:48:20.093802532 +0000 UTC m=+297.488251788" Sep 10 17:48:20.989974 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:20.989932 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:20.993181 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:20.993156 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:21.076215 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:21.076178 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:21.077429 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:21.077404 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56688c86cd-hhj85" Sep 10 17:48:21.403065 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:21.402976 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:22.080045 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:22.080014 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" event={"ID":"72ca04f0-cd13-45cf-aa3d-31ef9675c780","Type":"ContainerStarted","Data":"8d162662c0f1e7afd5004ee7c048d60a8c47a1c0f0bc77adad4f4a3001fe51e6"} Sep 10 17:48:22.096178 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:22.096128 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-qlqkl" podStartSLOduration=34.36985399 podStartE2EDuration="36.096111016s" totalImagesPullingTime="1.726257026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:22.095644383 +0000 UTC m=+299.490093649" watchObservedRunningTime="2026-09-10 17:48:22.096111016 +0000 UTC m=+299.490560321" Sep 10 17:48:22.476636 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:22.476540 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:23.027886 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:23.027858 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:48:23.031548 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:23.031528 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:48:23.032253 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:23.032235 2588 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 17:48:23.338697 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:23.338620 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:48:23.653196 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:23.653118 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:48:23.655297 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:23.655279 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3b6438c-5b70-4936-99f2-cf1a6ea84920-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4ssb\" (UID: \"a3b6438c-5b70-4936-99f2-cf1a6ea84920\") " pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:48:23.846362 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:23.846304 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqhnl\"" Sep 10 17:48:23.854153 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:23.854128 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p4ssb" Sep 10 17:48:24.121132 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:24.121101 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p4ssb"] Sep 10 17:48:24.123894 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:24.123866 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b6438c_5b70_4936_99f2_cf1a6ea84920.slice/crio-71b435811c1e730d3a9c7c3f9a49cfb350c12bdfa58cf2ab8bc3d4ea19364132 WatchSource:0}: Error finding container 71b435811c1e730d3a9c7c3f9a49cfb350c12bdfa58cf2ab8bc3d4ea19364132: Status 404 returned error can't find the container with id 71b435811c1e730d3a9c7c3f9a49cfb350c12bdfa58cf2ab8bc3d4ea19364132 Sep 10 17:48:24.176492 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:24.176470 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:48:25.089448 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:25.089414 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4ssb" event={"ID":"a3b6438c-5b70-4936-99f2-cf1a6ea84920","Type":"ContainerStarted","Data":"c1331cc86a550a76b6ca04dcef8008d1053f5d69e52e1119faad539a0ea08dd8"} Sep 10 17:48:25.089812 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:25.089467 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4ssb" event={"ID":"a3b6438c-5b70-4936-99f2-cf1a6ea84920","Type":"ContainerStarted","Data":"fa06fe081850d0e4324763376dc54bca0638169f9d6ffab2154356a87ca06ce5"} Sep 10 17:48:25.089812 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:25.089487 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4ssb" event={"ID":"a3b6438c-5b70-4936-99f2-cf1a6ea84920","Type":"ContainerStarted","Data":"71b435811c1e730d3a9c7c3f9a49cfb350c12bdfa58cf2ab8bc3d4ea19364132"} Sep 10 17:48:25.566379 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:25.566269 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:25.643705 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:25.643659 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:25.697170 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:25.697132 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:26.213356 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:26.213304 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:27.098490 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:27.098453 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4ssb" event={"ID":"a3b6438c-5b70-4936-99f2-cf1a6ea84920","Type":"ContainerStarted","Data":"93e57de7e8e44a95754cdd5659ab68fb32e3e087e701657e6c33dfba05c10454"} Sep 10 17:48:27.116187 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:27.116138 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p4ssb" podStartSLOduration=33.988869616 podStartE2EDuration="36.116122903s" totalImagesPullingTime="2.127253287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:47:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:27.114626873 +0000 UTC m=+304.509076127" watchObservedRunningTime="2026-09-10 17:48:27.116122903 +0000 UTC m=+304.510572170" Sep 10 17:48:28.529690 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:28.529659 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:28.876461 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:28.876373 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:28.976268 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:28.976236 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:29.116999 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.116970 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:48:29.721277 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.721238 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:29.907774 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.907737 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:29.979417 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.979382 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c"] Sep 10 17:48:29.982737 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.982713 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zlfpv"] Sep 10 17:48:29.982870 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.982847 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:29.985802 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.985783 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:29.986604 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.986578 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 17:48:29.986823 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.986606 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 17:48:29.986930 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.986604 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7mlks\"" Sep 10 17:48:29.986930 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.986622 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 17:48:29.986930 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.986638 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 17:48:29.988087 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.988065 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bc95g\"" Sep 10 17:48:29.988192 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.988139 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 17:48:29.988619 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.988602 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 17:48:29.988711 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.988606 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 17:48:29.996837 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:29.996814 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c"] Sep 10 17:48:30.010662 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.010636 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:30.090718 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.090668 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:30.101565 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101535 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d666l\" (UniqueName: \"kubernetes.io/projected/00fda959-60ce-40fa-936a-214e1ba67894-kube-api-access-d666l\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.101708 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101575 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-sys\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.101708 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101605 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqlw\" (UniqueName: \"kubernetes.io/projected/a1e1374d-d186-4296-a5fb-e0a36e78d001-kube-api-access-vvqlw\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.101841 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101712 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-root\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.101841 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101752 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.101841 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101787 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.101841 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101821 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.102001 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101880 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-tls\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.102001 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101931 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.102001 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.101963 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-wtmp\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.102112 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.102036 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00fda959-60ce-40fa-936a-214e1ba67894-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.102112 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.102073 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-textfile\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.102112 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.102103 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.102223 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.102127 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/00fda959-60ce-40fa-936a-214e1ba67894-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.102223 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.102154 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1e1374d-d186-4296-a5fb-e0a36e78d001-metrics-client-ca\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.188549 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.188495 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:30.203511 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203473 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203679 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203514 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-tls\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203679 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203568 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.203679 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203592 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-wtmp\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203679 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203631 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00fda959-60ce-40fa-936a-214e1ba67894-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.203679 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203655 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-textfile\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203681 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203704 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/00fda959-60ce-40fa-936a-214e1ba67894-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203734 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1e1374d-d186-4296-a5fb-e0a36e78d001-metrics-client-ca\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203775 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d666l\" (UniqueName: \"kubernetes.io/projected/00fda959-60ce-40fa-936a-214e1ba67894-kube-api-access-d666l\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203806 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-sys\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203835 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqlw\" (UniqueName: \"kubernetes.io/projected/a1e1374d-d186-4296-a5fb-e0a36e78d001-kube-api-access-vvqlw\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203862 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-root\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203891 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.203935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.203925 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.204433 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.204027 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-textfile\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.204433 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.204124 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.204433 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.204246 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-wtmp\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.204590 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.204569 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-sys\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.204651 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.204622 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1e1374d-d186-4296-a5fb-e0a36e78d001-root\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.204651 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.204625 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/00fda959-60ce-40fa-936a-214e1ba67894-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.204755 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.204710 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.204923 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.204894 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1e1374d-d186-4296-a5fb-e0a36e78d001-metrics-client-ca\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.205540 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.205519 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00fda959-60ce-40fa-936a-214e1ba67894-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.207625 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.207599 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-tls\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.207625 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.207611 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1e1374d-d186-4296-a5fb-e0a36e78d001-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.207940 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.207918 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.208098 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.208082 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00fda959-60ce-40fa-936a-214e1ba67894-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.213015 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.212992 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqlw\" (UniqueName: \"kubernetes.io/projected/a1e1374d-d186-4296-a5fb-e0a36e78d001-kube-api-access-vvqlw\") pod \"node-exporter-zlfpv\" (UID: \"a1e1374d-d186-4296-a5fb-e0a36e78d001\") " pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.213454 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.213433 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d666l\" (UniqueName: \"kubernetes.io/projected/00fda959-60ce-40fa-936a-214e1ba67894-kube-api-access-d666l\") pod \"kube-state-metrics-74cb57df7-qhv4c\" (UID: \"00fda959-60ce-40fa-936a-214e1ba67894\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.286848 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.286759 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:30.295704 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.295676 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" Sep 10 17:48:30.302021 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.302005 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlfpv" Sep 10 17:48:30.313663 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:30.313636 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e1374d_d186_4296_a5fb_e0a36e78d001.slice/crio-f490b348e7a3ccecf458b4e1f790f59f797376d8f655f403a84e0f2fb3a431b5 WatchSource:0}: Error finding container f490b348e7a3ccecf458b4e1f790f59f797376d8f655f403a84e0f2fb3a431b5: Status 404 returned error can't find the container with id f490b348e7a3ccecf458b4e1f790f59f797376d8f655f403a84e0f2fb3a431b5 Sep 10 17:48:30.388389 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.388356 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:30.572043 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.572021 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c"] Sep 10 17:48:30.574486 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:30.574457 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fda959_60ce_40fa_936a_214e1ba67894.slice/crio-810c64bea2e49e12f5f598c6defa5232e4e257f4f499d8c6c05ab9099ca1084f WatchSource:0}: Error finding container 810c64bea2e49e12f5f598c6defa5232e4e257f4f499d8c6c05ab9099ca1084f: Status 404 returned error can't find the container with id 810c64bea2e49e12f5f598c6defa5232e4e257f4f499d8c6c05ab9099ca1084f Sep 10 17:48:30.630541 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.630511 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:30.951246 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:30.951155 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:31.025085 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:31.025051 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:31.112661 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:31.112620 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" event={"ID":"00fda959-60ce-40fa-936a-214e1ba67894","Type":"ContainerStarted","Data":"810c64bea2e49e12f5f598c6defa5232e4e257f4f499d8c6c05ab9099ca1084f"} Sep 10 17:48:31.114008 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:31.113980 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlfpv" event={"ID":"a1e1374d-d186-4296-a5fb-e0a36e78d001","Type":"ContainerStarted","Data":"f490b348e7a3ccecf458b4e1f790f59f797376d8f655f403a84e0f2fb3a431b5"} Sep 10 17:48:31.154657 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:31.154541 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:32.122076 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:32.122017 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" event={"ID":"00fda959-60ce-40fa-936a-214e1ba67894","Type":"ContainerStarted","Data":"7941f8a49fd32ab26eb98c4511486583fb309bacab94dd9b318b9e4e60cfac4b"} Sep 10 17:48:32.122598 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:32.122085 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" event={"ID":"00fda959-60ce-40fa-936a-214e1ba67894","Type":"ContainerStarted","Data":"7a52797039913dbff77fe0158dc71e94d161361295f447f73fc91097dd49fe45"} Sep 10 17:48:32.124026 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:32.123998 2588 generic.go:356] "Generic (PLEG): container finished" podID="a1e1374d-d186-4296-a5fb-e0a36e78d001" containerID="15b8f2a30798cb7068cc3a68cd00307e3ebe8153b394f811be52680711c4f201" exitCode=0 Sep 10 17:48:32.124361 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:32.124280 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlfpv" event={"ID":"a1e1374d-d186-4296-a5fb-e0a36e78d001","Type":"ContainerDied","Data":"15b8f2a30798cb7068cc3a68cd00307e3ebe8153b394f811be52680711c4f201"} Sep 10 17:48:32.923006 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:32.922973 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:33.005041 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.004996 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:33.135820 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.135752 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlfpv" event={"ID":"a1e1374d-d186-4296-a5fb-e0a36e78d001","Type":"ContainerStarted","Data":"0919596ff6369ef122669c16d1c5d22297312ad0da976b8ba1dd2614a57c8be3"} Sep 10 17:48:33.136273 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.136088 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlfpv" event={"ID":"a1e1374d-d186-4296-a5fb-e0a36e78d001","Type":"ContainerStarted","Data":"7127e693d80ad9e9123f46d3ee795854d49ba829e08f962ad0eb65258d6b92dd"} Sep 10 17:48:33.138078 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.138041 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" event={"ID":"00fda959-60ce-40fa-936a-214e1ba67894","Type":"ContainerStarted","Data":"ebd6dc0a38a073a61944d51871c37fe74b1cb00593f2674d3b03803bb5712b89"} Sep 10 17:48:33.154971 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.154918 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zlfpv" podStartSLOduration=2.876636069 podStartE2EDuration="4.154898697s" totalImagesPullingTime="1.207778599s" totalInitContainerRuntime="70.484029ms" isStatefulPod=true podCreationTimestamp="2026-09-10 17:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:33.153374706 +0000 UTC m=+310.547823962" watchObservedRunningTime="2026-09-10 17:48:33.154898697 +0000 UTC m=+310.549347953" Sep 10 17:48:33.172154 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.172105 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-qhv4c" podStartSLOduration=2.791089558 podStartE2EDuration="4.172091081s" totalImagesPullingTime="1.381001523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:33.170159476 +0000 UTC m=+310.564608730" watchObservedRunningTime="2026-09-10 17:48:33.172091081 +0000 UTC m=+310.566540365" Sep 10 17:48:33.221718 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.221636 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:33.325156 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.325120 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:33.794900 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.794870 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-vvltd"] Sep 10 17:48:33.798099 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.798081 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-vvltd" Sep 10 17:48:33.800408 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.800380 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fgmxb\"" Sep 10 17:48:33.800502 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.800387 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 17:48:33.800502 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.800386 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 17:48:33.807190 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.807161 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:33.807482 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.807462 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-vvltd"] Sep 10 17:48:33.901663 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.901622 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:33.938824 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:33.938791 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwt9k\" (UniqueName: \"kubernetes.io/projected/30fad948-16ec-4c25-820f-356445321db1-kube-api-access-bwt9k\") pod \"downloads-85d98c998f-vvltd\" (UID: \"30fad948-16ec-4c25-820f-356445321db1\") " pod="openshift-console/downloads-85d98c998f-vvltd" Sep 10 17:48:34.004498 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.004463 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.039560 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.039532 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwt9k\" (UniqueName: \"kubernetes.io/projected/30fad948-16ec-4c25-820f-356445321db1-kube-api-access-bwt9k\") pod \"downloads-85d98c998f-vvltd\" (UID: \"30fad948-16ec-4c25-820f-356445321db1\") " pod="openshift-console/downloads-85d98c998f-vvltd" Sep 10 17:48:34.047959 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.047902 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwt9k\" (UniqueName: \"kubernetes.io/projected/30fad948-16ec-4c25-820f-356445321db1-kube-api-access-bwt9k\") pod \"downloads-85d98c998f-vvltd\" (UID: \"30fad948-16ec-4c25-820f-356445321db1\") " pod="openshift-console/downloads-85d98c998f-vvltd" Sep 10 17:48:34.105015 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.104972 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.106795 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.106776 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-vvltd" Sep 10 17:48:34.304168 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.304087 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.382117 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.382008 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-vvltd"] Sep 10 17:48:34.384606 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:34.384578 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fad948_16ec_4c25_820f_356445321db1.slice/crio-39d0f9efca08483f03c8409af807c265c7c2c9bf05a8990ebdab89d02dd14ed8 WatchSource:0}: Error finding container 39d0f9efca08483f03c8409af807c265c7c2c9bf05a8990ebdab89d02dd14ed8: Status 404 returned error can't find the container with id 39d0f9efca08483f03c8409af807c265c7c2c9bf05a8990ebdab89d02dd14ed8 Sep 10 17:48:34.388525 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.388470 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.451749 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.451716 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.552047 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.552007 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.652113 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.652023 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.737704 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.737671 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.885365 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.885307 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:34.964420 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:34.964329 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.147689 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.147645 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-vvltd" event={"ID":"30fad948-16ec-4c25-820f-356445321db1","Type":"ContainerStarted","Data":"39d0f9efca08483f03c8409af807c265c7c2c9bf05a8990ebdab89d02dd14ed8"} Sep 10 17:48:35.195923 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.195888 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2"] Sep 10 17:48:35.199667 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.199643 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.202174 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.202118 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 17:48:35.202292 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.202186 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 17:48:35.202292 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.202124 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 17:48:35.202292 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.202232 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nqb54\"" Sep 10 17:48:35.202292 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.202123 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 17:48:35.202640 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.202626 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 17:48:35.207594 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.207564 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 17:48:35.210352 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.210322 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2"] Sep 10 17:48:35.279212 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.279167 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.349594 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.349557 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-secret-telemeter-client\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.350022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.349612 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgn5c\" (UniqueName: \"kubernetes.io/projected/1727decf-9297-4d7a-9da3-9c67f9265281-kube-api-access-kgn5c\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.350022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.349661 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-federate-client-tls\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.350022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.349703 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.350022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.349764 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-telemeter-client-tls\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.350022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.349807 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.350022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.349866 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-metrics-client-ca\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.350022 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.349900 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-serving-certs-ca-bundle\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.379642 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.379608 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.450525 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.450492 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgn5c\" (UniqueName: \"kubernetes.io/projected/1727decf-9297-4d7a-9da3-9c67f9265281-kube-api-access-kgn5c\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.450701 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.450533 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-federate-client-tls\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.450701 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.450574 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.450701 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.450606 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-telemeter-client-tls\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.450701 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.450636 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.450701 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.450670 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-metrics-client-ca\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.450701 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.450699 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-serving-certs-ca-bundle\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.450990 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.450764 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-secret-telemeter-client\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.454908 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.452188 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.454908 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.452202 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-serving-certs-ca-bundle\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.454908 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.452202 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1727decf-9297-4d7a-9da3-9c67f9265281-metrics-client-ca\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.454908 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.454305 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-telemeter-client-tls\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.454908 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.454760 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.454908 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.454789 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-secret-telemeter-client\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.458911 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.458815 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1727decf-9297-4d7a-9da3-9c67f9265281-federate-client-tls\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.459632 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.459611 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgn5c\" (UniqueName: \"kubernetes.io/projected/1727decf-9297-4d7a-9da3-9c67f9265281-kube-api-access-kgn5c\") pod \"telemeter-client-5d6d96dd67-mz6z2\" (UID: \"1727decf-9297-4d7a-9da3-9c67f9265281\") " pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.514280 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.514244 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" Sep 10 17:48:35.709685 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.709644 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.796023 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.795993 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2"] Sep 10 17:48:35.798589 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.798531 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.799896 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:35.799856 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1727decf_9297_4d7a_9da3_9c67f9265281.slice/crio-09ddcfadd7a29b6e898f37a7b8ba05d2a44858c527d6ab18159804deac8a65d9 WatchSource:0}: Error finding container 09ddcfadd7a29b6e898f37a7b8ba05d2a44858c527d6ab18159804deac8a65d9: Status 404 returned error can't find the container with id 09ddcfadd7a29b6e898f37a7b8ba05d2a44858c527d6ab18159804deac8a65d9 Sep 10 17:48:35.861899 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.861769 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:35.962117 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:35.962071 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:36.154582 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.154504 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" event={"ID":"1727decf-9297-4d7a-9da3-9c67f9265281","Type":"ContainerStarted","Data":"09ddcfadd7a29b6e898f37a7b8ba05d2a44858c527d6ab18159804deac8a65d9"} Sep 10 17:48:36.165421 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.165377 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:36.233028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.232998 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:48:36.238326 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.238287 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.241108 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.240855 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 17:48:36.241108 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.240875 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 17:48:36.241108 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.240855 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 17:48:36.241108 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241015 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 17:48:36.241108 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241026 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4xv7h\"" Sep 10 17:48:36.241455 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241162 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 17:48:36.241455 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241342 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 17:48:36.241455 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241392 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 17:48:36.241591 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241496 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ab7fec0g54i1t\"" Sep 10 17:48:36.241637 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241592 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 17:48:36.241637 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241625 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 17:48:36.241802 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241782 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 17:48:36.242011 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241892 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 17:48:36.242011 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.241896 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 17:48:36.242266 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.242234 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 17:48:36.242410 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.242332 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 17:48:36.244122 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.244098 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 17:48:36.252977 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.252956 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:48:36.256836 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.256811 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:36.360363 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360303 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360394 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360458 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-web-config\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360512 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360569 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360633 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360661 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360689 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360718 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360748 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.360828 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360811 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360835 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360870 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360907 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.360949 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.361013 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp56d\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-kube-api-access-hp56d\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.361044 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config-out\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.361073 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.361132 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.361284 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.361157 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.461813 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461712 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.461813 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461773 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-web-config\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461822 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461851 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461894 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461918 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461944 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461970 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.461996 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462033 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462053 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462078 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462100 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462122 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462152 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp56d\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-kube-api-access-hp56d\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462181 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config-out\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462210 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462246 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462268 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462495 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462326 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462958 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462590 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.462958 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.462907 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.463996 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.463969 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.465355 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.465329 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.465460 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.465382 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.465629 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.465604 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.465629 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.465619 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.466043 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.466002 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.466539 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.466517 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.466637 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.466596 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.466724 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.466699 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.468115 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.467999 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config-out\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.468223 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.468156 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.468223 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.468162 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.468223 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.468169 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.468410 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.468297 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.468461 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.468421 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.468719 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.468695 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-web-config\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.468964 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.468943 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.475591 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.475569 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp56d\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-kube-api-access-hp56d\") pod \"prometheus-k8s-0\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.550805 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.550758 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:36.852924 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:36.852806 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:48:36.854981 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:48:36.854946 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e97f0b_d2f2_4be5_a252_2e5bbd485634.slice/crio-3a128be324b544bc89e299fe5f7f2bc48db85a958c216c05ae6e42d8db0b5138 WatchSource:0}: Error finding container 3a128be324b544bc89e299fe5f7f2bc48db85a958c216c05ae6e42d8db0b5138: Status 404 returned error can't find the container with id 3a128be324b544bc89e299fe5f7f2bc48db85a958c216c05ae6e42d8db0b5138 Sep 10 17:48:37.160895 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:37.160805 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerStarted","Data":"3a128be324b544bc89e299fe5f7f2bc48db85a958c216c05ae6e42d8db0b5138"} Sep 10 17:48:37.946402 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:37.946301 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:38.047523 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.047465 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:38.167389 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.167354 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" event={"ID":"1727decf-9297-4d7a-9da3-9c67f9265281","Type":"ContainerStarted","Data":"384f63f6168014e988a58384b8e7a4d3809bf81dd8397c50819bae0d42b1c405"} Sep 10 17:48:38.350996 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.350958 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" podUID="b6d0fec2-74f7-43f0-b26d-9499f106e54c" containerName="registry" containerID="cri-o://914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2" gracePeriod=30 Sep 10 17:48:38.613066 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.613039 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:48:38.683021 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.682982 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-bound-sa-token\") pod \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " Sep 10 17:48:38.683194 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683054 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-certificates\") pod \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " Sep 10 17:48:38.683194 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683098 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6gsk\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-kube-api-access-j6gsk\") pod \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " Sep 10 17:48:38.683194 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683124 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-image-registry-private-configuration\") pod \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " Sep 10 17:48:38.683194 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683165 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-installation-pull-secrets\") pod \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " Sep 10 17:48:38.683194 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683191 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") pod \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " Sep 10 17:48:38.683491 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683237 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6d0fec2-74f7-43f0-b26d-9499f106e54c-ca-trust-extracted\") pod \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " Sep 10 17:48:38.683491 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683281 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-trusted-ca\") pod \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\" (UID: \"b6d0fec2-74f7-43f0-b26d-9499f106e54c\") " Sep 10 17:48:38.683491 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683463 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b6d0fec2-74f7-43f0-b26d-9499f106e54c" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:38.684018 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683614 2588 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-certificates\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:48:38.684128 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.683848 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b6d0fec2-74f7-43f0-b26d-9499f106e54c" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:48:38.686706 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.686591 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b6d0fec2-74f7-43f0-b26d-9499f106e54c" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:38.686706 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.686623 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b6d0fec2-74f7-43f0-b26d-9499f106e54c" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:48:38.686831 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.686742 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b6d0fec2-74f7-43f0-b26d-9499f106e54c" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:48:38.686883 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.686827 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b6d0fec2-74f7-43f0-b26d-9499f106e54c" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:38.686922 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.686901 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-kube-api-access-j6gsk" (OuterVolumeSpecName: "kube-api-access-j6gsk") pod "b6d0fec2-74f7-43f0-b26d-9499f106e54c" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c"). InnerVolumeSpecName "kube-api-access-j6gsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:48:38.693835 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.693808 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d0fec2-74f7-43f0-b26d-9499f106e54c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b6d0fec2-74f7-43f0-b26d-9499f106e54c" (UID: "b6d0fec2-74f7-43f0-b26d-9499f106e54c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:48:38.784627 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.784589 2588 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-installation-pull-secrets\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:48:38.784627 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.784627 2588 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-registry-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:48:38.784839 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.784643 2588 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6d0fec2-74f7-43f0-b26d-9499f106e54c-ca-trust-extracted\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:48:38.784839 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.784658 2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6d0fec2-74f7-43f0-b26d-9499f106e54c-trusted-ca\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:48:38.784839 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.784672 2588 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-bound-sa-token\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:48:38.784839 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.784685 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6gsk\" (UniqueName: \"kubernetes.io/projected/b6d0fec2-74f7-43f0-b26d-9499f106e54c-kube-api-access-j6gsk\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:48:38.784839 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:38.784699 2588 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6d0fec2-74f7-43f0-b26d-9499f106e54c-image-registry-private-configuration\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:48:39.173446 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.173411 2588 generic.go:356] "Generic (PLEG): container finished" podID="b6d0fec2-74f7-43f0-b26d-9499f106e54c" containerID="914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2" exitCode=0 Sep 10 17:48:39.173880 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.173472 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" Sep 10 17:48:39.173880 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.173504 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" event={"ID":"b6d0fec2-74f7-43f0-b26d-9499f106e54c","Type":"ContainerDied","Data":"914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2"} Sep 10 17:48:39.173880 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.173567 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766b8d745b-k8b4f" event={"ID":"b6d0fec2-74f7-43f0-b26d-9499f106e54c","Type":"ContainerDied","Data":"e547700090b99e2807ef0910db331320db008a49f6d16f56768764649d644fe2"} Sep 10 17:48:39.173880 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.173600 2588 scope.go:117] "RemoveContainer" containerID="914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2" Sep 10 17:48:39.176738 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.176694 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" event={"ID":"1727decf-9297-4d7a-9da3-9c67f9265281","Type":"ContainerStarted","Data":"3c942c8a6563c56989c2a7066f5a67dc3fb90482259ee86f01a1f82aa41f5da5"} Sep 10 17:48:39.176845 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.176748 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" event={"ID":"1727decf-9297-4d7a-9da3-9c67f9265281","Type":"ContainerStarted","Data":"69620f03d2279cef5906d9aacff043eef94f69f7ebc2112a9162f5716811472f"} Sep 10 17:48:39.178513 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.178490 2588 generic.go:356] "Generic (PLEG): container finished" podID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" exitCode=0 Sep 10 17:48:39.178638 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.178556 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerDied","Data":"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160"} Sep 10 17:48:39.183795 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.183776 2588 scope.go:117] "RemoveContainer" containerID="914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2" Sep 10 17:48:39.184093 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:48:39.184070 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2\": container with ID starting with 914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2 not found: ID does not exist" containerID="914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2" Sep 10 17:48:39.184168 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.184102 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2"} err="failed to get container status \"914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2\": rpc error: code = NotFound desc = could not find container \"914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2\": container with ID starting with 914929d7c93be5fc1d6f7790d35239b7455b0ae780eea0bda028b110987fb8c2 not found: ID does not exist" Sep 10 17:48:39.189596 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.189574 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-766b8d745b-k8b4f"] Sep 10 17:48:39.194815 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.194795 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-766b8d745b-k8b4f"] Sep 10 17:48:39.214406 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:39.214357 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d6d96dd67-mz6z2" podStartSLOduration=1.720856769 podStartE2EDuration="4.214338928s" totalImagesPullingTime="2.493482159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:39.213884916 +0000 UTC m=+316.608334191" watchObservedRunningTime="2026-09-10 17:48:39.214338928 +0000 UTC m=+316.608788178" Sep 10 17:48:41.127510 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:41.125550 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6d0fec2-74f7-43f0-b26d-9499f106e54c" path="/var/lib/kubelet/pods/b6d0fec2-74f7-43f0-b26d-9499f106e54c/volumes" Sep 10 17:48:41.401554 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:41.401462 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:41.459337 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:41.459251 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:43.206800 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:43.206717 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerStarted","Data":"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2"} Sep 10 17:48:43.207199 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:43.206830 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerStarted","Data":"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85"} Sep 10 17:48:48.514087 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:48.514050 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:49.713032 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:49.712993 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:49.773842 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:49.773810 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:51.139083 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:51.139041 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:51.196395 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:51.196359 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:52.247374 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.247334 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-vvltd" event={"ID":"30fad948-16ec-4c25-820f-356445321db1","Type":"ContainerStarted","Data":"2336bd439bd8ab7ab3c72a65fadeed5230d6f03948a5ab438a734b6b8b5c2582"} Sep 10 17:48:52.247899 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.247880 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-vvltd" Sep 10 17:48:52.251885 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.251860 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerStarted","Data":"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e"} Sep 10 17:48:52.251993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.251918 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerStarted","Data":"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63"} Sep 10 17:48:52.251993 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.251956 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerStarted","Data":"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8"} Sep 10 17:48:52.252076 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.252001 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerStarted","Data":"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0"} Sep 10 17:48:52.256065 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.256041 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-vvltd" Sep 10 17:48:52.269003 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.268954 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-vvltd" podStartSLOduration=1.658777738 podStartE2EDuration="19.268937391s" totalImagesPullingTime="17.610159653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:52.267977351 +0000 UTC m=+329.662426599" watchObservedRunningTime="2026-09-10 17:48:52.268937391 +0000 UTC m=+329.663386645" Sep 10 17:48:52.310283 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:52.309469 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.150339194 podStartE2EDuration="16.309444146s" totalImagesPullingTime="14.130119935s" totalInitContainerRuntime="28.985017ms" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:52.30720983 +0000 UTC m=+329.701659086" watchObservedRunningTime="2026-09-10 17:48:52.309444146 +0000 UTC m=+329.703893404" Sep 10 17:48:53.912150 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:53.912115 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:53.970155 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:53.970116 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:56.335182 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:56.335146 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:56.439281 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:56.439231 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:56.551678 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:56.551642 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:48:59.318720 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:59.318678 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:48:59.379097 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:48:59.379061 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:00.763727 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:00.763690 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:03.560651 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:03.560620 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-qlqkl_72ca04f0-cd13-45cf-aa3d-31ef9675c780/cluster-monitoring-operator/0.log" Sep 10 17:49:03.716505 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:03.716468 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:03.758658 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:03.758624 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-qhv4c_00fda959-60ce-40fa-936a-214e1ba67894/kube-state-metrics/0.log" Sep 10 17:49:03.765476 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:03.765452 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:03.957604 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:03.957533 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-qhv4c_00fda959-60ce-40fa-936a-214e1ba67894/kube-rbac-proxy-main/0.log" Sep 10 17:49:04.160932 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:04.160905 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-qhv4c_00fda959-60ce-40fa-936a-214e1ba67894/kube-rbac-proxy-self/0.log" Sep 10 17:49:05.307570 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:05.307540 2588 generic.go:356] "Generic (PLEG): container finished" podID="eeb5f6f8-b04c-429c-8585-7a74b36969f4" containerID="ebb65d8d598108c898cd5034c00eceff3b1f71169a65a54be36a176f3449897a" exitCode=0 Sep 10 17:49:05.307987 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:05.307584 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" event={"ID":"eeb5f6f8-b04c-429c-8585-7a74b36969f4","Type":"ContainerDied","Data":"ebb65d8d598108c898cd5034c00eceff3b1f71169a65a54be36a176f3449897a"} Sep 10 17:49:05.307987 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:05.307873 2588 scope.go:117] "RemoveContainer" containerID="ebb65d8d598108c898cd5034c00eceff3b1f71169a65a54be36a176f3449897a" Sep 10 17:49:05.958173 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:05.958145 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlfpv_a1e1374d-d186-4296-a5fb-e0a36e78d001/init-textfile/0.log" Sep 10 17:49:06.159224 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:06.159176 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlfpv_a1e1374d-d186-4296-a5fb-e0a36e78d001/node-exporter/0.log" Sep 10 17:49:06.313053 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:06.313024 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qq5r4" event={"ID":"eeb5f6f8-b04c-429c-8585-7a74b36969f4","Type":"ContainerStarted","Data":"ae7897a03f66032c17c34d77ddcd1e290cdc67e0353b07e35ebd09180850ab7a"} Sep 10 17:49:06.358419 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:06.358387 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlfpv_a1e1374d-d186-4296-a5fb-e0a36e78d001/kube-rbac-proxy/0.log" Sep 10 17:49:07.159154 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:07.159104 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_96e97f0b-d2f2-4be5-a252-2e5bbd485634/init-config-reloader/0.log" Sep 10 17:49:07.362509 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:07.362482 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_96e97f0b-d2f2-4be5-a252-2e5bbd485634/prometheus/0.log" Sep 10 17:49:07.519778 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:07.519740 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:07.558244 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:07.558206 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_96e97f0b-d2f2-4be5-a252-2e5bbd485634/config-reloader/0.log" Sep 10 17:49:07.623469 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:07.623438 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:07.758543 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:07.758514 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_96e97f0b-d2f2-4be5-a252-2e5bbd485634/thanos-sidecar/0.log" Sep 10 17:49:07.958170 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:07.958089 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_96e97f0b-d2f2-4be5-a252-2e5bbd485634/kube-rbac-proxy-web/0.log" Sep 10 17:49:08.158503 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:08.158473 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_96e97f0b-d2f2-4be5-a252-2e5bbd485634/kube-rbac-proxy/0.log" Sep 10 17:49:08.357919 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:08.357886 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_96e97f0b-d2f2-4be5-a252-2e5bbd485634/kube-rbac-proxy-thanos/0.log" Sep 10 17:49:09.157411 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:09.157382 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d6d96dd67-mz6z2_1727decf-9297-4d7a-9da3-9c67f9265281/telemeter-client/0.log" Sep 10 17:49:09.357639 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:09.357609 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d6d96dd67-mz6z2_1727decf-9297-4d7a-9da3-9c67f9265281/reload/0.log" Sep 10 17:49:09.558181 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:09.558147 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d6d96dd67-mz6z2_1727decf-9297-4d7a-9da3-9c67f9265281/kube-rbac-proxy/0.log" Sep 10 17:49:11.340552 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:11.340520 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:11.401034 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:11.401004 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:11.959965 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:11.959931 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-vvltd_30fad948-16ec-4c25-820f-356445321db1/download-server/0.log" Sep 10 17:49:13.330986 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:13.330952 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:36.005452 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.005408 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:49:36.007725 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.007704 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeee428e-a7c2-41dc-b6fe-f24a9a337b9d-metrics-certs\") pod \"network-metrics-daemon-qmzql\" (UID: \"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d\") " pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:49:36.020255 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.020233 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kjkcx\"" Sep 10 17:49:36.027956 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.027941 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmzql" Sep 10 17:49:36.316823 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.316749 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qmzql"] Sep 10 17:49:36.319824 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:49:36.319796 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeee428e_a7c2_41dc_b6fe_f24a9a337b9d.slice/crio-4f9355fca6a8f28f3e461159484bfd4b24b617db37fd07c1a72602264a128fe3 WatchSource:0}: Error finding container 4f9355fca6a8f28f3e461159484bfd4b24b617db37fd07c1a72602264a128fe3: Status 404 returned error can't find the container with id 4f9355fca6a8f28f3e461159484bfd4b24b617db37fd07c1a72602264a128fe3 Sep 10 17:49:36.431348 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.431295 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmzql" event={"ID":"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d","Type":"ContainerStarted","Data":"4f9355fca6a8f28f3e461159484bfd4b24b617db37fd07c1a72602264a128fe3"} Sep 10 17:49:36.551762 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.551727 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:36.567650 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.567578 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:36.959468 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:36.959374 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:37.014877 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:37.014841 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:37.437055 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:37.437024 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmzql" event={"ID":"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d","Type":"ContainerStarted","Data":"4bf24e1fab8e687d5cd3b66a280a26b8ae4ee7541a25982d759c3d6915ad33c1"} Sep 10 17:49:37.457204 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:37.457178 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:38.444903 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:38.444854 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmzql" event={"ID":"aeee428e-a7c2-41dc-b6fe-f24a9a337b9d","Type":"ContainerStarted","Data":"b3df35f1187057b5937a20ded2cee408d8d35e34b77df5ad1f47ea127c84b752"} Sep 10 17:49:38.462387 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:38.462340 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qmzql" podStartSLOduration=374.437645062 podStartE2EDuration="6m15.462327119s" totalImagesPullingTime="1.024682057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:49:38.460502961 +0000 UTC m=+375.854952220" watchObservedRunningTime="2026-09-10 17:49:38.462327119 +0000 UTC m=+375.856776366" Sep 10 17:49:38.551177 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:38.551140 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:38.607884 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:38.607839 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:43.097376 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:43.097328 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:45.055462 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:45.055425 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:45.111973 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:45.111929 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:46.062040 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:46.061995 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:46.162209 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:46.162170 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:46.955242 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:46.955201 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:47.006928 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:47.006894 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:54.527432 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.527403 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:49:54.527862 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.527670 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="prometheus" containerID="cri-o://c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" gracePeriod=600 Sep 10 17:49:54.527862 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.527697 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy" containerID="cri-o://4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" gracePeriod=600 Sep 10 17:49:54.527862 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.527755 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy-web" containerID="cri-o://21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" gracePeriod=600 Sep 10 17:49:54.527862 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.527772 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" gracePeriod=600 Sep 10 17:49:54.527862 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.527715 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="thanos-sidecar" containerID="cri-o://93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" gracePeriod=600 Sep 10 17:49:54.527862 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.527752 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="config-reloader" containerID="cri-o://f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" gracePeriod=600 Sep 10 17:49:54.765424 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.765401 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:54.857863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.857773 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-metrics-client-ca\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.857863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.857808 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-2\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.857863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.857823 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-0\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.857863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.857842 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config-out\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858206 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.857875 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-metrics-client-certs\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858206 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858036 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-grpc-tls\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858206 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858083 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858206 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858148 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-kube-rbac-proxy\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858206 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858178 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-1\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858482 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858219 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-web-config\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858482 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858259 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-trusted-ca-bundle\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858482 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858285 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-db\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858482 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858347 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858482 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858374 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp56d\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-kube-api-access-hp56d\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858482 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858422 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-kubelet-serving-ca-bundle\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858482 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858463 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-thanos-prometheus-http-client-file\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858826 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858489 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-tls\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858826 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858518 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-serving-certs-ca-bundle\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858826 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858557 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-tls-assets\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.858826 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858596 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\" (UID: \"96e97f0b-d2f2-4be5-a252-2e5bbd485634\") " Sep 10 17:49:54.861878 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858281 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:54.862012 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.858336 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:54.862012 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.859482 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:54.862012 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.860725 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.862012 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.861411 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.862012 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.861512 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.862012 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.861846 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config-out" (OuterVolumeSpecName: "config-out") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:49:54.862012 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.861991 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:54.862567 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.862460 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:54.862567 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.862463 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.862842 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.862739 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:54.862930 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.862868 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:49:54.862991 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.862923 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-kube-api-access-hp56d" (OuterVolumeSpecName: "kube-api-access-hp56d") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "kube-api-access-hp56d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:49:54.862991 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.862957 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:54.863193 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.863169 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.863273 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.863250 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.864035 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.864004 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config" (OuterVolumeSpecName: "config") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.864937 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.864918 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:49:54.865019 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.864942 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.872198 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.872177 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-web-config" (OuterVolumeSpecName: "web-config") pod "96e97f0b-d2f2-4be5-a252-2e5bbd485634" (UID: "96e97f0b-d2f2-4be5-a252-2e5bbd485634"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:54.959289 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959250 2588 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959289 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959281 2588 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959289 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959292 2588 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959303 2588 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-tls-assets\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959341 2588 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959352 2588 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-metrics-client-ca\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959360 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959368 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959376 2588 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config-out\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959383 2588 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-metrics-client-certs\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959391 2588 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-grpc-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959400 2588 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959408 2588 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-secret-kube-rbac-proxy\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959417 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959425 2588 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-web-config\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959433 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959441 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e97f0b-d2f2-4be5-a252-2e5bbd485634-prometheus-k8s-db\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959449 2588 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e97f0b-d2f2-4be5-a252-2e5bbd485634-config\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959458 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp56d\" (UniqueName: \"kubernetes.io/projected/96e97f0b-d2f2-4be5-a252-2e5bbd485634-kube-api-access-hp56d\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:54.959529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:54.959467 2588 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e97f0b-d2f2-4be5-a252-2e5bbd485634-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:49:55.511824 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.511790 2588 generic.go:356] "Generic (PLEG): container finished" podID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" exitCode=0 Sep 10 17:49:55.511824 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.511817 2588 generic.go:356] "Generic (PLEG): container finished" podID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" exitCode=0 Sep 10 17:49:55.511824 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.511823 2588 generic.go:356] "Generic (PLEG): container finished" podID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" exitCode=0 Sep 10 17:49:55.511824 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.511829 2588 generic.go:356] "Generic (PLEG): container finished" podID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" exitCode=0 Sep 10 17:49:55.512079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.511834 2588 generic.go:356] "Generic (PLEG): container finished" podID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" exitCode=0 Sep 10 17:49:55.512079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.511839 2588 generic.go:356] "Generic (PLEG): container finished" podID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" exitCode=0 Sep 10 17:49:55.512079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.511877 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.512079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.511875 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerDied","Data":"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e"} Sep 10 17:49:55.512079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.512014 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerDied","Data":"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63"} Sep 10 17:49:55.512079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.512045 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerDied","Data":"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8"} Sep 10 17:49:55.512079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.512078 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerDied","Data":"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0"} Sep 10 17:49:55.512331 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.512112 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerDied","Data":"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2"} Sep 10 17:49:55.512331 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.512136 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerDied","Data":"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85"} Sep 10 17:49:55.512331 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.512080 2588 scope.go:117] "RemoveContainer" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" Sep 10 17:49:55.512331 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.512171 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e97f0b-d2f2-4be5-a252-2e5bbd485634","Type":"ContainerDied","Data":"3a128be324b544bc89e299fe5f7f2bc48db85a958c216c05ae6e42d8db0b5138"} Sep 10 17:49:55.519675 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.519656 2588 scope.go:117] "RemoveContainer" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" Sep 10 17:49:55.526448 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.526427 2588 scope.go:117] "RemoveContainer" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" Sep 10 17:49:55.531430 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.531406 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:49:55.535158 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.534876 2588 scope.go:117] "RemoveContainer" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" Sep 10 17:49:55.535933 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.535883 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:49:55.542775 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.542757 2588 scope.go:117] "RemoveContainer" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" Sep 10 17:49:55.557384 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.557362 2588 scope.go:117] "RemoveContainer" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" Sep 10 17:49:55.559684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559660 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:49:55.559936 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559921 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="prometheus" Sep 10 17:49:55.559936 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559935 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="prometheus" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559946 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="thanos-sidecar" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559952 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="thanos-sidecar" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559959 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy-thanos" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559964 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy-thanos" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559973 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d0fec2-74f7-43f0-b26d-9499f106e54c" containerName="registry" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559979 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d0fec2-74f7-43f0-b26d-9499f106e54c" containerName="registry" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559987 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy-web" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559992 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy-web" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.559997 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560001 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560015 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="init-config-reloader" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560021 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="init-config-reloader" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560027 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="config-reloader" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560032 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="config-reloader" Sep 10 17:49:55.560062 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560068 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="config-reloader" Sep 10 17:49:55.560844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560075 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy-thanos" Sep 10 17:49:55.560844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560082 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy-web" Sep 10 17:49:55.560844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560089 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="kube-rbac-proxy" Sep 10 17:49:55.560844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560096 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="thanos-sidecar" Sep 10 17:49:55.560844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560104 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6d0fec2-74f7-43f0-b26d-9499f106e54c" containerName="registry" Sep 10 17:49:55.560844 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.560112 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" containerName="prometheus" Sep 10 17:49:55.565271 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.565253 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.565879 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.565856 2588 scope.go:117] "RemoveContainer" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" Sep 10 17:49:55.567675 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.567654 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 17:49:55.567783 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.567705 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ab7fec0g54i1t\"" Sep 10 17:49:55.567783 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.567741 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 17:49:55.567783 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.567769 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 17:49:55.567783 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.567781 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 17:49:55.567991 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.567938 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 17:49:55.567991 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.567965 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4xv7h\"" Sep 10 17:49:55.568093 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.567995 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 17:49:55.568431 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.568404 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 17:49:55.568536 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.568501 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 17:49:55.568593 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.568559 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 17:49:55.568647 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.568588 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 17:49:55.568854 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.568835 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 17:49:55.568988 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.568855 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 17:49:55.568988 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.568952 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 17:49:55.570842 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.570824 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 17:49:55.573614 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.573592 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 17:49:55.576179 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.576162 2588 scope.go:117] "RemoveContainer" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" Sep 10 17:49:55.576469 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:49:55.576451 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": container with ID starting with c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e not found: ID does not exist" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" Sep 10 17:49:55.576522 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.576475 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e"} err="failed to get container status \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": rpc error: code = NotFound desc = could not find container \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": container with ID starting with c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e not found: ID does not exist" Sep 10 17:49:55.576522 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.576494 2588 scope.go:117] "RemoveContainer" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" Sep 10 17:49:55.576755 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:49:55.576738 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": container with ID starting with 4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63 not found: ID does not exist" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" Sep 10 17:49:55.576818 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.576765 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63"} err="failed to get container status \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": rpc error: code = NotFound desc = could not find container \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": container with ID starting with 4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63 not found: ID does not exist" Sep 10 17:49:55.576818 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.576788 2588 scope.go:117] "RemoveContainer" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" Sep 10 17:49:55.577026 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:49:55.577012 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": container with ID starting with 21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8 not found: ID does not exist" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" Sep 10 17:49:55.577065 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577031 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8"} err="failed to get container status \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": rpc error: code = NotFound desc = could not find container \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": container with ID starting with 21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8 not found: ID does not exist" Sep 10 17:49:55.577065 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577043 2588 scope.go:117] "RemoveContainer" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" Sep 10 17:49:55.577269 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:49:55.577250 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": container with ID starting with 93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0 not found: ID does not exist" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" Sep 10 17:49:55.577370 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577274 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0"} err="failed to get container status \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": rpc error: code = NotFound desc = could not find container \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": container with ID starting with 93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0 not found: ID does not exist" Sep 10 17:49:55.577370 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577288 2588 scope.go:117] "RemoveContainer" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" Sep 10 17:49:55.577539 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:49:55.577524 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": container with ID starting with f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2 not found: ID does not exist" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" Sep 10 17:49:55.577578 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577542 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2"} err="failed to get container status \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": rpc error: code = NotFound desc = could not find container \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": container with ID starting with f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2 not found: ID does not exist" Sep 10 17:49:55.577578 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577553 2588 scope.go:117] "RemoveContainer" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" Sep 10 17:49:55.577750 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:49:55.577736 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": container with ID starting with c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85 not found: ID does not exist" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" Sep 10 17:49:55.577791 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577751 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85"} err="failed to get container status \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": rpc error: code = NotFound desc = could not find container \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": container with ID starting with c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85 not found: ID does not exist" Sep 10 17:49:55.577791 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577762 2588 scope.go:117] "RemoveContainer" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" Sep 10 17:49:55.577966 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:49:55.577951 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": container with ID starting with c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160 not found: ID does not exist" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" Sep 10 17:49:55.578003 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577971 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160"} err="failed to get container status \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": rpc error: code = NotFound desc = could not find container \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": container with ID starting with c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160 not found: ID does not exist" Sep 10 17:49:55.578003 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.577987 2588 scope.go:117] "RemoveContainer" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" Sep 10 17:49:55.578178 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.578163 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e"} err="failed to get container status \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": rpc error: code = NotFound desc = could not find container \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": container with ID starting with c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e not found: ID does not exist" Sep 10 17:49:55.578217 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.578179 2588 scope.go:117] "RemoveContainer" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" Sep 10 17:49:55.578516 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.578492 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63"} err="failed to get container status \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": rpc error: code = NotFound desc = could not find container \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": container with ID starting with 4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63 not found: ID does not exist" Sep 10 17:49:55.578585 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.578518 2588 scope.go:117] "RemoveContainer" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" Sep 10 17:49:55.578796 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.578760 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8"} err="failed to get container status \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": rpc error: code = NotFound desc = could not find container \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": container with ID starting with 21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8 not found: ID does not exist" Sep 10 17:49:55.578966 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.578794 2588 scope.go:117] "RemoveContainer" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" Sep 10 17:49:55.579267 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.579228 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0"} err="failed to get container status \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": rpc error: code = NotFound desc = could not find container \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": container with ID starting with 93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0 not found: ID does not exist" Sep 10 17:49:55.579371 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.579276 2588 scope.go:117] "RemoveContainer" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" Sep 10 17:49:55.579704 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.579679 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2"} err="failed to get container status \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": rpc error: code = NotFound desc = could not find container \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": container with ID starting with f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2 not found: ID does not exist" Sep 10 17:49:55.579704 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.579703 2588 scope.go:117] "RemoveContainer" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" Sep 10 17:49:55.580042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.580020 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85"} err="failed to get container status \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": rpc error: code = NotFound desc = could not find container \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": container with ID starting with c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85 not found: ID does not exist" Sep 10 17:49:55.580042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.580043 2588 scope.go:117] "RemoveContainer" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" Sep 10 17:49:55.580348 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.580300 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160"} err="failed to get container status \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": rpc error: code = NotFound desc = could not find container \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": container with ID starting with c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160 not found: ID does not exist" Sep 10 17:49:55.580348 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.580347 2588 scope.go:117] "RemoveContainer" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" Sep 10 17:49:55.580594 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.580578 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e"} err="failed to get container status \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": rpc error: code = NotFound desc = could not find container \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": container with ID starting with c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e not found: ID does not exist" Sep 10 17:49:55.580653 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.580594 2588 scope.go:117] "RemoveContainer" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" Sep 10 17:49:55.580853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.580836 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63"} err="failed to get container status \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": rpc error: code = NotFound desc = could not find container \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": container with ID starting with 4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63 not found: ID does not exist" Sep 10 17:49:55.580919 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.580853 2588 scope.go:117] "RemoveContainer" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" Sep 10 17:49:55.581127 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581107 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8"} err="failed to get container status \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": rpc error: code = NotFound desc = could not find container \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": container with ID starting with 21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8 not found: ID does not exist" Sep 10 17:49:55.581195 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581127 2588 scope.go:117] "RemoveContainer" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" Sep 10 17:49:55.581386 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581367 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0"} err="failed to get container status \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": rpc error: code = NotFound desc = could not find container \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": container with ID starting with 93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0 not found: ID does not exist" Sep 10 17:49:55.581386 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581383 2588 scope.go:117] "RemoveContainer" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" Sep 10 17:49:55.581630 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581612 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2"} err="failed to get container status \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": rpc error: code = NotFound desc = could not find container \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": container with ID starting with f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2 not found: ID does not exist" Sep 10 17:49:55.581673 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581630 2588 scope.go:117] "RemoveContainer" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" Sep 10 17:49:55.581762 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581743 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:49:55.581875 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581854 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85"} err="failed to get container status \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": rpc error: code = NotFound desc = could not find container \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": container with ID starting with c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85 not found: ID does not exist" Sep 10 17:49:55.581934 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.581877 2588 scope.go:117] "RemoveContainer" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" Sep 10 17:49:55.582129 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.582103 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160"} err="failed to get container status \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": rpc error: code = NotFound desc = could not find container \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": container with ID starting with c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160 not found: ID does not exist" Sep 10 17:49:55.582179 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.582129 2588 scope.go:117] "RemoveContainer" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" Sep 10 17:49:55.582378 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.582355 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e"} err="failed to get container status \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": rpc error: code = NotFound desc = could not find container \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": container with ID starting with c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e not found: ID does not exist" Sep 10 17:49:55.582441 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.582380 2588 scope.go:117] "RemoveContainer" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" Sep 10 17:49:55.582637 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.582618 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63"} err="failed to get container status \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": rpc error: code = NotFound desc = could not find container \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": container with ID starting with 4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63 not found: ID does not exist" Sep 10 17:49:55.582637 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.582637 2588 scope.go:117] "RemoveContainer" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" Sep 10 17:49:55.582949 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.582928 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8"} err="failed to get container status \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": rpc error: code = NotFound desc = could not find container \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": container with ID starting with 21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8 not found: ID does not exist" Sep 10 17:49:55.583031 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.582950 2588 scope.go:117] "RemoveContainer" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" Sep 10 17:49:55.583218 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.583199 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0"} err="failed to get container status \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": rpc error: code = NotFound desc = could not find container \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": container with ID starting with 93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0 not found: ID does not exist" Sep 10 17:49:55.583265 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.583220 2588 scope.go:117] "RemoveContainer" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" Sep 10 17:49:55.583529 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.583509 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2"} err="failed to get container status \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": rpc error: code = NotFound desc = could not find container \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": container with ID starting with f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2 not found: ID does not exist" Sep 10 17:49:55.583613 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.583530 2588 scope.go:117] "RemoveContainer" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" Sep 10 17:49:55.583788 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.583771 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85"} err="failed to get container status \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": rpc error: code = NotFound desc = could not find container \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": container with ID starting with c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85 not found: ID does not exist" Sep 10 17:49:55.583841 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.583788 2588 scope.go:117] "RemoveContainer" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" Sep 10 17:49:55.583984 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.583968 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160"} err="failed to get container status \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": rpc error: code = NotFound desc = could not find container \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": container with ID starting with c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160 not found: ID does not exist" Sep 10 17:49:55.584028 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.583983 2588 scope.go:117] "RemoveContainer" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" Sep 10 17:49:55.584184 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.584169 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e"} err="failed to get container status \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": rpc error: code = NotFound desc = could not find container \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": container with ID starting with c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e not found: ID does not exist" Sep 10 17:49:55.584244 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.584184 2588 scope.go:117] "RemoveContainer" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" Sep 10 17:49:55.584435 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.584415 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63"} err="failed to get container status \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": rpc error: code = NotFound desc = could not find container \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": container with ID starting with 4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63 not found: ID does not exist" Sep 10 17:49:55.584435 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.584433 2588 scope.go:117] "RemoveContainer" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" Sep 10 17:49:55.584639 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.584622 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8"} err="failed to get container status \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": rpc error: code = NotFound desc = could not find container \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": container with ID starting with 21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8 not found: ID does not exist" Sep 10 17:49:55.584639 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.584638 2588 scope.go:117] "RemoveContainer" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" Sep 10 17:49:55.584862 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.584842 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0"} err="failed to get container status \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": rpc error: code = NotFound desc = could not find container \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": container with ID starting with 93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0 not found: ID does not exist" Sep 10 17:49:55.584928 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.584862 2588 scope.go:117] "RemoveContainer" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" Sep 10 17:49:55.585079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585062 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2"} err="failed to get container status \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": rpc error: code = NotFound desc = could not find container \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": container with ID starting with f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2 not found: ID does not exist" Sep 10 17:49:55.585079 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585078 2588 scope.go:117] "RemoveContainer" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" Sep 10 17:49:55.585332 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585293 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85"} err="failed to get container status \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": rpc error: code = NotFound desc = could not find container \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": container with ID starting with c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85 not found: ID does not exist" Sep 10 17:49:55.585408 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585336 2588 scope.go:117] "RemoveContainer" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" Sep 10 17:49:55.585533 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585516 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160"} err="failed to get container status \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": rpc error: code = NotFound desc = could not find container \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": container with ID starting with c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160 not found: ID does not exist" Sep 10 17:49:55.585533 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585531 2588 scope.go:117] "RemoveContainer" containerID="c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e" Sep 10 17:49:55.585720 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585703 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e"} err="failed to get container status \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": rpc error: code = NotFound desc = could not find container \"c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e\": container with ID starting with c3f622713fe509487850fdfcde6599b860788f06bb27b5d9d1a13356b1a2259e not found: ID does not exist" Sep 10 17:49:55.585720 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585719 2588 scope.go:117] "RemoveContainer" containerID="4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63" Sep 10 17:49:55.585921 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585905 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63"} err="failed to get container status \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": rpc error: code = NotFound desc = could not find container \"4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63\": container with ID starting with 4b4fa624e8ecc003da1e3ae6c81d6c247f8352b2523fdd32b1b63ac27b82eb63 not found: ID does not exist" Sep 10 17:49:55.585921 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.585920 2588 scope.go:117] "RemoveContainer" containerID="21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8" Sep 10 17:49:55.586164 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.586145 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8"} err="failed to get container status \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": rpc error: code = NotFound desc = could not find container \"21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8\": container with ID starting with 21f4f0a18114d193651447a7dec8e989e30279563c1d734af34a14a590ae7eb8 not found: ID does not exist" Sep 10 17:49:55.586233 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.586164 2588 scope.go:117] "RemoveContainer" containerID="93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0" Sep 10 17:49:55.586401 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.586383 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0"} err="failed to get container status \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": rpc error: code = NotFound desc = could not find container \"93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0\": container with ID starting with 93fcbb00a22b9271d334bc268ff4d6e4a4b567c5f0be78351113f0afba8801e0 not found: ID does not exist" Sep 10 17:49:55.586401 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.586400 2588 scope.go:117] "RemoveContainer" containerID="f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2" Sep 10 17:49:55.586624 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.586602 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2"} err="failed to get container status \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": rpc error: code = NotFound desc = could not find container \"f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2\": container with ID starting with f5375bed1a85a9f448cc54b84ceb0e49e74fd3af190423de4cf41009c2c9e1f2 not found: ID does not exist" Sep 10 17:49:55.586624 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.586623 2588 scope.go:117] "RemoveContainer" containerID="c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85" Sep 10 17:49:55.586837 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.586822 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85"} err="failed to get container status \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": rpc error: code = NotFound desc = could not find container \"c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85\": container with ID starting with c4f590e20b10a3ab5fa0b41446c24153021ed9987af0412f031166651b3a9b85 not found: ID does not exist" Sep 10 17:49:55.586837 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.586835 2588 scope.go:117] "RemoveContainer" containerID="c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160" Sep 10 17:49:55.587049 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.587033 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160"} err="failed to get container status \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": rpc error: code = NotFound desc = could not find container \"c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160\": container with ID starting with c1a43986f6c930d0fed9a7fd0688dca147c6da9a74fc17e067ab018f7159f160 not found: ID does not exist" Sep 10 17:49:55.665444 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665399 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665631 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665468 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665631 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665502 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665631 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665519 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-config\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665631 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665532 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665631 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665549 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665631 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665568 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665631 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665583 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdr8l\" (UniqueName: \"kubernetes.io/projected/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-kube-api-access-mdr8l\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665635 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665679 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665694 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665708 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665729 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665762 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665779 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665800 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665847 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665861 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665880 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.665981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.665907 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.766854 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.766762 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.766854 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.766811 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767102 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767076 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767168 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767119 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-config\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767168 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767136 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767168 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767163 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767357 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767193 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767357 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767227 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdr8l\" (UniqueName: \"kubernetes.io/projected/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-kube-api-access-mdr8l\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767448 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767365 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767448 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767422 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767465 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767502 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767526 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767559 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767592 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767620 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767658 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767707 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767730 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767765 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767799 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.767853 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.767803 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.768489 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.768465 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.768489 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.768465 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.769232 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.769027 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.770652 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.769655 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.770652 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.769878 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.770652 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.770469 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.770652 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.770617 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.770936 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.770897 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.771621 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.771597 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.772072 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.772043 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.772163 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.772084 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.772484 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.772460 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.772693 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.772641 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-config\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.772802 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.772767 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.773113 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.773091 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.773200 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.773145 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.773842 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.773822 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.774956 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.774937 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdr8l\" (UniqueName: \"kubernetes.io/projected/0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b-kube-api-access-mdr8l\") pod \"prometheus-k8s-0\" (UID: \"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:55.876265 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:55.876225 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:49:56.159848 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:56.159771 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 17:49:56.163451 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:49:56.163422 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9ba632_ea0a_434f_b6c8_e1bd565e4a6b.slice/crio-2e90a25460080d999fc7f687b905ff3e075eaaa062ff076da50496bc5e6bf212 WatchSource:0}: Error finding container 2e90a25460080d999fc7f687b905ff3e075eaaa062ff076da50496bc5e6bf212: Status 404 returned error can't find the container with id 2e90a25460080d999fc7f687b905ff3e075eaaa062ff076da50496bc5e6bf212 Sep 10 17:49:56.518636 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:56.518602 2588 generic.go:356] "Generic (PLEG): container finished" podID="0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b" containerID="9959aa31aa1a5c15a357580aec5be2e7f9eaca179061b6a965a14265ee9b3fa0" exitCode=0 Sep 10 17:49:56.518807 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:56.518648 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b","Type":"ContainerDied","Data":"9959aa31aa1a5c15a357580aec5be2e7f9eaca179061b6a965a14265ee9b3fa0"} Sep 10 17:49:56.518807 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:56.518696 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b","Type":"ContainerStarted","Data":"2e90a25460080d999fc7f687b905ff3e075eaaa062ff076da50496bc5e6bf212"} Sep 10 17:49:57.122971 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.122892 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e97f0b-d2f2-4be5-a252-2e5bbd485634" path="/var/lib/kubelet/pods/96e97f0b-d2f2-4be5-a252-2e5bbd485634/volumes" Sep 10 17:49:57.526053 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.526016 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b","Type":"ContainerStarted","Data":"5414d4ea25ec37e08ec6d0d6bf50fe810d02caf47924cddada420d2062596a92"} Sep 10 17:49:57.526217 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.526096 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b","Type":"ContainerStarted","Data":"a326229c87059e3080f1aa16370b3fb1531d25c6a0c26ae9a75fd74799296e5e"} Sep 10 17:49:57.526217 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.526135 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b","Type":"ContainerStarted","Data":"03ccab13f7282d6025fcae1198f0fe3562792a582c3636a49cbadb07b93f996a"} Sep 10 17:49:57.526217 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.526171 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b","Type":"ContainerStarted","Data":"c893e50a3d1fd50d9ce0903fa1e466d6a36c56125e31c317813aff1b74d2f346"} Sep 10 17:49:57.526217 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.526205 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b","Type":"ContainerStarted","Data":"0a8b48d717f3d7fc60fae7364f4acdf78e025fb1535f6acda91a009c364b21fe"} Sep 10 17:49:57.526477 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.526245 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b","Type":"ContainerStarted","Data":"20fbf02c515bbcd549ba0a77deca8f9e1ff4c6001705bea7da72e2c90277974c"} Sep 10 17:49:57.553737 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.553678 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.534091287 podStartE2EDuration="2.553656344s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.565057ms" isStatefulPod=false podCreationTimestamp="2026-09-10 17:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:49:57.550947015 +0000 UTC m=+394.945396270" watchObservedRunningTime="2026-09-10 17:49:57.553656344 +0000 UTC m=+394.948105600" Sep 10 17:49:57.888306 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.888222 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:57.983698 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:57.983658 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:58.113415 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:58.113382 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:58.216793 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:58.216709 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:49:58.315962 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:49:58.315927 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:00.876372 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:00.876336 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:50:08.132806 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:08.132763 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:08.201577 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:08.201540 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:11.350719 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:11.350684 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:11.451502 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:11.451460 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:32.674533 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:32.674500 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:32.730721 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:32.730689 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:42.333957 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:42.333913 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:42.433170 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:42.433134 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:50:55.876976 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:55.876878 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:50:55.892674 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:55.892646 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:50:56.766519 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:50:56.766491 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 17:51:09.523742 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:09.523698 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:09.645281 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:09.645250 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:13.117728 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:13.117688 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:13.171164 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:13.171132 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:14.496896 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:14.496860 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:14.614545 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:14.614484 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:14.743830 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:14.743793 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:14.851989 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:14.851880 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:16.890076 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:16.890020 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:17.304214 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:17.304171 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:19.713085 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:19.713034 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:19.773558 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:19.773515 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:25.106617 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:25.106578 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:26.781997 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:26.781959 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:26.877783 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:26.877748 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:28.506395 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.506360 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq"] Sep 10 17:51:28.509484 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.509467 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" Sep 10 17:51:28.511601 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.511581 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:51:28.512105 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.512079 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hhk6w\"" Sep 10 17:51:28.512201 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.512135 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 17:51:28.519648 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.519626 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq"] Sep 10 17:51:28.633525 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.633491 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvnr\" (UniqueName: \"kubernetes.io/projected/4d3f7275-606e-4b1b-914d-2d54632d6aa1-kube-api-access-8cvnr\") pod \"openshift-lws-operator-fd8ccff4c-58zbq\" (UID: \"4d3f7275-606e-4b1b-914d-2d54632d6aa1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" Sep 10 17:51:28.633698 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.633536 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d3f7275-606e-4b1b-914d-2d54632d6aa1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-58zbq\" (UID: \"4d3f7275-606e-4b1b-914d-2d54632d6aa1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" Sep 10 17:51:28.734276 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.734236 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvnr\" (UniqueName: \"kubernetes.io/projected/4d3f7275-606e-4b1b-914d-2d54632d6aa1-kube-api-access-8cvnr\") pod \"openshift-lws-operator-fd8ccff4c-58zbq\" (UID: \"4d3f7275-606e-4b1b-914d-2d54632d6aa1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" Sep 10 17:51:28.734276 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.734282 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d3f7275-606e-4b1b-914d-2d54632d6aa1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-58zbq\" (UID: \"4d3f7275-606e-4b1b-914d-2d54632d6aa1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" Sep 10 17:51:28.734722 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.734695 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d3f7275-606e-4b1b-914d-2d54632d6aa1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-58zbq\" (UID: \"4d3f7275-606e-4b1b-914d-2d54632d6aa1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" Sep 10 17:51:28.741919 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.741890 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvnr\" (UniqueName: \"kubernetes.io/projected/4d3f7275-606e-4b1b-914d-2d54632d6aa1-kube-api-access-8cvnr\") pod \"openshift-lws-operator-fd8ccff4c-58zbq\" (UID: \"4d3f7275-606e-4b1b-914d-2d54632d6aa1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" Sep 10 17:51:28.818435 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:28.818349 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" Sep 10 17:51:29.088842 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:29.088754 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq"] Sep 10 17:51:29.095167 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:51:29.094866 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d3f7275_606e_4b1b_914d_2d54632d6aa1.slice/crio-8675a7f2485071a7b92876eeb66550bd1cad60079d5c75648275147713b41813 WatchSource:0}: Error finding container 8675a7f2485071a7b92876eeb66550bd1cad60079d5c75648275147713b41813: Status 404 returned error can't find the container with id 8675a7f2485071a7b92876eeb66550bd1cad60079d5c75648275147713b41813 Sep 10 17:51:29.879869 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:29.879822 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" event={"ID":"4d3f7275-606e-4b1b-914d-2d54632d6aa1","Type":"ContainerStarted","Data":"8675a7f2485071a7b92876eeb66550bd1cad60079d5c75648275147713b41813"} Sep 10 17:51:31.891514 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:31.891474 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" event={"ID":"4d3f7275-606e-4b1b-914d-2d54632d6aa1","Type":"ContainerStarted","Data":"17da9a75fa4a5157c12a1c2470e6aeefcf61865dbbd10bf631b99201fc7716ff"} Sep 10 17:51:31.907357 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:31.907281 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58zbq" podStartSLOduration=1.664865318 podStartE2EDuration="3.907262399s" totalImagesPullingTime="2.242397081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:51:31.906230011 +0000 UTC m=+489.300679265" watchObservedRunningTime="2026-09-10 17:51:31.907262399 +0000 UTC m=+489.301711656" Sep 10 17:51:32.593023 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:32.592980 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:32.692278 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:32.692238 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:34.797484 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:34.797441 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:42.321517 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:42.321480 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:45.945442 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:45.945408 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:46.044201 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.044162 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:46.561616 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.561577 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:46.769895 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.769862 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:46.872519 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.872427 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:46.913402 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.913372 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4"] Sep 10 17:51:46.920066 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.920047 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:46.922149 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.922127 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 17:51:46.922391 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.922372 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 17:51:46.922509 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.922394 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 17:51:46.922509 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.922412 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 17:51:46.922509 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.922468 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-65whl\"" Sep 10 17:51:46.929145 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.929123 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4"] Sep 10 17:51:46.986694 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.986660 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61dec93-4646-4098-8879-9750f11f2fd3-tmp\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:46.986694 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.986693 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f61dec93-4646-4098-8879-9750f11f2fd3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:46.987114 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.986731 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f61dec93-4646-4098-8879-9750f11f2fd3-manifests\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:46.987114 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.986749 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz7g4\" (UniqueName: \"kubernetes.io/projected/f61dec93-4646-4098-8879-9750f11f2fd3-kube-api-access-gz7g4\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:46.987114 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:46.986779 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f61dec93-4646-4098-8879-9750f11f2fd3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.040021 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.039984 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:47.087271 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.087223 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz7g4\" (UniqueName: \"kubernetes.io/projected/f61dec93-4646-4098-8879-9750f11f2fd3-kube-api-access-gz7g4\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.087476 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.087304 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f61dec93-4646-4098-8879-9750f11f2fd3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.087476 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.087370 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61dec93-4646-4098-8879-9750f11f2fd3-tmp\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.087476 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.087396 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f61dec93-4646-4098-8879-9750f11f2fd3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.087476 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.087469 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f61dec93-4646-4098-8879-9750f11f2fd3-manifests\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.087896 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.087868 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f61dec93-4646-4098-8879-9750f11f2fd3-manifests\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.096354 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.095926 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f61dec93-4646-4098-8879-9750f11f2fd3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.096790 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.096771 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61dec93-4646-4098-8879-9750f11f2fd3-tmp\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.097804 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.097778 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f61dec93-4646-4098-8879-9750f11f2fd3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.101934 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.101888 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz7g4\" (UniqueName: \"kubernetes.io/projected/f61dec93-4646-4098-8879-9750f11f2fd3-kube-api-access-gz7g4\") pod \"opendatahub-operator-controller-manager-86cbcccc5-7q8l4\" (UID: \"f61dec93-4646-4098-8879-9750f11f2fd3\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.144656 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.144562 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:47.230528 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.230485 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:47.239086 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.239055 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:47.340964 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.340933 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:47.443097 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.443010 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:47.510681 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.510648 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4"] Sep 10 17:51:47.513679 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:51:47.513651 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61dec93_4646_4098_8879_9750f11f2fd3.slice/crio-390e6c2d3a386c8e7a9cba65ff334d75b5e8f1d1f3f5a5c6e0258c0713d6f35e WatchSource:0}: Error finding container 390e6c2d3a386c8e7a9cba65ff334d75b5e8f1d1f3f5a5c6e0258c0713d6f35e: Status 404 returned error can't find the container with id 390e6c2d3a386c8e7a9cba65ff334d75b5e8f1d1f3f5a5c6e0258c0713d6f35e Sep 10 17:51:47.522805 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.522780 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:51:47.953461 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:47.953431 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" event={"ID":"f61dec93-4646-4098-8879-9750f11f2fd3","Type":"ContainerStarted","Data":"390e6c2d3a386c8e7a9cba65ff334d75b5e8f1d1f3f5a5c6e0258c0713d6f35e"} Sep 10 17:51:50.968419 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:50.968300 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" event={"ID":"f61dec93-4646-4098-8879-9750f11f2fd3","Type":"ContainerStarted","Data":"78a1859f35e61891f31402811e8b12021cec7cde1c736d0319e944d033d6ad2f"} Sep 10 17:51:51.974655 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:51.974569 2588 generic.go:356] "Generic (PLEG): container finished" podID="f61dec93-4646-4098-8879-9750f11f2fd3" containerID="78a1859f35e61891f31402811e8b12021cec7cde1c736d0319e944d033d6ad2f" exitCode=0 Sep 10 17:51:51.974655 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:51.974606 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" event={"ID":"f61dec93-4646-4098-8879-9750f11f2fd3","Type":"ContainerDied","Data":"78a1859f35e61891f31402811e8b12021cec7cde1c736d0319e944d033d6ad2f"} Sep 10 17:51:52.981189 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:52.981153 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" event={"ID":"f61dec93-4646-4098-8879-9750f11f2fd3","Type":"ContainerStarted","Data":"aea9f014470fb8b39ed4f6ee5a4bb9791550494570bdcd70aae59720b0051766"} Sep 10 17:51:52.981608 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:52.981269 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:51:53.002675 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:51:53.002620 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" podStartSLOduration=2.647389187 podStartE2EDuration="7.002595281s" totalImagesPullingTime="3.300421619s" totalInitContainerRuntime="1.054784475s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:51:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:51:53.001421726 +0000 UTC m=+510.395870982" watchObservedRunningTime="2026-09-10 17:51:53.002595281 +0000 UTC m=+510.397044537" Sep 10 17:52:03.987905 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:03.987872 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-7q8l4" Sep 10 17:52:04.913531 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:04.913492 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:05.012075 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:05.012042 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:05.975700 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:05.975665 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:06.142871 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.142838 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:06.367428 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.367389 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:06.539724 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.539674 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:06.720212 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.720128 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:06.818305 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.818255 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:06.818860 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.818833 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq"] Sep 10 17:52:06.827083 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.827060 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:06.830282 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.830260 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bvbx7\"" Sep 10 17:52:06.830282 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.830271 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 17:52:06.830706 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.830288 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 17:52:06.830706 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.830273 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 17:52:06.832705 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.832684 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq"] Sep 10 17:52:06.972274 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.972199 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d2bdb73-e560-4f65-9239-6dfbe45bf906-manager-config\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:06.972274 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.972241 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kfmb\" (UniqueName: \"kubernetes.io/projected/1d2bdb73-e560-4f65-9239-6dfbe45bf906-kube-api-access-4kfmb\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:06.972481 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.972277 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d2bdb73-e560-4f65-9239-6dfbe45bf906-cert\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:06.972481 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:06.972419 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d2bdb73-e560-4f65-9239-6dfbe45bf906-metrics-cert\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.072817 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.072781 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d2bdb73-e560-4f65-9239-6dfbe45bf906-cert\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.072989 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.072845 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d2bdb73-e560-4f65-9239-6dfbe45bf906-metrics-cert\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.072989 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.072864 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d2bdb73-e560-4f65-9239-6dfbe45bf906-manager-config\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.072989 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.072889 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kfmb\" (UniqueName: \"kubernetes.io/projected/1d2bdb73-e560-4f65-9239-6dfbe45bf906-kube-api-access-4kfmb\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.073603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.073581 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d2bdb73-e560-4f65-9239-6dfbe45bf906-manager-config\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.075427 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.075405 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d2bdb73-e560-4f65-9239-6dfbe45bf906-metrics-cert\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.075519 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.075447 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d2bdb73-e560-4f65-9239-6dfbe45bf906-cert\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.090611 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.090586 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kfmb\" (UniqueName: \"kubernetes.io/projected/1d2bdb73-e560-4f65-9239-6dfbe45bf906-kube-api-access-4kfmb\") pod \"lws-controller-manager-6547fb5f9d-8svjq\" (UID: \"1d2bdb73-e560-4f65-9239-6dfbe45bf906\") " pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.136653 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.136623 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:07.413267 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.413232 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq"] Sep 10 17:52:07.415770 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:52:07.415740 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2bdb73_e560_4f65_9239_6dfbe45bf906.slice/crio-826d521e99d99da3d38af47dfa569d94d6ac1c3b798bcd3569fbef6d37e8e8d4 WatchSource:0}: Error finding container 826d521e99d99da3d38af47dfa569d94d6ac1c3b798bcd3569fbef6d37e8e8d4: Status 404 returned error can't find the container with id 826d521e99d99da3d38af47dfa569d94d6ac1c3b798bcd3569fbef6d37e8e8d4 Sep 10 17:52:07.814150 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.814086 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:07.906690 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:07.906652 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:08.045051 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:08.045012 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" event={"ID":"1d2bdb73-e560-4f65-9239-6dfbe45bf906","Type":"ContainerStarted","Data":"826d521e99d99da3d38af47dfa569d94d6ac1c3b798bcd3569fbef6d37e8e8d4"} Sep 10 17:52:08.846266 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:08.846229 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:09.051658 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:09.051624 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" event={"ID":"1d2bdb73-e560-4f65-9239-6dfbe45bf906","Type":"ContainerStarted","Data":"094ee77611101c51433b3c3fc55d80e0392646c3d29426dd3351b98f3d40b1b9"} Sep 10 17:52:09.051827 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:09.051684 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:09.068496 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:09.068421 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" podStartSLOduration=1.856062805 podStartE2EDuration="3.068404707s" totalImagesPullingTime="1.212341902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:09.067617682 +0000 UTC m=+526.462066968" watchObservedRunningTime="2026-09-10 17:52:09.068404707 +0000 UTC m=+526.462853961" Sep 10 17:52:11.761720 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:11.761680 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:12.605938 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:12.605899 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:12.714885 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:12.714854 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:13.182905 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:13.182868 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:13.388421 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:13.388387 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:13.478558 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:13.478526 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:17.104205 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.104114 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4mvbv"] Sep 10 17:52:17.109699 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.109670 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:17.112240 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.112190 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bgphf\"" Sep 10 17:52:17.112410 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.112196 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 10 17:52:17.138166 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.138130 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:17.139432 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.139407 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4mvbv"] Sep 10 17:52:17.209797 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.209727 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:17.265588 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.265548 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f765n\" (UniqueName: \"kubernetes.io/projected/2cc58564-94ab-4590-8d92-4da5607ad7d3-kube-api-access-f765n\") pod \"odh-model-controller-7998c67dc4-4mvbv\" (UID: \"2cc58564-94ab-4590-8d92-4da5607ad7d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:17.265783 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.265602 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cc58564-94ab-4590-8d92-4da5607ad7d3-cert\") pod \"odh-model-controller-7998c67dc4-4mvbv\" (UID: \"2cc58564-94ab-4590-8d92-4da5607ad7d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:17.309115 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.309064 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:17.366464 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.366376 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f765n\" (UniqueName: \"kubernetes.io/projected/2cc58564-94ab-4590-8d92-4da5607ad7d3-kube-api-access-f765n\") pod \"odh-model-controller-7998c67dc4-4mvbv\" (UID: \"2cc58564-94ab-4590-8d92-4da5607ad7d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:17.366464 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.366414 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cc58564-94ab-4590-8d92-4da5607ad7d3-cert\") pod \"odh-model-controller-7998c67dc4-4mvbv\" (UID: \"2cc58564-94ab-4590-8d92-4da5607ad7d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:17.368860 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.368833 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cc58564-94ab-4590-8d92-4da5607ad7d3-cert\") pod \"odh-model-controller-7998c67dc4-4mvbv\" (UID: \"2cc58564-94ab-4590-8d92-4da5607ad7d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:17.374054 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.374029 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f765n\" (UniqueName: \"kubernetes.io/projected/2cc58564-94ab-4590-8d92-4da5607ad7d3-kube-api-access-f765n\") pod \"odh-model-controller-7998c67dc4-4mvbv\" (UID: \"2cc58564-94ab-4590-8d92-4da5607ad7d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:17.408579 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.408549 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:17.425534 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.425504 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:17.503863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.503818 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:17.689402 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.689305 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q2rk2"] Sep 10 17:52:17.693867 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.693846 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:17.696629 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.696609 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 10 17:52:17.703249 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.703209 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q2rk2"] Sep 10 17:52:17.712826 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.712755 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4mvbv"] Sep 10 17:52:17.717534 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.717462 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:17.871516 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.871478 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfvg\" (UniqueName: \"kubernetes.io/projected/cb7e4090-579b-4237-99ab-8bb24bfe4489-kube-api-access-4dfvg\") pod \"model-serving-api-54d89bd5fc-q2rk2\" (UID: \"cb7e4090-579b-4237-99ab-8bb24bfe4489\") " pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:17.871688 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.871624 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7e4090-579b-4237-99ab-8bb24bfe4489-tls-certs\") pod \"model-serving-api-54d89bd5fc-q2rk2\" (UID: \"cb7e4090-579b-4237-99ab-8bb24bfe4489\") " pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:17.972787 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.972700 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7e4090-579b-4237-99ab-8bb24bfe4489-tls-certs\") pod \"model-serving-api-54d89bd5fc-q2rk2\" (UID: \"cb7e4090-579b-4237-99ab-8bb24bfe4489\") " pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:17.972787 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.972753 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfvg\" (UniqueName: \"kubernetes.io/projected/cb7e4090-579b-4237-99ab-8bb24bfe4489-kube-api-access-4dfvg\") pod \"model-serving-api-54d89bd5fc-q2rk2\" (UID: \"cb7e4090-579b-4237-99ab-8bb24bfe4489\") " pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:17.973028 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:52:17.972864 2588 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 10 17:52:17.973028 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:52:17.972940 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7e4090-579b-4237-99ab-8bb24bfe4489-tls-certs podName:cb7e4090-579b-4237-99ab-8bb24bfe4489 nodeName:}" failed. No retries permitted until 2026-09-10 17:52:18.472920635 +0000 UTC m=+535.867369886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cb7e4090-579b-4237-99ab-8bb24bfe4489-tls-certs") pod "model-serving-api-54d89bd5fc-q2rk2" (UID: "cb7e4090-579b-4237-99ab-8bb24bfe4489") : secret "model-serving-api-tls" not found Sep 10 17:52:17.983481 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:17.983454 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfvg\" (UniqueName: \"kubernetes.io/projected/cb7e4090-579b-4237-99ab-8bb24bfe4489-kube-api-access-4dfvg\") pod \"model-serving-api-54d89bd5fc-q2rk2\" (UID: \"cb7e4090-579b-4237-99ab-8bb24bfe4489\") " pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:18.093459 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:18.093421 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" event={"ID":"2cc58564-94ab-4590-8d92-4da5607ad7d3","Type":"ContainerStarted","Data":"6ae235dc7c83c3c021f2cc0533bb02a577969dde4fe208e647f5c040e889960d"} Sep 10 17:52:18.099244 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:18.099208 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:18.477236 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:18.477200 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7e4090-579b-4237-99ab-8bb24bfe4489-tls-certs\") pod \"model-serving-api-54d89bd5fc-q2rk2\" (UID: \"cb7e4090-579b-4237-99ab-8bb24bfe4489\") " pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:18.480132 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:18.480100 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7e4090-579b-4237-99ab-8bb24bfe4489-tls-certs\") pod \"model-serving-api-54d89bd5fc-q2rk2\" (UID: \"cb7e4090-579b-4237-99ab-8bb24bfe4489\") " pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:18.606538 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:18.606498 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:18.898073 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:18.898040 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-q2rk2"] Sep 10 17:52:18.900524 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:52:18.900491 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7e4090_579b_4237_99ab_8bb24bfe4489.slice/crio-67afa26d31a956cb7686675f82e997d359e23634df1a902bfb54a1ff74f5d1e6 WatchSource:0}: Error finding container 67afa26d31a956cb7686675f82e997d359e23634df1a902bfb54a1ff74f5d1e6: Status 404 returned error can't find the container with id 67afa26d31a956cb7686675f82e997d359e23634df1a902bfb54a1ff74f5d1e6 Sep 10 17:52:19.099128 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:19.099086 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" event={"ID":"cb7e4090-579b-4237-99ab-8bb24bfe4489","Type":"ContainerStarted","Data":"67afa26d31a956cb7686675f82e997d359e23634df1a902bfb54a1ff74f5d1e6"} Sep 10 17:52:20.058668 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:20.058619 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6547fb5f9d-8svjq" Sep 10 17:52:21.129560 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:21.129508 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:21.130033 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:21.129564 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" event={"ID":"2cc58564-94ab-4590-8d92-4da5607ad7d3","Type":"ContainerStarted","Data":"e77150f02cdcc2a6e343e732909bf1de37f5c6ae677a9ebc333b2a0ad138df4b"} Sep 10 17:52:21.137173 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:21.136736 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" podStartSLOduration=1.236349039 podStartE2EDuration="4.136715331s" totalImagesPullingTime="2.900366292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:21.136574903 +0000 UTC m=+538.531024159" watchObservedRunningTime="2026-09-10 17:52:21.136715331 +0000 UTC m=+538.531164587" Sep 10 17:52:23.129017 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:23.128925 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" event={"ID":"cb7e4090-579b-4237-99ab-8bb24bfe4489","Type":"ContainerStarted","Data":"261b9ea56dad4d1e2dfea8152be161b0256abbdcffbfb1d0a4974a346bf5fa56"} Sep 10 17:52:23.129370 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:23.129037 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:23.153765 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:23.153721 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" podStartSLOduration=2.28660093 podStartE2EDuration="6.153705181s" totalImagesPullingTime="3.867104251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:23.153128733 +0000 UTC m=+540.547578014" watchObservedRunningTime="2026-09-10 17:52:23.153705181 +0000 UTC m=+540.548154438" Sep 10 17:52:27.411223 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.411125 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:27.472903 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.472870 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8phqs"] Sep 10 17:52:27.483912 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.479246 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:27.483912 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.482671 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 10 17:52:27.483912 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.482745 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vkr7b\"" Sep 10 17:52:27.492119 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.492089 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8phqs"] Sep 10 17:52:27.514152 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.514122 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:27.559215 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.559181 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/403dd2a1-f20b-4b9e-9718-cb1806294ff1-cert\") pod \"kserve-controller-manager-d6f4b65b8-8phqs\" (UID: \"403dd2a1-f20b-4b9e-9718-cb1806294ff1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:27.559397 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.559242 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ldxm\" (UniqueName: \"kubernetes.io/projected/403dd2a1-f20b-4b9e-9718-cb1806294ff1-kube-api-access-6ldxm\") pod \"kserve-controller-manager-d6f4b65b8-8phqs\" (UID: \"403dd2a1-f20b-4b9e-9718-cb1806294ff1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:27.659791 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.659759 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/403dd2a1-f20b-4b9e-9718-cb1806294ff1-cert\") pod \"kserve-controller-manager-d6f4b65b8-8phqs\" (UID: \"403dd2a1-f20b-4b9e-9718-cb1806294ff1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:27.659999 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.659813 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ldxm\" (UniqueName: \"kubernetes.io/projected/403dd2a1-f20b-4b9e-9718-cb1806294ff1-kube-api-access-6ldxm\") pod \"kserve-controller-manager-d6f4b65b8-8phqs\" (UID: \"403dd2a1-f20b-4b9e-9718-cb1806294ff1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:27.659999 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:52:27.659930 2588 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 10 17:52:27.660111 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:52:27.660024 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/403dd2a1-f20b-4b9e-9718-cb1806294ff1-cert podName:403dd2a1-f20b-4b9e-9718-cb1806294ff1 nodeName:}" failed. No retries permitted until 2026-09-10 17:52:28.160001316 +0000 UTC m=+545.554450566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/403dd2a1-f20b-4b9e-9718-cb1806294ff1-cert") pod "kserve-controller-manager-d6f4b65b8-8phqs" (UID: "403dd2a1-f20b-4b9e-9718-cb1806294ff1") : secret "kserve-webhook-server-cert" not found Sep 10 17:52:27.674754 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.674694 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ldxm\" (UniqueName: \"kubernetes.io/projected/403dd2a1-f20b-4b9e-9718-cb1806294ff1-kube-api-access-6ldxm\") pod \"kserve-controller-manager-d6f4b65b8-8phqs\" (UID: \"403dd2a1-f20b-4b9e-9718-cb1806294ff1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:27.737108 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.737073 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:27.827485 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:27.827449 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:28.165639 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:28.165604 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/403dd2a1-f20b-4b9e-9718-cb1806294ff1-cert\") pod \"kserve-controller-manager-d6f4b65b8-8phqs\" (UID: \"403dd2a1-f20b-4b9e-9718-cb1806294ff1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:28.167966 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:28.167937 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/403dd2a1-f20b-4b9e-9718-cb1806294ff1-cert\") pod \"kserve-controller-manager-d6f4b65b8-8phqs\" (UID: \"403dd2a1-f20b-4b9e-9718-cb1806294ff1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:28.393356 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:28.393298 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:28.671686 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:28.671658 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8phqs"] Sep 10 17:52:28.673871 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:52:28.673838 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403dd2a1_f20b_4b9e_9718_cb1806294ff1.slice/crio-bb80487f7baa00f7b4a212066bd73e5f594540e9d0cf087e36a9857cb8cb448a WatchSource:0}: Error finding container bb80487f7baa00f7b4a212066bd73e5f594540e9d0cf087e36a9857cb8cb448a: Status 404 returned error can't find the container with id bb80487f7baa00f7b4a212066bd73e5f594540e9d0cf087e36a9857cb8cb448a Sep 10 17:52:28.731836 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:28.731799 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:28.826987 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:28.826957 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:28.903417 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:28.903383 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:52:29.155038 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:29.154953 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" event={"ID":"403dd2a1-f20b-4b9e-9718-cb1806294ff1","Type":"ContainerStarted","Data":"bb80487f7baa00f7b4a212066bd73e5f594540e9d0cf087e36a9857cb8cb448a"} Sep 10 17:52:31.165145 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:31.165061 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" event={"ID":"403dd2a1-f20b-4b9e-9718-cb1806294ff1","Type":"ContainerStarted","Data":"88b7baedae922f45077a3c9294eeb66d9b5885464177069a4b91e58dab4a2cef"} Sep 10 17:52:31.165145 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:31.165133 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:52:31.182780 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:31.182730 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" podStartSLOduration=1.959210117 podStartE2EDuration="4.182713287s" totalImagesPullingTime="2.22350317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:31.181581238 +0000 UTC m=+548.576030493" watchObservedRunningTime="2026-09-10 17:52:31.182713287 +0000 UTC m=+548.577162565" Sep 10 17:52:32.126352 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:32.126295 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4mvbv" Sep 10 17:52:34.138250 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:34.138222 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-q2rk2" Sep 10 17:52:47.454473 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:52:47.454422 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:02.175932 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:02.175903 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8phqs" Sep 10 17:53:20.458794 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:20.458754 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:20.555597 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:20.555570 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:22.360026 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:22.359987 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:22.410775 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:22.410741 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:23.056714 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:23.056683 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:53:23.058810 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:23.058786 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:53:23.990651 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:23.990613 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:28.489104 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:28.489070 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:45.536438 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:45.536357 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:45.635202 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:45.635169 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:45.739230 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:45.739194 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:46.269873 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:46.269834 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:46.327143 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:46.327108 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:50.696985 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:50.696938 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:50.751479 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:50.751448 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:55.988918 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:55.988881 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:56.050525 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:56.050485 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:53:56.103385 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:53:56.103359 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:54:13.817216 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:54:13.817179 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:54:25.005656 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:54:25.005619 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:56:19.636362 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:56:19.636326 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:15.410096 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:15.410061 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:19.792630 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:19.792576 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:19.888076 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:19.888045 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:33.833230 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:33.833195 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:35.872827 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:35.872788 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78"] Sep 10 17:57:35.875903 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:35.875880 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:35.878089 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:35.878070 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 17:57:35.878946 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:35.878921 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qnzxv\"" Sep 10 17:57:35.879051 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:35.878926 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 17:57:35.890443 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:35.890411 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78"] Sep 10 17:57:35.936812 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:35.936769 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969r6\" (UniqueName: \"kubernetes.io/projected/d7b6dc6c-855f-4db1-bc90-2548cd5e9240-kube-api-access-969r6\") pod \"limitador-operator-controller-manager-74495c69f8-65c78\" (UID: \"d7b6dc6c-855f-4db1-bc90-2548cd5e9240\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:36.037394 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:36.037298 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-969r6\" (UniqueName: \"kubernetes.io/projected/d7b6dc6c-855f-4db1-bc90-2548cd5e9240-kube-api-access-969r6\") pod \"limitador-operator-controller-manager-74495c69f8-65c78\" (UID: \"d7b6dc6c-855f-4db1-bc90-2548cd5e9240\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:36.048877 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:36.048852 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-969r6\" (UniqueName: \"kubernetes.io/projected/d7b6dc6c-855f-4db1-bc90-2548cd5e9240-kube-api-access-969r6\") pod \"limitador-operator-controller-manager-74495c69f8-65c78\" (UID: \"d7b6dc6c-855f-4db1-bc90-2548cd5e9240\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:36.195044 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:36.194953 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:36.422943 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:36.422912 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:36.467988 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:36.467961 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78"] Sep 10 17:57:36.470694 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:57:36.470668 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b6dc6c_855f_4db1_bc90_2548cd5e9240.slice/crio-c70f204bff2ebcbd31b99030da9fc32db5a3072e5def97b58df0443b3bcd88d5 WatchSource:0}: Error finding container c70f204bff2ebcbd31b99030da9fc32db5a3072e5def97b58df0443b3bcd88d5: Status 404 returned error can't find the container with id c70f204bff2ebcbd31b99030da9fc32db5a3072e5def97b58df0443b3bcd88d5 Sep 10 17:57:36.472856 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:36.472837 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:57:36.484207 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:36.484180 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" event={"ID":"d7b6dc6c-855f-4db1-bc90-2548cd5e9240","Type":"ContainerStarted","Data":"c70f204bff2ebcbd31b99030da9fc32db5a3072e5def97b58df0443b3bcd88d5"} Sep 10 17:57:36.815641 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:36.815609 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:37.239209 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:37.239169 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:39.503716 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:39.503679 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" event={"ID":"d7b6dc6c-855f-4db1-bc90-2548cd5e9240","Type":"ContainerStarted","Data":"95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d"} Sep 10 17:57:39.504136 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:39.503795 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:39.519935 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:39.519885 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" podStartSLOduration=2.077475624 podStartE2EDuration="4.519867229s" totalImagesPullingTime="2.442391605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:39.518888059 +0000 UTC m=+856.913337315" watchObservedRunningTime="2026-09-10 17:57:39.519867229 +0000 UTC m=+856.914316487" Sep 10 17:57:40.095334 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:40.095277 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:40.839627 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:40.839595 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:41.120233 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:41.120098 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:41.212568 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:41.212492 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:42.175125 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.175088 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn"] Sep 10 17:57:42.178758 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.178733 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" Sep 10 17:57:42.181187 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.181165 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jjckl\"" Sep 10 17:57:42.181339 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.181230 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 10 17:57:42.188916 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.188894 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn"] Sep 10 17:57:42.293869 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.293828 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jbsw\" (UniqueName: \"kubernetes.io/projected/68abdb0b-6921-4b9a-ae2d-0f91b780254c-kube-api-access-6jbsw\") pod \"dns-operator-controller-manager-7b84cd7c9c-cnldn\" (UID: \"68abdb0b-6921-4b9a-ae2d-0f91b780254c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" Sep 10 17:57:42.394786 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.394743 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jbsw\" (UniqueName: \"kubernetes.io/projected/68abdb0b-6921-4b9a-ae2d-0f91b780254c-kube-api-access-6jbsw\") pod \"dns-operator-controller-manager-7b84cd7c9c-cnldn\" (UID: \"68abdb0b-6921-4b9a-ae2d-0f91b780254c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" Sep 10 17:57:42.404113 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.404076 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jbsw\" (UniqueName: \"kubernetes.io/projected/68abdb0b-6921-4b9a-ae2d-0f91b780254c-kube-api-access-6jbsw\") pod \"dns-operator-controller-manager-7b84cd7c9c-cnldn\" (UID: \"68abdb0b-6921-4b9a-ae2d-0f91b780254c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" Sep 10 17:57:42.420029 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.419990 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:42.489432 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.489408 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" Sep 10 17:57:42.679781 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.679747 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:42.760602 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.760572 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn"] Sep 10 17:57:42.763110 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:57:42.763075 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68abdb0b_6921_4b9a_ae2d_0f91b780254c.slice/crio-cfc080a1c69c33edd87dd3d24e14e6000bb798553e731708d5d9d784404c536c WatchSource:0}: Error finding container cfc080a1c69c33edd87dd3d24e14e6000bb798553e731708d5d9d784404c536c: Status 404 returned error can't find the container with id cfc080a1c69c33edd87dd3d24e14e6000bb798553e731708d5d9d784404c536c Sep 10 17:57:42.830898 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.830868 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:42.997283 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:42.997250 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:43.524426 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:43.524388 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" event={"ID":"68abdb0b-6921-4b9a-ae2d-0f91b780254c","Type":"ContainerStarted","Data":"cfc080a1c69c33edd87dd3d24e14e6000bb798553e731708d5d9d784404c536c"} Sep 10 17:57:44.127192 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:44.127042 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:45.124346 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.124249 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-xt9bs"] Sep 10 17:57:45.127622 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.127605 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" Sep 10 17:57:45.130676 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.130654 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zcwd9\"" Sep 10 17:57:45.148663 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.148639 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-xt9bs"] Sep 10 17:57:45.230496 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.230457 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4mn8\" (UniqueName: \"kubernetes.io/projected/39809583-96ab-4853-8df7-8f3519fbfb63-kube-api-access-w4mn8\") pod \"authorino-operator-76b478bd78-xt9bs\" (UID: \"39809583-96ab-4853-8df7-8f3519fbfb63\") " pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" Sep 10 17:57:45.331751 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.331720 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4mn8\" (UniqueName: \"kubernetes.io/projected/39809583-96ab-4853-8df7-8f3519fbfb63-kube-api-access-w4mn8\") pod \"authorino-operator-76b478bd78-xt9bs\" (UID: \"39809583-96ab-4853-8df7-8f3519fbfb63\") " pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" Sep 10 17:57:45.345361 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.345331 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4mn8\" (UniqueName: \"kubernetes.io/projected/39809583-96ab-4853-8df7-8f3519fbfb63-kube-api-access-w4mn8\") pod \"authorino-operator-76b478bd78-xt9bs\" (UID: \"39809583-96ab-4853-8df7-8f3519fbfb63\") " pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" Sep 10 17:57:45.438426 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.438346 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" Sep 10 17:57:45.537216 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.537176 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" event={"ID":"68abdb0b-6921-4b9a-ae2d-0f91b780254c","Type":"ContainerStarted","Data":"6a46080a697e1b983841f8a161d14eac61e4993675752a850f75fc273c914344"} Sep 10 17:57:45.537402 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.537267 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" Sep 10 17:57:45.554604 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.554558 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" podStartSLOduration=1.504971522 podStartE2EDuration="3.554542595s" totalImagesPullingTime="2.049571073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:45.552136298 +0000 UTC m=+862.946585553" watchObservedRunningTime="2026-09-10 17:57:45.554542595 +0000 UTC m=+862.948991850" Sep 10 17:57:45.712823 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:45.712793 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-xt9bs"] Sep 10 17:57:45.715427 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:57:45.715384 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39809583_96ab_4853_8df7_8f3519fbfb63.slice/crio-b7de2d2f79a45b75925d8e75379ba6f6f95457f45a402c9afff93ac675eaa2b3 WatchSource:0}: Error finding container b7de2d2f79a45b75925d8e75379ba6f6f95457f45a402c9afff93ac675eaa2b3: Status 404 returned error can't find the container with id b7de2d2f79a45b75925d8e75379ba6f6f95457f45a402c9afff93ac675eaa2b3 Sep 10 17:57:46.448876 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:46.448830 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:46.541606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:46.541569 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:46.544763 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:46.544734 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" event={"ID":"39809583-96ab-4853-8df7-8f3519fbfb63","Type":"ContainerStarted","Data":"b7de2d2f79a45b75925d8e75379ba6f6f95457f45a402c9afff93ac675eaa2b3"} Sep 10 17:57:47.094217 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:47.094181 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:47.381733 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:47.381699 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:47.551394 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:47.551353 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" event={"ID":"39809583-96ab-4853-8df7-8f3519fbfb63","Type":"ContainerStarted","Data":"321a94309cc05f718c69277307696bed85cc98edb8f1439783d4268e89f127af"} Sep 10 17:57:47.551801 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:47.551559 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" Sep 10 17:57:47.569444 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:47.569385 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" podStartSLOduration=1.324476037 podStartE2EDuration="2.569366598s" totalImagesPullingTime="1.244890561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:47.568463034 +0000 UTC m=+864.962912294" watchObservedRunningTime="2026-09-10 17:57:47.569366598 +0000 UTC m=+864.963815855" Sep 10 17:57:50.228814 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:50.228785 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:50.291328 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:50.291291 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:50.510829 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:50.510761 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:50.629878 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:50.629847 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:50.730582 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:50.730554 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:51.071765 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:51.071728 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:51.166129 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:51.166095 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:56.547509 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:56.547479 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-cnldn" Sep 10 17:57:56.622839 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:56.622810 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:56.715851 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:56.715821 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:57:57.852526 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.852487 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78"] Sep 10 17:57:57.852934 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.852723 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" containerName="manager" containerID="cri-o://95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d" gracePeriod=2 Sep 10 17:57:57.868892 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.868605 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78"] Sep 10 17:57:57.876385 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:57:57.876352 2588 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d7b6dc6c-855f-4db1-bc90-2548cd5e9240\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-65c78\": pods \"limitador-operator-controller-manager-74495c69f8-65c78\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:57.886556 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.886523 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v"] Sep 10 17:57:57.886949 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.886932 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" containerName="manager" Sep 10 17:57:57.887034 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.886952 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" containerName="manager" Sep 10 17:57:57.887088 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.887068 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" containerName="manager" Sep 10 17:57:57.890664 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.890578 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" Sep 10 17:57:57.892950 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:57:57.892911 2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-65c78\" is forbidden: User \"system:node:ip-10-0-131-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-165.ec2.internal' and this object" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:57.900133 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.900109 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v"] Sep 10 17:57:57.937298 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:57.937269 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgv58\" (UniqueName: \"kubernetes.io/projected/64c9fe69-6197-430f-ac67-56cacee30547-kube-api-access-qgv58\") pod \"limitador-operator-controller-manager-74495c69f8-4zt8v\" (UID: \"64c9fe69-6197-430f-ac67-56cacee30547\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" Sep 10 17:57:58.037772 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.037745 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgv58\" (UniqueName: \"kubernetes.io/projected/64c9fe69-6197-430f-ac67-56cacee30547-kube-api-access-qgv58\") pod \"limitador-operator-controller-manager-74495c69f8-4zt8v\" (UID: \"64c9fe69-6197-430f-ac67-56cacee30547\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" Sep 10 17:57:58.046597 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.046568 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgv58\" (UniqueName: \"kubernetes.io/projected/64c9fe69-6197-430f-ac67-56cacee30547-kube-api-access-qgv58\") pod \"limitador-operator-controller-manager-74495c69f8-4zt8v\" (UID: \"64c9fe69-6197-430f-ac67-56cacee30547\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" Sep 10 17:57:58.091360 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.091336 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:58.093685 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:57:58.093658 2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-65c78\" is forbidden: User \"system:node:ip-10-0-131-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-165.ec2.internal' and this object" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:58.229616 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.229581 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" Sep 10 17:57:58.240033 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.240010 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-969r6\" (UniqueName: \"kubernetes.io/projected/d7b6dc6c-855f-4db1-bc90-2548cd5e9240-kube-api-access-969r6\") pod \"d7b6dc6c-855f-4db1-bc90-2548cd5e9240\" (UID: \"d7b6dc6c-855f-4db1-bc90-2548cd5e9240\") " Sep 10 17:57:58.242049 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.242019 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7b6dc6c-855f-4db1-bc90-2548cd5e9240-kube-api-access-969r6" (OuterVolumeSpecName: "kube-api-access-969r6") pod "d7b6dc6c-855f-4db1-bc90-2548cd5e9240" (UID: "d7b6dc6c-855f-4db1-bc90-2548cd5e9240"). InnerVolumeSpecName "kube-api-access-969r6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:57:58.340944 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.340907 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-969r6\" (UniqueName: \"kubernetes.io/projected/d7b6dc6c-855f-4db1-bc90-2548cd5e9240-kube-api-access-969r6\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:57:58.504476 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.504351 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v"] Sep 10 17:57:58.506648 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:57:58.506597 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c9fe69_6197_430f_ac67_56cacee30547.slice/crio-4d85c973158af6b6f0cc1eb6909da037110652a3752937ee703b5ab7aa9fee99 WatchSource:0}: Error finding container 4d85c973158af6b6f0cc1eb6909da037110652a3752937ee703b5ab7aa9fee99: Status 404 returned error can't find the container with id 4d85c973158af6b6f0cc1eb6909da037110652a3752937ee703b5ab7aa9fee99 Sep 10 17:57:58.559035 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.559013 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-xt9bs" Sep 10 17:57:58.560798 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:57:58.560764 2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-65c78\" is forbidden: User \"system:node:ip-10-0-131-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-165.ec2.internal' and this object" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:58.607423 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.607388 2588 generic.go:356] "Generic (PLEG): container finished" podID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" containerID="95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d" exitCode=0 Sep 10 17:57:58.607603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.607460 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:58.607603 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.607491 2588 scope.go:117] "RemoveContainer" containerID="95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d" Sep 10 17:57:58.609655 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:57:58.609428 2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-65c78\" is forbidden: User \"system:node:ip-10-0-131-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-165.ec2.internal' and this object" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:58.610038 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.610009 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" event={"ID":"64c9fe69-6197-430f-ac67-56cacee30547","Type":"ContainerStarted","Data":"a2b53780934d5a7bf5c1bc897db3e067d85dfa20fc3a5bf6bcc860dbb1147c02"} Sep 10 17:57:58.610142 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.610064 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" event={"ID":"64c9fe69-6197-430f-ac67-56cacee30547","Type":"ContainerStarted","Data":"4d85c973158af6b6f0cc1eb6909da037110652a3752937ee703b5ab7aa9fee99"} Sep 10 17:57:58.610142 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.610115 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" Sep 10 17:57:58.611816 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:57:58.611786 2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-65c78\" is forbidden: User \"system:node:ip-10-0-131-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-165.ec2.internal' and this object" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:58.617634 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.617614 2588 scope.go:117] "RemoveContainer" containerID="95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d" Sep 10 17:57:58.617921 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:57:58.617903 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d\": container with ID starting with 95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d not found: ID does not exist" containerID="95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d" Sep 10 17:57:58.617975 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.617929 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d"} err="failed to get container status \"95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d\": rpc error: code = NotFound desc = could not find container \"95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d\": container with ID starting with 95f6a90346f657c3b96361540a88a2a8849f43102cc7bebe550d3662a46fe09d not found: ID does not exist" Sep 10 17:57:58.634718 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:58.634674 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" podStartSLOduration=1.634656439 podStartE2EDuration="1.634656439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:58.633294414 +0000 UTC m=+876.027743681" watchObservedRunningTime="2026-09-10 17:57:58.634656439 +0000 UTC m=+876.029105694" Sep 10 17:57:58.635269 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:57:58.635234 2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-65c78\" is forbidden: User \"system:node:ip-10-0-131-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-165.ec2.internal' and this object" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-65c78" Sep 10 17:57:59.124007 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:57:59.123927 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7b6dc6c-855f-4db1-bc90-2548cd5e9240" path="/var/lib/kubelet/pods/d7b6dc6c-855f-4db1-bc90-2548cd5e9240/volumes" Sep 10 17:58:03.088726 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:03.088693 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:03.188456 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:03.188428 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:05.655938 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:05.655903 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:05.762690 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:05.762661 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:09.472592 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:09.472556 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:09.567770 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:09.567743 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:09.618135 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:09.618107 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4zt8v" Sep 10 17:58:09.668690 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:09.668659 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:09.769199 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:09.769162 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:10.676369 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:10.676338 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:10.771934 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:10.771904 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:17.513859 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:17.513781 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:17.571610 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:17.571574 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:23.088484 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:23.088457 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:58:23.088920 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:23.088668 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 17:58:24.062777 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:24.062669 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:24.161863 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:24.161831 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:26.191725 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:26.191683 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:27.414900 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:27.414872 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:33.718042 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:33.718002 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:41.262929 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:41.262888 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:41.368497 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:41.368462 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:41.466627 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:41.466594 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:42.076116 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.076082 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-dqxtq"] Sep 10 17:58:42.079667 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.079642 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" Sep 10 17:58:42.081794 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.081773 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zncjn\"" Sep 10 17:58:42.086496 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.086471 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-dqxtq"] Sep 10 17:58:42.109795 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.109762 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:42.209286 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.209250 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:42.222435 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.222401 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkp2t\" (UniqueName: \"kubernetes.io/projected/9b4f145e-7bb2-4738-a42c-712226dbbed4-kube-api-access-tkp2t\") pod \"authorino-7bcfd8f9cd-dqxtq\" (UID: \"9b4f145e-7bb2-4738-a42c-712226dbbed4\") " pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" Sep 10 17:58:42.323928 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.323887 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkp2t\" (UniqueName: \"kubernetes.io/projected/9b4f145e-7bb2-4738-a42c-712226dbbed4-kube-api-access-tkp2t\") pod \"authorino-7bcfd8f9cd-dqxtq\" (UID: \"9b4f145e-7bb2-4738-a42c-712226dbbed4\") " pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" Sep 10 17:58:42.332026 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.331966 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkp2t\" (UniqueName: \"kubernetes.io/projected/9b4f145e-7bb2-4738-a42c-712226dbbed4-kube-api-access-tkp2t\") pod \"authorino-7bcfd8f9cd-dqxtq\" (UID: \"9b4f145e-7bb2-4738-a42c-712226dbbed4\") " pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" Sep 10 17:58:42.386743 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.386700 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-4bkw7"] Sep 10 17:58:42.389833 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.389807 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" Sep 10 17:58:42.390160 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.390141 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-4bkw7" Sep 10 17:58:42.397508 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.397484 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-4bkw7"] Sep 10 17:58:42.525870 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.525834 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc25b\" (UniqueName: \"kubernetes.io/projected/8a7f57f9-965d-40b3-a09f-b0672d5dd693-kube-api-access-bc25b\") pod \"authorino-59c974bd48-4bkw7\" (UID: \"8a7f57f9-965d-40b3-a09f-b0672d5dd693\") " pod="kuadrant-system/authorino-59c974bd48-4bkw7" Sep 10 17:58:42.626812 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.626722 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc25b\" (UniqueName: \"kubernetes.io/projected/8a7f57f9-965d-40b3-a09f-b0672d5dd693-kube-api-access-bc25b\") pod \"authorino-59c974bd48-4bkw7\" (UID: \"8a7f57f9-965d-40b3-a09f-b0672d5dd693\") " pod="kuadrant-system/authorino-59c974bd48-4bkw7" Sep 10 17:58:42.635213 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.635186 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc25b\" (UniqueName: \"kubernetes.io/projected/8a7f57f9-965d-40b3-a09f-b0672d5dd693-kube-api-access-bc25b\") pod \"authorino-59c974bd48-4bkw7\" (UID: \"8a7f57f9-965d-40b3-a09f-b0672d5dd693\") " pod="kuadrant-system/authorino-59c974bd48-4bkw7" Sep 10 17:58:42.664611 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.664585 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-dqxtq"] Sep 10 17:58:42.667301 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:58:42.667273 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b4f145e_7bb2_4738_a42c_712226dbbed4.slice/crio-7d918ae80af62cb054c4fafaf5115590eb1b81b73c123c0abe6d6c8b5f21c9dd WatchSource:0}: Error finding container 7d918ae80af62cb054c4fafaf5115590eb1b81b73c123c0abe6d6c8b5f21c9dd: Status 404 returned error can't find the container with id 7d918ae80af62cb054c4fafaf5115590eb1b81b73c123c0abe6d6c8b5f21c9dd Sep 10 17:58:42.720600 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.720573 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-4bkw7" Sep 10 17:58:42.816358 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.816303 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" event={"ID":"9b4f145e-7bb2-4738-a42c-712226dbbed4","Type":"ContainerStarted","Data":"7d918ae80af62cb054c4fafaf5115590eb1b81b73c123c0abe6d6c8b5f21c9dd"} Sep 10 17:58:42.989695 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:42.989668 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-4bkw7"] Sep 10 17:58:42.991816 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:58:42.991787 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a7f57f9_965d_40b3_a09f_b0672d5dd693.slice/crio-34666498ba03682e48899ed13354a5396dbefccba2c79736d37e67abd379472a WatchSource:0}: Error finding container 34666498ba03682e48899ed13354a5396dbefccba2c79736d37e67abd379472a: Status 404 returned error can't find the container with id 34666498ba03682e48899ed13354a5396dbefccba2c79736d37e67abd379472a Sep 10 17:58:43.829589 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:43.829531 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-4bkw7" event={"ID":"8a7f57f9-965d-40b3-a09f-b0672d5dd693","Type":"ContainerStarted","Data":"34666498ba03682e48899ed13354a5396dbefccba2c79736d37e67abd379472a"} Sep 10 17:58:44.836227 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:44.836129 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" event={"ID":"9b4f145e-7bb2-4738-a42c-712226dbbed4","Type":"ContainerStarted","Data":"9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361"} Sep 10 17:58:44.837684 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:44.837656 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-4bkw7" event={"ID":"8a7f57f9-965d-40b3-a09f-b0672d5dd693","Type":"ContainerStarted","Data":"7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b"} Sep 10 17:58:44.850521 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:44.850480 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" podStartSLOduration=0.961301445 podStartE2EDuration="2.850466773s" totalImagesPullingTime="1.889165328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:58:44.849410727 +0000 UTC m=+922.243859986" watchObservedRunningTime="2026-09-10 17:58:44.850466773 +0000 UTC m=+922.244916028" Sep 10 17:58:44.864251 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:44.864202 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-4bkw7" podStartSLOduration=1.295703954 podStartE2EDuration="2.864186509s" totalImagesPullingTime="1.568482555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:58:44.86212209 +0000 UTC m=+922.256571346" watchObservedRunningTime="2026-09-10 17:58:44.864186509 +0000 UTC m=+922.258635763" Sep 10 17:58:44.885106 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:44.885072 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-dqxtq"] Sep 10 17:58:46.847398 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:46.847359 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" podUID="9b4f145e-7bb2-4738-a42c-712226dbbed4" containerName="authorino" containerID="cri-o://9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361" gracePeriod=30 Sep 10 17:58:47.103975 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.103917 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" Sep 10 17:58:47.166672 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.166639 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkp2t\" (UniqueName: \"kubernetes.io/projected/9b4f145e-7bb2-4738-a42c-712226dbbed4-kube-api-access-tkp2t\") pod \"9b4f145e-7bb2-4738-a42c-712226dbbed4\" (UID: \"9b4f145e-7bb2-4738-a42c-712226dbbed4\") " Sep 10 17:58:47.168652 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.168626 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b4f145e-7bb2-4738-a42c-712226dbbed4-kube-api-access-tkp2t" (OuterVolumeSpecName: "kube-api-access-tkp2t") pod "9b4f145e-7bb2-4738-a42c-712226dbbed4" (UID: "9b4f145e-7bb2-4738-a42c-712226dbbed4"). InnerVolumeSpecName "kube-api-access-tkp2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:58:47.268074 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.268038 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkp2t\" (UniqueName: \"kubernetes.io/projected/9b4f145e-7bb2-4738-a42c-712226dbbed4-kube-api-access-tkp2t\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:58:47.853123 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.853086 2588 generic.go:356] "Generic (PLEG): container finished" podID="9b4f145e-7bb2-4738-a42c-712226dbbed4" containerID="9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361" exitCode=0 Sep 10 17:58:47.853595 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.853135 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" Sep 10 17:58:47.853595 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.853171 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" event={"ID":"9b4f145e-7bb2-4738-a42c-712226dbbed4","Type":"ContainerDied","Data":"9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361"} Sep 10 17:58:47.853595 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.853211 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-dqxtq" event={"ID":"9b4f145e-7bb2-4738-a42c-712226dbbed4","Type":"ContainerDied","Data":"7d918ae80af62cb054c4fafaf5115590eb1b81b73c123c0abe6d6c8b5f21c9dd"} Sep 10 17:58:47.853595 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.853228 2588 scope.go:117] "RemoveContainer" containerID="9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361" Sep 10 17:58:47.861881 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.861866 2588 scope.go:117] "RemoveContainer" containerID="9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361" Sep 10 17:58:47.862146 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:58:47.862130 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361\": container with ID starting with 9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361 not found: ID does not exist" containerID="9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361" Sep 10 17:58:47.862199 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.862152 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361"} err="failed to get container status \"9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361\": rpc error: code = NotFound desc = could not find container \"9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361\": container with ID starting with 9801e4d0ba119184393d3d6b9ec2826fd9fd46c5e1ccb5f9805c502eb8236361 not found: ID does not exist" Sep 10 17:58:47.873179 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.873158 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-dqxtq"] Sep 10 17:58:47.876605 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:47.876583 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-dqxtq"] Sep 10 17:58:49.122838 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:49.122799 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b4f145e-7bb2-4738-a42c-712226dbbed4" path="/var/lib/kubelet/pods/9b4f145e-7bb2-4738-a42c-712226dbbed4/volumes" Sep 10 17:58:59.367903 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:59.367861 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:59.470246 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:59.470203 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:58:59.823665 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:58:59.823613 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:11.428048 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.428011 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:11.648444 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.648410 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-mgvsx"] Sep 10 17:59:11.648808 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.648793 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4f145e-7bb2-4738-a42c-712226dbbed4" containerName="authorino" Sep 10 17:59:11.648808 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.648808 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4f145e-7bb2-4738-a42c-712226dbbed4" containerName="authorino" Sep 10 17:59:11.648945 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.648883 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4f145e-7bb2-4738-a42c-712226dbbed4" containerName="authorino" Sep 10 17:59:11.652142 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.652125 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-mgvsx" Sep 10 17:59:11.657252 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.657221 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-mgvsx"] Sep 10 17:59:11.774606 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.774577 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpk55\" (UniqueName: \"kubernetes.io/projected/cc1ea4fe-f69e-4365-9e91-152bbefb0261-kube-api-access-xpk55\") pod \"authorino-557f876f69-mgvsx\" (UID: \"cc1ea4fe-f69e-4365-9e91-152bbefb0261\") " pod="kuadrant-system/authorino-557f876f69-mgvsx" Sep 10 17:59:11.802035 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.802005 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:11.875428 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.875398 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpk55\" (UniqueName: \"kubernetes.io/projected/cc1ea4fe-f69e-4365-9e91-152bbefb0261-kube-api-access-xpk55\") pod \"authorino-557f876f69-mgvsx\" (UID: \"cc1ea4fe-f69e-4365-9e91-152bbefb0261\") " pod="kuadrant-system/authorino-557f876f69-mgvsx" Sep 10 17:59:11.888959 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.888931 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpk55\" (UniqueName: \"kubernetes.io/projected/cc1ea4fe-f69e-4365-9e91-152bbefb0261-kube-api-access-xpk55\") pod \"authorino-557f876f69-mgvsx\" (UID: \"cc1ea4fe-f69e-4365-9e91-152bbefb0261\") " pod="kuadrant-system/authorino-557f876f69-mgvsx" Sep 10 17:59:11.901220 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.901191 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-mgvsx"] Sep 10 17:59:11.901461 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.901450 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-mgvsx" Sep 10 17:59:11.930911 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.930883 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58d5dcf594-vhdjj"] Sep 10 17:59:11.934509 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.934492 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58d5dcf594-vhdjj" Sep 10 17:59:11.936651 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.936628 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 17:59:11.940743 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:11.940719 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58d5dcf594-vhdjj"] Sep 10 17:59:12.077891 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.077790 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kn45\" (UniqueName: \"kubernetes.io/projected/0f4967a8-6f32-4262-a862-5371e75675da-kube-api-access-4kn45\") pod \"authorino-58d5dcf594-vhdjj\" (UID: \"0f4967a8-6f32-4262-a862-5371e75675da\") " pod="kuadrant-system/authorino-58d5dcf594-vhdjj" Sep 10 17:59:12.077891 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.077833 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f4967a8-6f32-4262-a862-5371e75675da-tls-cert\") pod \"authorino-58d5dcf594-vhdjj\" (UID: \"0f4967a8-6f32-4262-a862-5371e75675da\") " pod="kuadrant-system/authorino-58d5dcf594-vhdjj" Sep 10 17:59:12.177191 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.177167 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-mgvsx"] Sep 10 17:59:12.178951 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.178930 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kn45\" (UniqueName: \"kubernetes.io/projected/0f4967a8-6f32-4262-a862-5371e75675da-kube-api-access-4kn45\") pod \"authorino-58d5dcf594-vhdjj\" (UID: \"0f4967a8-6f32-4262-a862-5371e75675da\") " pod="kuadrant-system/authorino-58d5dcf594-vhdjj" Sep 10 17:59:12.179036 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.178965 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f4967a8-6f32-4262-a862-5371e75675da-tls-cert\") pod \"authorino-58d5dcf594-vhdjj\" (UID: \"0f4967a8-6f32-4262-a862-5371e75675da\") " pod="kuadrant-system/authorino-58d5dcf594-vhdjj" Sep 10 17:59:12.179703 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:59:12.179676 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc1ea4fe_f69e_4365_9e91_152bbefb0261.slice/crio-8412d1858c7e92e5aafb400cf8547005d22b0a08ac7f89349d96af578b9b461b WatchSource:0}: Error finding container 8412d1858c7e92e5aafb400cf8547005d22b0a08ac7f89349d96af578b9b461b: Status 404 returned error can't find the container with id 8412d1858c7e92e5aafb400cf8547005d22b0a08ac7f89349d96af578b9b461b Sep 10 17:59:12.181619 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.181579 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f4967a8-6f32-4262-a862-5371e75675da-tls-cert\") pod \"authorino-58d5dcf594-vhdjj\" (UID: \"0f4967a8-6f32-4262-a862-5371e75675da\") " pod="kuadrant-system/authorino-58d5dcf594-vhdjj" Sep 10 17:59:12.187071 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.187038 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kn45\" (UniqueName: \"kubernetes.io/projected/0f4967a8-6f32-4262-a862-5371e75675da-kube-api-access-4kn45\") pod \"authorino-58d5dcf594-vhdjj\" (UID: \"0f4967a8-6f32-4262-a862-5371e75675da\") " pod="kuadrant-system/authorino-58d5dcf594-vhdjj" Sep 10 17:59:12.246825 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.246788 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58d5dcf594-vhdjj" Sep 10 17:59:12.518144 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.518110 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58d5dcf594-vhdjj"] Sep 10 17:59:12.521092 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:59:12.521061 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f4967a8_6f32_4262_a862_5371e75675da.slice/crio-134d379602234b89b56d61b495d215367ac504ecd368e74982ef355b88c56a24 WatchSource:0}: Error finding container 134d379602234b89b56d61b495d215367ac504ecd368e74982ef355b88c56a24: Status 404 returned error can't find the container with id 134d379602234b89b56d61b495d215367ac504ecd368e74982ef355b88c56a24 Sep 10 17:59:12.980867 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.980826 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-mgvsx" event={"ID":"cc1ea4fe-f69e-4365-9e91-152bbefb0261","Type":"ContainerStarted","Data":"ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a"} Sep 10 17:59:12.980867 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.980847 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-mgvsx" podUID="cc1ea4fe-f69e-4365-9e91-152bbefb0261" containerName="authorino" containerID="cri-o://ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a" gracePeriod=30 Sep 10 17:59:12.981147 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.980884 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-mgvsx" event={"ID":"cc1ea4fe-f69e-4365-9e91-152bbefb0261","Type":"ContainerStarted","Data":"8412d1858c7e92e5aafb400cf8547005d22b0a08ac7f89349d96af578b9b461b"} Sep 10 17:59:12.982640 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.982614 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58d5dcf594-vhdjj" event={"ID":"0f4967a8-6f32-4262-a862-5371e75675da","Type":"ContainerStarted","Data":"ba6a556bf015dfc2af3f0c2082e01adbd67f89345060f36f73f85616201a88c2"} Sep 10 17:59:12.982732 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.982650 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58d5dcf594-vhdjj" event={"ID":"0f4967a8-6f32-4262-a862-5371e75675da","Type":"ContainerStarted","Data":"134d379602234b89b56d61b495d215367ac504ecd368e74982ef355b88c56a24"} Sep 10 17:59:12.995772 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:12.995731 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-mgvsx" podStartSLOduration=1.550130386 podStartE2EDuration="1.995714975s" totalImagesPullingTime="445.584589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:12.994364083 +0000 UTC m=+950.388813340" watchObservedRunningTime="2026-09-10 17:59:12.995714975 +0000 UTC m=+950.390164231" Sep 10 17:59:13.009081 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.009032 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58d5dcf594-vhdjj" podStartSLOduration=1.705908071 podStartE2EDuration="2.009016979s" totalImagesPullingTime="303.108908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:13.007476136 +0000 UTC m=+950.401925393" watchObservedRunningTime="2026-09-10 17:59:13.009016979 +0000 UTC m=+950.403466233" Sep 10 17:59:13.034467 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.034433 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-4bkw7"] Sep 10 17:59:13.034682 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.034660 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-4bkw7" podUID="8a7f57f9-965d-40b3-a09f-b0672d5dd693" containerName="authorino" containerID="cri-o://7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b" gracePeriod=30 Sep 10 17:59:13.309563 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.309534 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-mgvsx" Sep 10 17:59:13.313040 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.313017 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-4bkw7" Sep 10 17:59:13.390856 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.390750 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpk55\" (UniqueName: \"kubernetes.io/projected/cc1ea4fe-f69e-4365-9e91-152bbefb0261-kube-api-access-xpk55\") pod \"cc1ea4fe-f69e-4365-9e91-152bbefb0261\" (UID: \"cc1ea4fe-f69e-4365-9e91-152bbefb0261\") " Sep 10 17:59:13.390856 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.390835 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc25b\" (UniqueName: \"kubernetes.io/projected/8a7f57f9-965d-40b3-a09f-b0672d5dd693-kube-api-access-bc25b\") pod \"8a7f57f9-965d-40b3-a09f-b0672d5dd693\" (UID: \"8a7f57f9-965d-40b3-a09f-b0672d5dd693\") " Sep 10 17:59:13.392981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.392934 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a7f57f9-965d-40b3-a09f-b0672d5dd693-kube-api-access-bc25b" (OuterVolumeSpecName: "kube-api-access-bc25b") pod "8a7f57f9-965d-40b3-a09f-b0672d5dd693" (UID: "8a7f57f9-965d-40b3-a09f-b0672d5dd693"). InnerVolumeSpecName "kube-api-access-bc25b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:59:13.392981 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.392954 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1ea4fe-f69e-4365-9e91-152bbefb0261-kube-api-access-xpk55" (OuterVolumeSpecName: "kube-api-access-xpk55") pod "cc1ea4fe-f69e-4365-9e91-152bbefb0261" (UID: "cc1ea4fe-f69e-4365-9e91-152bbefb0261"). InnerVolumeSpecName "kube-api-access-xpk55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:59:13.492444 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.492407 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc25b\" (UniqueName: \"kubernetes.io/projected/8a7f57f9-965d-40b3-a09f-b0672d5dd693-kube-api-access-bc25b\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:59:13.492444 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.492440 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpk55\" (UniqueName: \"kubernetes.io/projected/cc1ea4fe-f69e-4365-9e91-152bbefb0261-kube-api-access-xpk55\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\"" Sep 10 17:59:13.989861 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.989830 2588 generic.go:356] "Generic (PLEG): container finished" podID="8a7f57f9-965d-40b3-a09f-b0672d5dd693" containerID="7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b" exitCode=0 Sep 10 17:59:13.990288 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.989869 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-4bkw7" Sep 10 17:59:13.990288 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.989908 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-4bkw7" event={"ID":"8a7f57f9-965d-40b3-a09f-b0672d5dd693","Type":"ContainerDied","Data":"7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b"} Sep 10 17:59:13.990288 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.989944 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-4bkw7" event={"ID":"8a7f57f9-965d-40b3-a09f-b0672d5dd693","Type":"ContainerDied","Data":"34666498ba03682e48899ed13354a5396dbefccba2c79736d37e67abd379472a"} Sep 10 17:59:13.990288 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.989960 2588 scope.go:117] "RemoveContainer" containerID="7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b" Sep 10 17:59:13.991351 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.991328 2588 generic.go:356] "Generic (PLEG): container finished" podID="cc1ea4fe-f69e-4365-9e91-152bbefb0261" containerID="ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a" exitCode=0 Sep 10 17:59:13.991440 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.991370 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-mgvsx" Sep 10 17:59:13.991440 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.991417 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-mgvsx" event={"ID":"cc1ea4fe-f69e-4365-9e91-152bbefb0261","Type":"ContainerDied","Data":"ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a"} Sep 10 17:59:13.991525 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.991451 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-mgvsx" event={"ID":"cc1ea4fe-f69e-4365-9e91-152bbefb0261","Type":"ContainerDied","Data":"8412d1858c7e92e5aafb400cf8547005d22b0a08ac7f89349d96af578b9b461b"} Sep 10 17:59:13.998517 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.998498 2588 scope.go:117] "RemoveContainer" containerID="7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b" Sep 10 17:59:13.998802 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:59:13.998782 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b\": container with ID starting with 7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b not found: ID does not exist" containerID="7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b" Sep 10 17:59:13.998917 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.998811 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b"} err="failed to get container status \"7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b\": rpc error: code = NotFound desc = could not find container \"7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b\": container with ID starting with 7c625590d620ef277ba57afc0d1d209fa297ec335eb70d693636a90168c5589b not found: ID does not exist" Sep 10 17:59:13.998917 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:13.998834 2588 scope.go:117] "RemoveContainer" containerID="ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a" Sep 10 17:59:14.006846 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:14.006828 2588 scope.go:117] "RemoveContainer" containerID="ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a" Sep 10 17:59:14.007102 ip-10-0-131-165 kubenswrapper[2588]: E0910 17:59:14.007086 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a\": container with ID starting with ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a not found: ID does not exist" containerID="ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a" Sep 10 17:59:14.007160 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:14.007107 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a"} err="failed to get container status \"ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a\": rpc error: code = NotFound desc = could not find container \"ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a\": container with ID starting with ec3db0f1e3634a1ea519666370a1b877768472a9809ebfac50f9191903f9ce0a not found: ID does not exist" Sep 10 17:59:14.013547 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:14.013523 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-4bkw7"] Sep 10 17:59:14.017398 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:14.017379 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-4bkw7"] Sep 10 17:59:14.026159 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:14.026138 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-mgvsx"] Sep 10 17:59:14.031706 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:14.031686 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-mgvsx"] Sep 10 17:59:15.123878 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:15.123844 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a7f57f9-965d-40b3-a09f-b0672d5dd693" path="/var/lib/kubelet/pods/8a7f57f9-965d-40b3-a09f-b0672d5dd693/volumes" Sep 10 17:59:15.124220 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:15.124152 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1ea4fe-f69e-4365-9e91-152bbefb0261" path="/var/lib/kubelet/pods/cc1ea4fe-f69e-4365-9e91-152bbefb0261/volumes" Sep 10 17:59:17.746544 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:17.746508 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:17.820868 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:17.820829 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:17.883182 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:17.883135 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:17.980795 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:17.980746 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:18.082187 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:18.082085 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:21.022872 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:21.022839 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:21.122885 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:21.122850 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:24.059029 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:24.058997 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:53.459080 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:53.458997 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:53.557718 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:53.557688 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:55.036555 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.036512 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:55.137809 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.137776 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:55.209016 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.208983 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:55.530905 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.530871 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:55.637570 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.637530 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 17:59:55.740424 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.740391 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk"] Sep 10 17:59:55.740854 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.740829 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a7f57f9-965d-40b3-a09f-b0672d5dd693" containerName="authorino" Sep 10 17:59:55.740854 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.740851 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7f57f9-965d-40b3-a09f-b0672d5dd693" containerName="authorino" Sep 10 17:59:55.740992 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.740865 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1ea4fe-f69e-4365-9e91-152bbefb0261" containerName="authorino" Sep 10 17:59:55.740992 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.740874 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1ea4fe-f69e-4365-9e91-152bbefb0261" containerName="authorino" Sep 10 17:59:55.740992 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.740960 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1ea4fe-f69e-4365-9e91-152bbefb0261" containerName="authorino" Sep 10 17:59:55.740992 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.740982 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a7f57f9-965d-40b3-a09f-b0672d5dd693" containerName="authorino" Sep 10 17:59:55.744003 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.743980 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:55.747389 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.747368 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lfb4d\"" Sep 10 17:59:55.749334 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.749299 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 17:59:55.759692 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.759659 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk"] Sep 10 17:59:55.862072 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.861985 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-698nr\" (UniqueName: \"kubernetes.io/projected/862633e5-fc2e-453e-be88-1dfefd999cd8-kube-api-access-698nr\") pod \"payload-pre-processing-59fbc47bf8-zfnhk\" (UID: \"862633e5-fc2e-453e-be88-1dfefd999cd8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:55.862357 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.862324 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/862633e5-fc2e-453e-be88-1dfefd999cd8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zfnhk\" (UID: \"862633e5-fc2e-453e-be88-1dfefd999cd8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:55.963380 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.963302 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-698nr\" (UniqueName: \"kubernetes.io/projected/862633e5-fc2e-453e-be88-1dfefd999cd8-kube-api-access-698nr\") pod \"payload-pre-processing-59fbc47bf8-zfnhk\" (UID: \"862633e5-fc2e-453e-be88-1dfefd999cd8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:55.963690 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.963670 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/862633e5-fc2e-453e-be88-1dfefd999cd8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zfnhk\" (UID: \"862633e5-fc2e-453e-be88-1dfefd999cd8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:55.964770 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.964722 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/862633e5-fc2e-453e-be88-1dfefd999cd8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zfnhk\" (UID: \"862633e5-fc2e-453e-be88-1dfefd999cd8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:55.972743 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:55.972700 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-698nr\" (UniqueName: \"kubernetes.io/projected/862633e5-fc2e-453e-be88-1dfefd999cd8-kube-api-access-698nr\") pod \"payload-pre-processing-59fbc47bf8-zfnhk\" (UID: \"862633e5-fc2e-453e-be88-1dfefd999cd8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:56.055875 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:56.055834 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:56.323359 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:56.323231 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk"] Sep 10 17:59:56.325610 ip-10-0-131-165 kubenswrapper[2588]: W0910 17:59:56.325582 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862633e5_fc2e_453e_be88_1dfefd999cd8.slice/crio-98b4717b4a97dec6caf208bc515f48e716969bf10c6b86e5dd82003caa4508e5 WatchSource:0}: Error finding container 98b4717b4a97dec6caf208bc515f48e716969bf10c6b86e5dd82003caa4508e5: Status 404 returned error can't find the container with id 98b4717b4a97dec6caf208bc515f48e716969bf10c6b86e5dd82003caa4508e5 Sep 10 17:59:57.200749 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:57.200712 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" event={"ID":"862633e5-fc2e-453e-be88-1dfefd999cd8","Type":"ContainerStarted","Data":"98b4717b4a97dec6caf208bc515f48e716969bf10c6b86e5dd82003caa4508e5"} Sep 10 17:59:59.212628 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:59.212589 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" event={"ID":"862633e5-fc2e-453e-be88-1dfefd999cd8","Type":"ContainerStarted","Data":"64ef29d143592850d5e67fa389ba3e8d4d2fc1cc33d117459559f1d953f444e8"} Sep 10 17:59:59.213051 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:59.212696 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 17:59:59.229245 ip-10-0-131-165 kubenswrapper[2588]: I0910 17:59:59.229200 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" podStartSLOduration=2.055970216 podStartE2EDuration="4.229185653s" totalImagesPullingTime="2.173215437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:59.228986908 +0000 UTC m=+996.623436160" watchObservedRunningTime="2026-09-10 17:59:59.229185653 +0000 UTC m=+996.623634925" Sep 10 18:00:00.135364 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:00.135325 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr"] Sep 10 18:00:00.139169 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:00.139146 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" Sep 10 18:00:00.141473 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:00.141449 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5gzzs\"" Sep 10 18:00:00.142626 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:00.142603 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr"] Sep 10 18:00:00.152188 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:00.152168 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" Sep 10 18:00:00.420428 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:00.420403 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr"] Sep 10 18:00:00.422866 ip-10-0-131-165 kubenswrapper[2588]: W0910 18:00:00.422834 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65158358_7bd4_4fd3_9838_dc8653a30666.slice/crio-280313bc5cf590f5270f77f9bd4b4481cf30fa10a9c62d3cbf652aa92b40048c WatchSource:0}: Error finding container 280313bc5cf590f5270f77f9bd4b4481cf30fa10a9c62d3cbf652aa92b40048c: Status 404 returned error can't find the container with id 280313bc5cf590f5270f77f9bd4b4481cf30fa10a9c62d3cbf652aa92b40048c Sep 10 18:00:01.225844 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:01.225805 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" event={"ID":"65158358-7bd4-4fd3-9838-dc8653a30666","Type":"ContainerStarted","Data":"280313bc5cf590f5270f77f9bd4b4481cf30fa10a9c62d3cbf652aa92b40048c"} Sep 10 18:00:03.237371 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:03.237334 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" event={"ID":"65158358-7bd4-4fd3-9838-dc8653a30666","Type":"ContainerStarted","Data":"2a03e3afaf0cb8de472e7bffa77edb9fb971beb94f55aa960490f698f23704dc"} Sep 10 18:00:04.243785 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:04.243744 2588 generic.go:356] "Generic (PLEG): container finished" podID="65158358-7bd4-4fd3-9838-dc8653a30666" containerID="2a03e3afaf0cb8de472e7bffa77edb9fb971beb94f55aa960490f698f23704dc" exitCode=7 Sep 10 18:00:04.244188 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:04.243832 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" event={"ID":"65158358-7bd4-4fd3-9838-dc8653a30666","Type":"ContainerDied","Data":"2a03e3afaf0cb8de472e7bffa77edb9fb971beb94f55aa960490f698f23704dc"} Sep 10 18:00:04.244188 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:04.243968 2588 scope.go:117] "RemoveContainer" containerID="2a03e3afaf0cb8de472e7bffa77edb9fb971beb94f55aa960490f698f23704dc" Sep 10 18:00:05.250651 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:05.250622 2588 generic.go:356] "Generic (PLEG): container finished" podID="65158358-7bd4-4fd3-9838-dc8653a30666" containerID="86c97ca39002cee1cc94b185362efd9e2ea9c457f825ce7b665576105b04c1cd" exitCode=7 Sep 10 18:00:05.251051 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:05.250736 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" event={"ID":"65158358-7bd4-4fd3-9838-dc8653a30666","Type":"ContainerDied","Data":"86c97ca39002cee1cc94b185362efd9e2ea9c457f825ce7b665576105b04c1cd"} Sep 10 18:00:05.251051 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:05.250784 2588 scope.go:117] "RemoveContainer" containerID="2a03e3afaf0cb8de472e7bffa77edb9fb971beb94f55aa960490f698f23704dc" Sep 10 18:00:05.251051 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:05.250850 2588 scope.go:117] "RemoveContainer" containerID="86c97ca39002cee1cc94b185362efd9e2ea9c457f825ce7b665576105b04c1cd" Sep 10 18:00:05.251181 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:00:05.251057 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29817720-ngvcr_odh-ai-gateway-infra(65158358-7bd4-4fd3-9838-dc8653a30666)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" Sep 10 18:00:06.257073 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:06.257043 2588 scope.go:117] "RemoveContainer" containerID="86c97ca39002cee1cc94b185362efd9e2ea9c457f825ce7b665576105b04c1cd" Sep 10 18:00:06.257509 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:00:06.257305 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29817720-ngvcr_odh-ai-gateway-infra(65158358-7bd4-4fd3-9838-dc8653a30666)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" Sep 10 18:00:08.378055 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:08.378015 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:00:08.470545 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:08.470508 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:00:10.222456 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:10.222422 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zfnhk" Sep 10 18:00:18.009495 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.009455 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl"] Sep 10 18:00:18.014542 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.014519 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.017123 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.017097 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 18:00:18.017813 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.017796 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8kpr5\"" Sep 10 18:00:18.018189 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.018162 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 18:00:18.018290 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.018248 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 10 18:00:18.023618 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.023592 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl"] Sep 10 18:00:18.105744 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.105710 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:00:18.159073 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.159035 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.159201 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.159091 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.159201 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.159158 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnc7c\" (UniqueName: \"kubernetes.io/projected/5f955430-fed4-4328-8952-eb4bdf27577c-kube-api-access-mnc7c\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.159340 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.159216 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.159340 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.159268 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.159340 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.159306 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f955430-fed4-4328-8952-eb4bdf27577c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.260413 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.260295 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnc7c\" (UniqueName: \"kubernetes.io/projected/5f955430-fed4-4328-8952-eb4bdf27577c-kube-api-access-mnc7c\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.260413 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.260393 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.260660 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.260422 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.260660 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.260455 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f955430-fed4-4328-8952-eb4bdf27577c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.260660 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.260487 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.260660 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.260533 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.260891 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.260868 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.260980 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.260951 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.261042 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.261026 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.262788 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.262761 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f955430-fed4-4328-8952-eb4bdf27577c-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.263191 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.263169 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f955430-fed4-4328-8952-eb4bdf27577c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.268531 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.268511 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnc7c\" (UniqueName: \"kubernetes.io/projected/5f955430-fed4-4328-8952-eb4bdf27577c-kube-api-access-mnc7c\") pod \"e2e-distinct-2-simulated-kserve-859856b874-b5cfl\" (UID: \"5f955430-fed4-4328-8952-eb4bdf27577c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.325919 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.325886 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:18.599859 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:18.599827 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl"] Sep 10 18:00:18.602483 ip-10-0-131-165 kubenswrapper[2588]: W0910 18:00:18.602455 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f955430_fed4_4328_8952_eb4bdf27577c.slice/crio-39fcffe4dd1d4af5217fec028e3c0900b25256368d8eb226f619541f0daff5d4 WatchSource:0}: Error finding container 39fcffe4dd1d4af5217fec028e3c0900b25256368d8eb226f619541f0daff5d4: Status 404 returned error can't find the container with id 39fcffe4dd1d4af5217fec028e3c0900b25256368d8eb226f619541f0daff5d4 Sep 10 18:00:19.321434 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:19.321398 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" event={"ID":"5f955430-fed4-4328-8952-eb4bdf27577c","Type":"ContainerStarted","Data":"39fcffe4dd1d4af5217fec028e3c0900b25256368d8eb226f619541f0daff5d4"} Sep 10 18:00:21.117714 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:21.117681 2588 scope.go:117] "RemoveContainer" containerID="86c97ca39002cee1cc94b185362efd9e2ea9c457f825ce7b665576105b04c1cd" Sep 10 18:00:22.336813 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:22.336779 2588 generic.go:356] "Generic (PLEG): container finished" podID="65158358-7bd4-4fd3-9838-dc8653a30666" containerID="f42a87935b38da51ced3d1c0b96c257fd2f0eedb899363eb05a1dbb337fe51b2" exitCode=0 Sep 10 18:00:22.337214 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:22.336839 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" event={"ID":"65158358-7bd4-4fd3-9838-dc8653a30666","Type":"ContainerDied","Data":"f42a87935b38da51ced3d1c0b96c257fd2f0eedb899363eb05a1dbb337fe51b2"} Sep 10 18:00:22.337214 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:22.336928 2588 scope.go:117] "RemoveContainer" containerID="86c97ca39002cee1cc94b185362efd9e2ea9c457f825ce7b665576105b04c1cd" Sep 10 18:00:23.342187 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:23.342155 2588 generic.go:356] "Generic (PLEG): container finished" podID="5f955430-fed4-4328-8952-eb4bdf27577c" containerID="5947e85ae99cb4202c830ea04a07b7cc142e1f6b06a01075cd15a876f05a18a2" exitCode=0 Sep 10 18:00:23.342615 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:23.342237 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" event={"ID":"5f955430-fed4-4328-8952-eb4bdf27577c","Type":"ContainerDied","Data":"5947e85ae99cb4202c830ea04a07b7cc142e1f6b06a01075cd15a876f05a18a2"} Sep 10 18:00:23.342615 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:23.342496 2588 scope.go:117] "RemoveContainer" containerID="5947e85ae99cb4202c830ea04a07b7cc142e1f6b06a01075cd15a876f05a18a2" Sep 10 18:00:23.364046 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:23.364011 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr"] Sep 10 18:00:23.484124 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:23.484095 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" Sep 10 18:00:24.350762 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:24.350738 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" Sep 10 18:00:24.351233 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:24.350737 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr" event={"ID":"65158358-7bd4-4fd3-9838-dc8653a30666","Type":"ContainerDied","Data":"280313bc5cf590f5270f77f9bd4b4481cf30fa10a9c62d3cbf652aa92b40048c"} Sep 10 18:00:24.351233 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:24.350858 2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="280313bc5cf590f5270f77f9bd4b4481cf30fa10a9c62d3cbf652aa92b40048c" Sep 10 18:00:24.377705 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:24.377672 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr"] Sep 10 18:00:24.381249 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:24.381225 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817720-ngvcr"] Sep 10 18:00:25.123138 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:25.123108 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" path="/var/lib/kubelet/pods/65158358-7bd4-4fd3-9838-dc8653a30666/volumes" Sep 10 18:00:27.367476 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:27.367442 2588 generic.go:356] "Generic (PLEG): container finished" podID="5f955430-fed4-4328-8952-eb4bdf27577c" containerID="cea4342eab9f47d3f83373c3c7976e362d98c9e53dac0422d81d82af06e5724f" exitCode=0 Sep 10 18:00:27.367896 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:27.367535 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" event={"ID":"5f955430-fed4-4328-8952-eb4bdf27577c","Type":"ContainerDied","Data":"cea4342eab9f47d3f83373c3c7976e362d98c9e53dac0422d81d82af06e5724f"} Sep 10 18:00:27.367896 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:27.367588 2588 scope.go:117] "RemoveContainer" containerID="5947e85ae99cb4202c830ea04a07b7cc142e1f6b06a01075cd15a876f05a18a2" Sep 10 18:00:27.367896 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:27.367755 2588 scope.go:117] "RemoveContainer" containerID="cea4342eab9f47d3f83373c3c7976e362d98c9e53dac0422d81d82af06e5724f" Sep 10 18:00:27.368027 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:00:27.367951 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:00:28.326322 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:28.326287 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:28.326495 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:28.326362 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:28.326495 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:28.326379 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:28.326495 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:28.326393 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:28.377897 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:28.377874 2588 scope.go:117] "RemoveContainer" containerID="cea4342eab9f47d3f83373c3c7976e362d98c9e53dac0422d81d82af06e5724f" Sep 10 18:00:28.378242 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:00:28.378042 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:00:29.381980 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:29.381956 2588 scope.go:117] "RemoveContainer" containerID="cea4342eab9f47d3f83373c3c7976e362d98c9e53dac0422d81d82af06e5724f" Sep 10 18:00:29.382360 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:00:29.382146 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:00:42.117980 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:42.117927 2588 scope.go:117] "RemoveContainer" containerID="cea4342eab9f47d3f83373c3c7976e362d98c9e53dac0422d81d82af06e5724f" Sep 10 18:00:42.207748 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:42.207713 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:00:42.445528 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:42.445498 2588 generic.go:356] "Generic (PLEG): container finished" podID="5f955430-fed4-4328-8952-eb4bdf27577c" containerID="a5320e3164f0120eae9dbe13aa7c673eb0e4fe3b1dcf39008855c34d59dd2eb3" exitCode=0 Sep 10 18:00:42.445683 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:42.445573 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" event={"ID":"5f955430-fed4-4328-8952-eb4bdf27577c","Type":"ContainerDied","Data":"a5320e3164f0120eae9dbe13aa7c673eb0e4fe3b1dcf39008855c34d59dd2eb3"} Sep 10 18:00:42.445683 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:42.445638 2588 scope.go:117] "RemoveContainer" containerID="cea4342eab9f47d3f83373c3c7976e362d98c9e53dac0422d81d82af06e5724f" Sep 10 18:00:42.445996 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:42.445981 2588 scope.go:117] "RemoveContainer" containerID="a5320e3164f0120eae9dbe13aa7c673eb0e4fe3b1dcf39008855c34d59dd2eb3" Sep 10 18:00:42.446172 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:00:42.446152 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:00:48.326617 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:48.326569 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:48.326997 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:48.326645 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:48.326997 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:48.326660 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:48.326997 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:48.326673 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:00:48.327111 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:48.327009 2588 scope.go:117] "RemoveContainer" containerID="a5320e3164f0120eae9dbe13aa7c673eb0e4fe3b1dcf39008855c34d59dd2eb3" Sep 10 18:00:48.327192 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:00:48.327172 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:00:49.422385 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:49.422353 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:00:49.519274 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:49.519237 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:00:51.734835 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:51.734796 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:00:58.216253 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.216220 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq"] Sep 10 18:00:58.216831 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.216605 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:00:58.216831 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.216617 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:00:58.216831 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.216634 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:00:58.216831 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.216639 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:00:58.216831 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.216713 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:00:58.216831 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.216731 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:00:58.220066 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.220044 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.222349 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.222329 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 18:00:58.230005 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.229986 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq"] Sep 10 18:00:58.249228 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.249203 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:00:58.324344 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.324291 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.324520 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.324351 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.324520 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.324404 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620fd108-83ea-4e7b-8d42-2938a9d7a96d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.324520 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.324421 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.324520 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.324443 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.324717 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.324572 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqzzf\" (UniqueName: \"kubernetes.io/projected/620fd108-83ea-4e7b-8d42-2938a9d7a96d-kube-api-access-vqzzf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.425591 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.425559 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.425591 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.425595 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.425834 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.425621 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620fd108-83ea-4e7b-8d42-2938a9d7a96d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.425834 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.425737 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.425834 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.425777 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.425994 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.425870 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzzf\" (UniqueName: \"kubernetes.io/projected/620fd108-83ea-4e7b-8d42-2938a9d7a96d-kube-api-access-vqzzf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.425994 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.425948 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.426110 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.426082 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.426215 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.426197 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.427936 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.427905 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620fd108-83ea-4e7b-8d42-2938a9d7a96d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.428160 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.428144 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620fd108-83ea-4e7b-8d42-2938a9d7a96d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.433795 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.433772 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzzf\" (UniqueName: \"kubernetes.io/projected/620fd108-83ea-4e7b-8d42-2938a9d7a96d-kube-api-access-vqzzf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r9xjq\" (UID: \"620fd108-83ea-4e7b-8d42-2938a9d7a96d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.534108 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.534073 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:00:58.803459 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:58.803432 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq"] Sep 10 18:00:58.805641 ip-10-0-131-165 kubenswrapper[2588]: W0910 18:00:58.805615 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620fd108_83ea_4e7b_8d42_2938a9d7a96d.slice/crio-60c8a45b42aafa9f5017e42a09be620ca6472a16e1e3c9efbcb06c00f53e8b59 WatchSource:0}: Error finding container 60c8a45b42aafa9f5017e42a09be620ca6472a16e1e3c9efbcb06c00f53e8b59: Status 404 returned error can't find the container with id 60c8a45b42aafa9f5017e42a09be620ca6472a16e1e3c9efbcb06c00f53e8b59 Sep 10 18:00:59.532092 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:59.532053 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" event={"ID":"620fd108-83ea-4e7b-8d42-2938a9d7a96d","Type":"ContainerStarted","Data":"969bbcaf88d684015bc19f9bb26785738db91f051cfb6691066a2e2547d6ede8"} Sep 10 18:00:59.532498 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:59.532118 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" event={"ID":"620fd108-83ea-4e7b-8d42-2938a9d7a96d","Type":"ContainerStarted","Data":"60c8a45b42aafa9f5017e42a09be620ca6472a16e1e3c9efbcb06c00f53e8b59"} Sep 10 18:00:59.548620 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:00:59.548573 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" podStartSLOduration=1.277619836 podStartE2EDuration="1.548555304s" totalImagesPullingTime="270.935468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:59.547915181 +0000 UTC m=+1056.942364441" watchObservedRunningTime="2026-09-10 18:00:59.548555304 +0000 UTC m=+1056.943004599" Sep 10 18:01:03.120784 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:03.120755 2588 scope.go:117] "RemoveContainer" containerID="a5320e3164f0120eae9dbe13aa7c673eb0e4fe3b1dcf39008855c34d59dd2eb3" Sep 10 18:01:03.553264 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:03.553230 2588 generic.go:356] "Generic (PLEG): container finished" podID="5f955430-fed4-4328-8952-eb4bdf27577c" containerID="7493d579631d5dafeedd02b4a1307ed947a31fa3a1732d5080055dfb20266cce" exitCode=0 Sep 10 18:01:03.553467 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:03.553323 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" event={"ID":"5f955430-fed4-4328-8952-eb4bdf27577c","Type":"ContainerDied","Data":"7493d579631d5dafeedd02b4a1307ed947a31fa3a1732d5080055dfb20266cce"} Sep 10 18:01:03.553467 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:03.553393 2588 scope.go:117] "RemoveContainer" containerID="a5320e3164f0120eae9dbe13aa7c673eb0e4fe3b1dcf39008855c34d59dd2eb3" Sep 10 18:01:03.553769 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:03.553744 2588 scope.go:117] "RemoveContainer" containerID="7493d579631d5dafeedd02b4a1307ed947a31fa3a1732d5080055dfb20266cce" Sep 10 18:01:03.554000 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:03.553977 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:01:05.904000 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:05.903966 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2"] Sep 10 18:01:05.904409 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:05.904373 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:01:05.904409 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:05.904386 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:01:05.904504 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:05.904456 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="65158358-7bd4-4fd3-9838-dc8653a30666" containerName="cleanup" Sep 10 18:01:05.908675 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:05.908656 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:05.911289 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:05.911267 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 18:01:05.915544 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:05.915520 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2"] Sep 10 18:01:05.945572 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:05.945526 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:01:06.095619 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.095581 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.095619 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.095621 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.095838 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.095646 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.095838 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.095691 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.095838 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.095720 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2df4\" (UniqueName: \"kubernetes.io/projected/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-kube-api-access-s2df4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.095838 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.095783 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197122 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197017 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197291 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197159 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197291 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197189 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197291 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197212 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197291 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197239 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197291 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197266 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2df4\" (UniqueName: \"kubernetes.io/projected/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-kube-api-access-s2df4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197584 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197527 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197641 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197587 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.197641 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.197603 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.199577 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.199542 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.199709 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.199691 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.205362 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.205341 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2df4\" (UniqueName: \"kubernetes.io/projected/a9783be8-17b6-4dd4-a1fa-b8decc1c12bb-kube-api-access-s2df4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2\" (UID: \"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.222338 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.222296 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:06.492187 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.492159 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2"] Sep 10 18:01:06.494174 ip-10-0-131-165 kubenswrapper[2588]: W0910 18:01:06.494149 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9783be8_17b6_4dd4_a1fa_b8decc1c12bb.slice/crio-55a41c20b8ab7c716c053ba085bc425e6b4b646aa212f42dbe3bb9b7c6f4798b WatchSource:0}: Error finding container 55a41c20b8ab7c716c053ba085bc425e6b4b646aa212f42dbe3bb9b7c6f4798b: Status 404 returned error can't find the container with id 55a41c20b8ab7c716c053ba085bc425e6b4b646aa212f42dbe3bb9b7c6f4798b Sep 10 18:01:06.572562 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:06.572525 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" event={"ID":"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb","Type":"ContainerStarted","Data":"55a41c20b8ab7c716c053ba085bc425e6b4b646aa212f42dbe3bb9b7c6f4798b"} Sep 10 18:01:07.579438 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:07.579399 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" event={"ID":"a9783be8-17b6-4dd4-a1fa-b8decc1c12bb","Type":"ContainerStarted","Data":"fe304708c9feb33912dcce5c4d037fbcb0a65c28a9733fec456adbfda2a443ea"} Sep 10 18:01:07.599123 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:07.599057 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" podStartSLOduration=2.375539233 podStartE2EDuration="2.599038228s" totalImagesPullingTime="223.498995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:01:07.597414005 +0000 UTC m=+1064.991863263" watchObservedRunningTime="2026-09-10 18:01:07.599038228 +0000 UTC m=+1064.993487488" Sep 10 18:01:08.326935 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.326901 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:01:08.327113 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.326970 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:01:08.327113 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.326990 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:01:08.327113 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.327011 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:01:08.327412 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.327394 2588 scope.go:117] "RemoveContainer" containerID="7493d579631d5dafeedd02b4a1307ed947a31fa3a1732d5080055dfb20266cce" Sep 10 18:01:08.327591 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:08.327573 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:01:08.535102 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.535067 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:01:08.535276 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.535124 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:01:08.547957 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.547930 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:01:08.595937 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:08.595860 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r9xjq" Sep 10 18:01:12.795658 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.795626 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx"] Sep 10 18:01:12.799392 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.799368 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.801648 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.801622 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 10 18:01:12.808842 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.808818 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx"] Sep 10 18:01:12.832771 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.832739 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:01:12.852044 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.852011 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.852186 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.852061 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.852186 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.852124 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.852186 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.852143 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fvp\" (UniqueName: \"kubernetes.io/projected/5cdba282-4bc9-4237-9ce0-1974748f9bbc-kube-api-access-n8fvp\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.852391 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.852206 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdba282-4bc9-4237-9ce0-1974748f9bbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.852391 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.852244 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.953539 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.953500 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.953705 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.953545 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fvp\" (UniqueName: \"kubernetes.io/projected/5cdba282-4bc9-4237-9ce0-1974748f9bbc-kube-api-access-n8fvp\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.953705 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.953576 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdba282-4bc9-4237-9ce0-1974748f9bbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.953705 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.953603 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.953705 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.953664 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.953986 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.953710 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.953986 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.953980 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.954066 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.954032 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.954107 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.954057 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.955854 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.955837 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cdba282-4bc9-4237-9ce0-1974748f9bbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.955982 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.955967 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cdba282-4bc9-4237-9ce0-1974748f9bbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:12.964492 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:12.964468 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fvp\" (UniqueName: \"kubernetes.io/projected/5cdba282-4bc9-4237-9ce0-1974748f9bbc-kube-api-access-n8fvp\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx\" (UID: \"5cdba282-4bc9-4237-9ce0-1974748f9bbc\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:13.111866 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:13.111768 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:13.386952 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:13.386925 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx"] Sep 10 18:01:13.388910 ip-10-0-131-165 kubenswrapper[2588]: W0910 18:01:13.388877 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cdba282_4bc9_4237_9ce0_1974748f9bbc.slice/crio-661cdb7c04431569cce83a1664705302bf03509ed083292c16c5b2fb3912de99 WatchSource:0}: Error finding container 661cdb7c04431569cce83a1664705302bf03509ed083292c16c5b2fb3912de99: Status 404 returned error can't find the container with id 661cdb7c04431569cce83a1664705302bf03509ed083292c16c5b2fb3912de99 Sep 10 18:01:13.610188 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:13.610159 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" event={"ID":"5cdba282-4bc9-4237-9ce0-1974748f9bbc","Type":"ContainerStarted","Data":"661cdb7c04431569cce83a1664705302bf03509ed083292c16c5b2fb3912de99"} Sep 10 18:01:14.622000 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:14.621954 2588 generic.go:356] "Generic (PLEG): container finished" podID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" containerID="2fec763bfa19a8e08c8adaee3d4074a141f3a8a943e52ffb710fb5e17dc94e69" exitCode=0 Sep 10 18:01:14.622391 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:14.622008 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" event={"ID":"5cdba282-4bc9-4237-9ce0-1974748f9bbc","Type":"ContainerDied","Data":"2fec763bfa19a8e08c8adaee3d4074a141f3a8a943e52ffb710fb5e17dc94e69"} Sep 10 18:01:14.622391 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:14.622339 2588 scope.go:117] "RemoveContainer" containerID="2fec763bfa19a8e08c8adaee3d4074a141f3a8a943e52ffb710fb5e17dc94e69" Sep 10 18:01:15.629216 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:15.629133 2588 generic.go:356] "Generic (PLEG): container finished" podID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" containerID="985daa21cf35435d88b2dfcb137e8438192545bbb1207f42e0885b5559d1554a" exitCode=0 Sep 10 18:01:15.629216 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:15.629184 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" event={"ID":"5cdba282-4bc9-4237-9ce0-1974748f9bbc","Type":"ContainerDied","Data":"985daa21cf35435d88b2dfcb137e8438192545bbb1207f42e0885b5559d1554a"} Sep 10 18:01:15.629755 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:15.629230 2588 scope.go:117] "RemoveContainer" containerID="2fec763bfa19a8e08c8adaee3d4074a141f3a8a943e52ffb710fb5e17dc94e69" Sep 10 18:01:15.629755 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:15.629619 2588 scope.go:117] "RemoveContainer" containerID="985daa21cf35435d88b2dfcb137e8438192545bbb1207f42e0885b5559d1554a" Sep 10 18:01:15.629880 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:15.629847 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:01:16.223236 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:16.223195 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:16.223423 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:16.223263 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:16.235488 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:16.235464 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:16.636160 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:16.636128 2588 scope.go:117] "RemoveContainer" containerID="985daa21cf35435d88b2dfcb137e8438192545bbb1207f42e0885b5559d1554a" Sep 10 18:01:16.636548 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:16.636335 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:01:16.647152 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:16.647134 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2" Sep 10 18:01:20.117717 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:20.117682 2588 scope.go:117] "RemoveContainer" containerID="7493d579631d5dafeedd02b4a1307ed947a31fa3a1732d5080055dfb20266cce" Sep 10 18:01:20.118087 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:20.117856 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:01:23.112907 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:23.112868 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:23.113281 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:23.112950 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:23.113281 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:23.112967 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:23.113281 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:23.112987 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:23.113417 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:23.113391 2588 scope.go:117] "RemoveContainer" containerID="985daa21cf35435d88b2dfcb137e8438192545bbb1207f42e0885b5559d1554a" Sep 10 18:01:23.113591 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:23.113570 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:01:31.117896 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:31.117865 2588 scope.go:117] "RemoveContainer" containerID="7493d579631d5dafeedd02b4a1307ed947a31fa3a1732d5080055dfb20266cce" Sep 10 18:01:31.118375 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:31.118037 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:01:38.117296 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:38.117261 2588 scope.go:117] "RemoveContainer" containerID="985daa21cf35435d88b2dfcb137e8438192545bbb1207f42e0885b5559d1554a" Sep 10 18:01:38.750926 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:38.750893 2588 generic.go:356] "Generic (PLEG): container finished" podID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" containerID="4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f" exitCode=0 Sep 10 18:01:38.751088 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:38.750948 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" event={"ID":"5cdba282-4bc9-4237-9ce0-1974748f9bbc","Type":"ContainerDied","Data":"4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f"} Sep 10 18:01:38.751088 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:38.751002 2588 scope.go:117] "RemoveContainer" containerID="985daa21cf35435d88b2dfcb137e8438192545bbb1207f42e0885b5559d1554a" Sep 10 18:01:38.751405 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:38.751381 2588 scope.go:117] "RemoveContainer" containerID="4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f" Sep 10 18:01:38.751622 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:38.751598 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:01:40.647473 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:40.647439 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:01:43.112435 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:43.112394 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:43.112951 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:43.112930 2588 scope.go:117] "RemoveContainer" containerID="4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f" Sep 10 18:01:43.113203 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:43.113169 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:01:43.113784 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:43.113757 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:43.113905 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:43.113826 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:43.113905 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:43.113849 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:01:43.779470 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:43.779042 2588 scope.go:117] "RemoveContainer" containerID="4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f" Sep 10 18:01:43.779470 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:43.779285 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:01:44.118333 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:44.118231 2588 scope.go:117] "RemoveContainer" containerID="7493d579631d5dafeedd02b4a1307ed947a31fa3a1732d5080055dfb20266cce" Sep 10 18:01:44.786504 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:44.786471 2588 generic.go:356] "Generic (PLEG): container finished" podID="5f955430-fed4-4328-8952-eb4bdf27577c" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" exitCode=0 Sep 10 18:01:44.786669 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:44.786545 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" event={"ID":"5f955430-fed4-4328-8952-eb4bdf27577c","Type":"ContainerDied","Data":"c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b"} Sep 10 18:01:44.786669 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:44.786611 2588 scope.go:117] "RemoveContainer" containerID="7493d579631d5dafeedd02b4a1307ed947a31fa3a1732d5080055dfb20266cce" Sep 10 18:01:44.786949 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:44.786934 2588 scope.go:117] "RemoveContainer" containerID="4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f" Sep 10 18:01:44.787020 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:44.786997 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:01:44.787163 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:44.787138 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:01:44.787296 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:44.787165 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:01:48.326330 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:48.326283 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:01:48.326692 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:48.326355 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:01:48.326692 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:48.326373 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:01:48.326692 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:48.326386 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:01:48.326692 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:48.326692 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:01:48.326872 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:48.326853 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:01:58.117887 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:58.117849 2588 scope.go:117] "RemoveContainer" containerID="4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f" Sep 10 18:01:58.118358 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:58.118090 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:01:59.117829 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:01:59.117794 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:01:59.118067 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:01:59.118039 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:02:09.117672 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:09.117633 2588 scope.go:117] "RemoveContainer" containerID="4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f" Sep 10 18:02:09.914559 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:09.914526 2588 generic.go:356] "Generic (PLEG): container finished" podID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" containerID="03d40c169240ef072582e243abc042d89c9cfa54afe502f45cca0cbe98d50043" exitCode=0 Sep 10 18:02:09.914733 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:09.914607 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" event={"ID":"5cdba282-4bc9-4237-9ce0-1974748f9bbc","Type":"ContainerDied","Data":"03d40c169240ef072582e243abc042d89c9cfa54afe502f45cca0cbe98d50043"} Sep 10 18:02:09.914733 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:09.914671 2588 scope.go:117] "RemoveContainer" containerID="4a508732fd1a517419729ed725d98dd486bbdbee2478c419fe0f9e47e3a1a48f" Sep 10 18:02:09.915017 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:09.915002 2588 scope.go:117] "RemoveContainer" containerID="03d40c169240ef072582e243abc042d89c9cfa54afe502f45cca0cbe98d50043" Sep 10 18:02:09.915201 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:09.915179 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:02:09.916605 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:09.916585 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:02:12.297823 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:12.297788 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:02:12.376366 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:12.376331 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:02:13.112065 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:13.112031 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:02:13.112239 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:13.112084 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:02:13.112239 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:13.112106 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:02:13.112239 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:13.112122 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:02:13.112503 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:13.112490 2588 scope.go:117] "RemoveContainer" containerID="03d40c169240ef072582e243abc042d89c9cfa54afe502f45cca0cbe98d50043" Sep 10 18:02:13.112683 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:13.112664 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:02:13.117962 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:13.117946 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:02:13.118125 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:13.118108 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:02:27.117286 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:27.117251 2588 scope.go:117] "RemoveContainer" containerID="03d40c169240ef072582e243abc042d89c9cfa54afe502f45cca0cbe98d50043" Sep 10 18:02:27.117705 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:27.117401 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:02:27.117705 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:27.117474 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:02:27.117705 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:27.117556 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:02:42.118255 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:42.118221 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:02:42.118797 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:42.118346 2588 scope.go:117] "RemoveContainer" containerID="03d40c169240ef072582e243abc042d89c9cfa54afe502f45cca0cbe98d50043" Sep 10 18:02:42.118797 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:42.118444 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:02:42.118797 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:42.118505 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:02:53.120434 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:53.120348 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:02:53.120815 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:53.120532 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:02:54.435734 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:54.435693 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:02:56.118151 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:56.118116 2588 scope.go:117] "RemoveContainer" containerID="03d40c169240ef072582e243abc042d89c9cfa54afe502f45cca0cbe98d50043" Sep 10 18:02:56.118547 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:56.118443 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 18:02:57.149473 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:57.149441 2588 generic.go:356] "Generic (PLEG): container finished" podID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" exitCode=0 Sep 10 18:02:57.149937 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:57.149496 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" event={"ID":"5cdba282-4bc9-4237-9ce0-1974748f9bbc","Type":"ContainerDied","Data":"74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db"} Sep 10 18:02:57.149937 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:57.149555 2588 scope.go:117] "RemoveContainer" containerID="03d40c169240ef072582e243abc042d89c9cfa54afe502f45cca0cbe98d50043" Sep 10 18:02:57.150049 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:02:57.149976 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:02:57.150203 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:02:57.150178 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:03:03.112177 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:03.112125 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:03:03.112629 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:03.112207 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:03:03.112629 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:03.112232 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:03:03.112629 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:03.112252 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:03:03.112743 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:03.112664 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:03:03.112884 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:03.112863 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:03:08.117825 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:08.117795 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:03:09.210332 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:09.210286 2588 generic.go:356] "Generic (PLEG): container finished" podID="5f955430-fed4-4328-8952-eb4bdf27577c" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" exitCode=0 Sep 10 18:03:09.210815 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:09.210349 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" event={"ID":"5f955430-fed4-4328-8952-eb4bdf27577c","Type":"ContainerDied","Data":"607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2"} Sep 10 18:03:09.210815 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:09.210423 2588 scope.go:117] "RemoveContainer" containerID="c124d5eadb43c00f89e2a8370afe8b2869719b85069e621ca7d22c6f9d75d24b" Sep 10 18:03:09.210815 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:09.210782 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:03:09.211006 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:09.210986 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:03:13.416701 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:13.416640 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:03:14.117521 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:14.117485 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:03:14.117686 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:14.117668 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:03:18.326953 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:18.326917 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:03:18.327410 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:18.326978 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:03:18.327410 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:18.326993 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:03:18.327410 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:18.327007 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" Sep 10 18:03:18.327410 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:18.327380 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:03:18.327599 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:18.327547 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:03:23.126952 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:23.126921 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 18:03:23.128566 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:23.128544 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4swb_ff8923a5-5a5e-4d30-8368-4caf0a95424c/ovn-acl-logging/0.log" Sep 10 18:03:28.117241 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:28.117210 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:03:28.119567 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:28.117415 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:03:29.117390 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:29.117346 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:03:29.117890 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:29.117563 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:03:39.118353 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:39.118293 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:03:39.118757 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:39.118486 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:03:42.118096 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:42.118066 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:03:42.118525 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:42.118220 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:03:53.119874 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:53.119844 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:03:53.120303 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:53.120025 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:03:54.117535 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:03:54.117502 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:03:54.117709 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:03:54.117677 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:04:04.118040 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:04.118006 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:04:04.118520 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:04.118197 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:04:09.117545 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:09.117509 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:04:09.118008 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:09.117676 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:04:16.117308 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:16.117221 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:04:16.117700 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:16.117454 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:04:22.117503 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:22.117472 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:04:22.117870 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:22.117629 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:04:27.117626 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:27.117585 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:04:27.605749 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:27.605713 2588 generic.go:356] "Generic (PLEG): container finished" podID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" containerID="42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9" exitCode=0 Sep 10 18:04:27.605749 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:27.605751 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" event={"ID":"5cdba282-4bc9-4237-9ce0-1974748f9bbc","Type":"ContainerDied","Data":"42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9"} Sep 10 18:04:27.605979 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:27.605798 2588 scope.go:117] "RemoveContainer" containerID="74492557da2c8654d09506bb23c0374e64de1715db8e2ba76f8d96c6aaa7a2db" Sep 10 18:04:27.606156 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:27.606128 2588 scope.go:117] "RemoveContainer" containerID="42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9" Sep 10 18:04:27.606420 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:27.606392 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:04:33.112498 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:33.112463 2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:04:33.112878 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:33.112549 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:04:33.112878 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:33.112566 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:04:33.112878 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:33.112581 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" Sep 10 18:04:33.112999 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:33.112911 2588 scope.go:117] "RemoveContainer" containerID="42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9" Sep 10 18:04:33.113121 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:33.113099 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:04:35.118247 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:35.118209 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:04:35.118713 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:35.118513 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:04:48.117675 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:48.117642 2588 scope.go:117] "RemoveContainer" containerID="42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9" Sep 10 18:04:48.118055 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:48.117820 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:04:50.117980 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:04:50.117950 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:04:50.118408 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:04:50.118127 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:05:02.117304 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:02.117275 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:05:02.117722 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:02.117374 2588 scope.go:117] "RemoveContainer" containerID="42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9" Sep 10 18:05:02.117722 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:02.117522 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:05:02.117722 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:02.117534 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:05:11.755831 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:11.755796 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_5cdba282-4bc9-4237-9ce0-1974748f9bbc/main/5.log" Sep 10 18:05:11.871151 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:11.871123 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_5cdba282-4bc9-4237-9ce0-1974748f9bbc/main/5.log" Sep 10 18:05:12.920071 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:12.920036 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58d5dcf594-vhdjj_0f4967a8-6f32-4262-a862-5371e75675da/authorino/0.log" Sep 10 18:05:13.120264 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:13.120231 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:05:13.120467 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:13.120433 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:05:17.118275 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:17.118239 2588 scope.go:117] "RemoveContainer" containerID="42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9" Sep 10 18:05:17.118867 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:17.118527 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:05:18.186356 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:18.186322 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8phqs_403dd2a1-f20b-4b9e-9718-cb1806294ff1/manager/0.log" Sep 10 18:05:18.577127 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:18.577101 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q2rk2_cb7e4090-579b-4237-99ab-8bb24bfe4489/server/0.log" Sep 10 18:05:18.690912 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:18.690883 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4mvbv_2cc58564-94ab-4590-8d92-4da5607ad7d3/manager/0.log" Sep 10 18:05:18.799198 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:18.799168 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cbcccc5-7q8l4_f61dec93-4646-4098-8879-9750f11f2fd3/copy-manifests/0.log" Sep 10 18:05:18.811108 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:18.811082 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cbcccc5-7q8l4_f61dec93-4646-4098-8879-9750f11f2fd3/manager/0.log" Sep 10 18:05:20.292753 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:20.292721 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58d5dcf594-vhdjj_0f4967a8-6f32-4262-a862-5371e75675da/authorino/0.log" Sep 10 18:05:20.405951 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:20.405922 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-xt9bs_39809583-96ab-4853-8df7-8f3519fbfb63/manager/0.log" Sep 10 18:05:20.518043 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:20.518015 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-cnldn_68abdb0b-6921-4b9a-ae2d-0f91b780254c/manager/0.log" Sep 10 18:05:20.987840 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:20.987812 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-4zt8v_64c9fe69-6197-430f-ac67-56cacee30547/manager/0.log" Sep 10 18:05:21.934300 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:21.934270 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zfnhk_862633e5-fc2e-453e-be88-1dfefd999cd8/payload-pre-processing/0.log" Sep 10 18:05:22.162689 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:22.162657 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56688c86cd-hhj85_df815363-cc78-4be5-978e-0d3c9f652093/router/0.log" Sep 10 18:05:22.515981 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:22.515949 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-b5cfl_5f955430-fed4-4328-8952-eb4bdf27577c/main/5.log" Sep 10 18:05:22.860227 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:22.860152 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-r9xjq_620fd108-83ea-4e7b-8d42-2938a9d7a96d/main/0.log" Sep 10 18:05:22.980088 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:22.980056 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgf2b2_a9783be8-17b6-4dd4-a1fa-b8decc1c12bb/main/0.log" Sep 10 18:05:23.095646 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:23.095618 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_5cdba282-4bc9-4237-9ce0-1974748f9bbc/main/5.log" Sep 10 18:05:24.117713 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:24.117676 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:05:24.118084 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:24.117908 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:05:28.322370 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:28.322340 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:05:29.568390 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:29.568355 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" limit=1024 Sep 10 18:05:30.117497 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:30.117464 2588 scope.go:117] "RemoveContainer" containerID="42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9" Sep 10 18:05:30.117677 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:30.117658 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:05:30.960619 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:30.960590 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rjnqb_76889f62-c935-47d0-a249-35a7650c5a03/global-pull-secret-syncer/0.log" Sep 10 18:05:31.038901 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:31.038874 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-drpl9_ee7b9c0a-0b03-4069-94f5-e4375b835807/konnectivity-agent/0.log" Sep 10 18:05:31.123809 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:31.123773 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-165.ec2.internal_5907c737389965eebb4c3a73e149b012/haproxy/0.log" Sep 10 18:05:35.117816 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:35.117777 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:05:35.118210 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:35.118022 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:05:35.828705 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:35.828680 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58d5dcf594-vhdjj_0f4967a8-6f32-4262-a862-5371e75675da/authorino/0.log" Sep 10 18:05:35.867508 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:35.867477 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-xt9bs_39809583-96ab-4853-8df7-8f3519fbfb63/manager/0.log" Sep 10 18:05:35.890420 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:35.890397 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-cnldn_68abdb0b-6921-4b9a-ae2d-0f91b780254c/manager/0.log" Sep 10 18:05:36.019719 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:36.019630 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-4zt8v_64c9fe69-6197-430f-ac67-56cacee30547/manager/0.log" Sep 10 18:05:37.702111 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:37.702033 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-qlqkl_72ca04f0-cd13-45cf-aa3d-31ef9675c780/cluster-monitoring-operator/0.log" Sep 10 18:05:37.728259 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:37.728230 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-qhv4c_00fda959-60ce-40fa-936a-214e1ba67894/kube-state-metrics/0.log" Sep 10 18:05:37.754139 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:37.754115 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-qhv4c_00fda959-60ce-40fa-936a-214e1ba67894/kube-rbac-proxy-main/0.log" Sep 10 18:05:37.775136 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:37.775112 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-qhv4c_00fda959-60ce-40fa-936a-214e1ba67894/kube-rbac-proxy-self/0.log" Sep 10 18:05:38.016773 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.016744 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlfpv_a1e1374d-d186-4296-a5fb-e0a36e78d001/node-exporter/0.log" Sep 10 18:05:38.036647 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.036618 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlfpv_a1e1374d-d186-4296-a5fb-e0a36e78d001/kube-rbac-proxy/0.log" Sep 10 18:05:38.056978 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.056948 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlfpv_a1e1374d-d186-4296-a5fb-e0a36e78d001/init-textfile/0.log" Sep 10 18:05:38.173251 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.173225 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b/prometheus/0.log" Sep 10 18:05:38.192242 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.192220 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b/config-reloader/0.log" Sep 10 18:05:38.214640 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.214612 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b/thanos-sidecar/0.log" Sep 10 18:05:38.234486 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.234456 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b/kube-rbac-proxy-web/0.log" Sep 10 18:05:38.256332 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.256293 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b/kube-rbac-proxy/0.log" Sep 10 18:05:38.279464 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.279397 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b/kube-rbac-proxy-thanos/0.log" Sep 10 18:05:38.301047 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.301021 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e9ba632-ea0a-434f-b6c8-e1bd565e4a6b/init-config-reloader/0.log" Sep 10 18:05:38.454652 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.454625 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d6d96dd67-mz6z2_1727decf-9297-4d7a-9da3-9c67f9265281/telemeter-client/0.log" Sep 10 18:05:38.474582 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.474558 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d6d96dd67-mz6z2_1727decf-9297-4d7a-9da3-9c67f9265281/reload/0.log" Sep 10 18:05:38.493725 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:38.493700 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d6d96dd67-mz6z2_1727decf-9297-4d7a-9da3-9c67f9265281/kube-rbac-proxy/0.log" Sep 10 18:05:41.147421 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.147388 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm"] Sep 10 18:05:41.151103 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.151082 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.153382 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.153365 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cj7qw\"/\"kube-root-ca.crt\"" Sep 10 18:05:41.154158 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.154130 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cj7qw\"/\"openshift-service-ca.crt\"" Sep 10 18:05:41.154296 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.154139 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cj7qw\"/\"default-dockercfg-tz6hl\"" Sep 10 18:05:41.160203 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.160179 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm"] Sep 10 18:05:41.256586 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.256549 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-podres\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.256586 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.256584 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-lib-modules\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.256795 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.256614 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvrtq\" (UniqueName: \"kubernetes.io/projected/e535994d-1836-436f-9f56-403a91bf3ca2-kube-api-access-jvrtq\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.256795 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.256701 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-sys\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.256795 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.256742 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-proc\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357224 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357196 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-sys\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357440 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357232 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-proc\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357440 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357329 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-podres\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357440 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357358 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-lib-modules\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357440 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357327 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-sys\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357625 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357448 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-podres\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357625 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357396 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-proc\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357625 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357399 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvrtq\" (UniqueName: \"kubernetes.io/projected/e535994d-1836-436f-9f56-403a91bf3ca2-kube-api-access-jvrtq\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.357625 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.357490 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e535994d-1836-436f-9f56-403a91bf3ca2-lib-modules\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.358661 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.358646 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-vvltd_30fad948-16ec-4c25-820f-356445321db1/download-server/0.log" Sep 10 18:05:41.365239 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.365217 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvrtq\" (UniqueName: \"kubernetes.io/projected/e535994d-1836-436f-9f56-403a91bf3ca2-kube-api-access-jvrtq\") pod \"perf-node-gather-daemonset-hqlnm\" (UID: \"e535994d-1836-436f-9f56-403a91bf3ca2\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.461693 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.461603 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:41.729190 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.729142 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm"] Sep 10 18:05:41.731359 ip-10-0-131-165 kubenswrapper[2588]: W0910 18:05:41.731332 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode535994d_1836_436f_9f56_403a91bf3ca2.slice/crio-ab220243ea3834d81113f2f59420bc3bb81c8f50e9d229512402f5cd82b73540 WatchSource:0}: Error finding container ab220243ea3834d81113f2f59420bc3bb81c8f50e9d229512402f5cd82b73540: Status 404 returned error can't find the container with id ab220243ea3834d81113f2f59420bc3bb81c8f50e9d229512402f5cd82b73540 Sep 10 18:05:41.985569 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.985467 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" event={"ID":"e535994d-1836-436f-9f56-403a91bf3ca2","Type":"ContainerStarted","Data":"c572b31e217845aa67bfd2df20a9832ef20979df43a1e31fbc2dc6ebaa90b053"} Sep 10 18:05:41.985569 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.985520 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" event={"ID":"e535994d-1836-436f-9f56-403a91bf3ca2","Type":"ContainerStarted","Data":"ab220243ea3834d81113f2f59420bc3bb81c8f50e9d229512402f5cd82b73540"} Sep 10 18:05:41.985807 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:41.985582 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:42.001332 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:42.001256 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" podStartSLOduration=1.001237574 podStartE2EDuration="1.001237574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:05:41.999386501 +0000 UTC m=+1339.393835758" watchObservedRunningTime="2026-09-10 18:05:42.001237574 +0000 UTC m=+1339.395686846" Sep 10 18:05:43.019978 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:43.019948 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-59p25_15e5fae2-6ec1-4a98-8e17-d5c7118961c0/dns/0.log" Sep 10 18:05:43.038568 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:43.038533 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-59p25_15e5fae2-6ec1-4a98-8e17-d5c7118961c0/kube-rbac-proxy/0.log" Sep 10 18:05:43.119530 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:43.119500 2588 scope.go:117] "RemoveContainer" containerID="42bf1a103e83313b9b2392301f3aaad42c3a132aea30577b3bc48cd8ab6dc9e9" Sep 10 18:05:43.119738 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:43.119689 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx_llm(5cdba282-4bc9-4237-9ce0-1974748f9bbc)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-gwltx" podUID="5cdba282-4bc9-4237-9ce0-1974748f9bbc" Sep 10 18:05:43.192690 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:43.192659 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n6zbr_61acebda-4243-4f37-b852-1584bbe917bc/dns-node-resolver/0.log" Sep 10 18:05:43.777184 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:43.777154 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tt7rv_bed09fa0-af01-4f59-91e0-a6c7c7d9ff07/node-ca/0.log" Sep 10 18:05:44.819892 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:44.819862 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zfnhk_862633e5-fc2e-453e-be88-1dfefd999cd8/payload-pre-processing/0.log" Sep 10 18:05:44.868271 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:44.868239 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56688c86cd-hhj85_df815363-cc78-4be5-978e-0d3c9f652093/router/0.log" Sep 10 18:05:45.448886 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:45.448812 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2gmwm_3f5fe123-739a-4e69-a7b2-33312d784386/serve-healthcheck-canary/0.log" Sep 10 18:05:46.048474 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:46.048448 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4ssb_a3b6438c-5b70-4936-99f2-cf1a6ea84920/kube-rbac-proxy/0.log" Sep 10 18:05:46.066124 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:46.066097 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4ssb_a3b6438c-5b70-4936-99f2-cf1a6ea84920/exporter/0.log" Sep 10 18:05:46.084946 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:46.084923 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4ssb_a3b6438c-5b70-4936-99f2-cf1a6ea84920/extractor/0.log" Sep 10 18:05:47.117823 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:47.117782 2588 scope.go:117] "RemoveContainer" containerID="607ec91107b3a1686c1b51f4a63b5c5e12d60ef58b8543adb34bdb40ea31efd2" Sep 10 18:05:47.118348 ip-10-0-131-165 kubenswrapper[2588]: E0910 18:05:47.118030 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-b5cfl_llm(5f955430-fed4-4328-8952-eb4bdf27577c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-b5cfl" podUID="5f955430-fed4-4328-8952-eb4bdf27577c" Sep 10 18:05:48.001297 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:48.001269 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-hqlnm" Sep 10 18:05:48.215162 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:48.215135 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8phqs_403dd2a1-f20b-4b9e-9718-cb1806294ff1/manager/0.log" Sep 10 18:05:48.316235 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:48.316152 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-q2rk2_cb7e4090-579b-4237-99ab-8bb24bfe4489/server/0.log" Sep 10 18:05:48.367323 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:48.367293 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4mvbv_2cc58564-94ab-4590-8d92-4da5607ad7d3/manager/0.log" Sep 10 18:05:48.414485 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:48.414455 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cbcccc5-7q8l4_f61dec93-4646-4098-8879-9750f11f2fd3/manager/0.log" Sep 10 18:05:48.431114 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:48.431087 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cbcccc5-7q8l4_f61dec93-4646-4098-8879-9750f11f2fd3/copy-manifests/0.log" Sep 10 18:05:49.942674 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:49.942596 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6547fb5f9d-8svjq_1d2bdb73-e560-4f65-9239-6dfbe45bf906/manager/0.log" Sep 10 18:05:49.995854 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:49.995823 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-58zbq_4d3f7275-606e-4b1b-914d-2d54632d6aa1/openshift-lws-operator/0.log" Sep 10 18:05:51.975708 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:51.975675 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zfnhk_862633e5-fc2e-453e-be88-1dfefd999cd8/payload-pre-processing/0.log" Sep 10 18:05:52.014031 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:52.014002 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56688c86cd-hhj85_df815363-cc78-4be5-978e-0d3c9f652093/router/0.log" Sep 10 18:05:53.251929 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:53.251899 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zfnhk_862633e5-fc2e-453e-be88-1dfefd999cd8/payload-pre-processing/0.log" Sep 10 18:05:53.282478 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:53.282445 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56688c86cd-hhj85_df815363-cc78-4be5-978e-0d3c9f652093/router/0.log" Sep 10 18:05:55.627104 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:55.627065 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-qq5r4_eeb5f6f8-b04c-429c-8585-7a74b36969f4/kube-storage-version-migrator-operator/1.log" Sep 10 18:05:55.627799 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:55.627782 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-qq5r4_eeb5f6f8-b04c-429c-8585-7a74b36969f4/kube-storage-version-migrator-operator/0.log" Sep 10 18:05:56.600701 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:56.600670 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7jzcr_2dc63600-b198-4c68-b838-a40560abc448/kube-multus/0.log" Sep 10 18:05:57.042553 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.042523 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x54pr_19f47f90-d4c7-40d8-97b5-21447400a63d/kube-multus-additional-cni-plugins/0.log" Sep 10 18:05:57.060905 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.060877 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x54pr_19f47f90-d4c7-40d8-97b5-21447400a63d/egress-router-binary-copy/0.log" Sep 10 18:05:57.079677 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.079651 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x54pr_19f47f90-d4c7-40d8-97b5-21447400a63d/cni-plugins/0.log" Sep 10 18:05:57.097830 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.097810 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x54pr_19f47f90-d4c7-40d8-97b5-21447400a63d/bond-cni-plugin/0.log" Sep 10 18:05:57.115884 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.115861 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x54pr_19f47f90-d4c7-40d8-97b5-21447400a63d/routeoverride-cni/0.log" Sep 10 18:05:57.134453 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.134430 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x54pr_19f47f90-d4c7-40d8-97b5-21447400a63d/whereabouts-cni-bincopy/0.log" Sep 10 18:05:57.158611 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.158583 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x54pr_19f47f90-d4c7-40d8-97b5-21447400a63d/whereabouts-cni/0.log" Sep 10 18:05:57.374176 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.374098 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qmzql_aeee428e-a7c2-41dc-b6fe-f24a9a337b9d/network-metrics-daemon/0.log" Sep 10 18:05:57.392919 ip-10-0-131-165 kubenswrapper[2588]: I0910 18:05:57.392896 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qmzql_aeee428e-a7c2-41dc-b6fe-f24a9a337b9d/kube-rbac-proxy/0.log"