Sep 18 23:58:17.467185 ip-10-0-141-42 systemd[1]: Starting Kubernetes Kubelet... Sep 18 23:58:17.854688 ip-10-0-141-42 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 23:58:17.854688 ip-10-0-141-42 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 23:58:17.854688 ip-10-0-141-42 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 23:58:17.854688 ip-10-0-141-42 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 23:58:17.854688 ip-10-0-141-42 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 23:58:17.855366 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.854776 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 23:58:17.859266 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859248 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:17.859266 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859264 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:17.859266 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859269 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859272 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859277 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859281 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859285 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859287 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859290 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859293 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859295 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859298 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859301 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859304 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859306 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859314 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859316 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859319 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859322 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859324 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859327 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:17.859371 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859330 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859333 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859335 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859338 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859340 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859343 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859346 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859348 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859351 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859353 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859356 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859358 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859361 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859363 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859366 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859370 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859373 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859375 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859378 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:17.859825 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859381 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859385 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859389 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859392 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859394 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859397 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859400 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859403 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859406 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859409 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859412 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859415 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859417 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859421 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859425 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859428 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859431 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859434 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859436 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:17.860301 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859439 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859441 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859444 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859447 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859449 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859452 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859454 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859456 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859459 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859463 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859466 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859468 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859471 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859474 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859476 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859480 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859483 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859485 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859488 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859491 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:17.860761 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859494 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859496 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859498 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859501 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859504 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859507 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859509 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859511 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859514 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859516 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859519 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859521 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859524 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859526 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859529 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859531 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859534 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859537 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859539 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.859542 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:17.861272 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860261 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860269 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860273 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860277 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860281 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860284 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860287 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860290 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860293 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860296 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860299 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860302 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860305 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860308 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860310 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860313 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860316 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860318 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860321 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:17.861797 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860323 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860326 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860328 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860332 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860335 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860338 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860341 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860343 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860346 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860349 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860352 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860354 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860357 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860359 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860363 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860365 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860368 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860371 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860373 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:17.862286 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860376 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860379 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860381 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860383 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860387 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860390 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860392 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860395 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860397 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860400 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860402 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860404 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860407 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860410 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860412 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860414 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860417 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860420 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860422 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860426 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:17.862754 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860429 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860432 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860436 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860439 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860441 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860444 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860446 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860449 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860452 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860454 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860457 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860459 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860462 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860464 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860467 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860469 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860472 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860480 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860483 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860485 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:17.863250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860488 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860490 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860493 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860495 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860498 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860500 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860503 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860505 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860507 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860510 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860512 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860517 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860520 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860523 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860526 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860528 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860530 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860533 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860536 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860538 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:17.863734 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860541 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860965 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860971 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860973 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860976 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860979 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860981 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860984 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860987 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860990 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860992 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860995 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.860998 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861000 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861003 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861006 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861009 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861012 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861014 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861017 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:17.864252 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861019 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861022 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861024 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861037 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861041 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861043 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861046 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861048 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861051 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861054 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861056 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861059 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861062 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861064 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861067 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861069 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861072 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861074 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861077 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861079 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:17.864740 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861082 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861085 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861093 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861096 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861099 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861102 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861105 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861108 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861111 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861113 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861116 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861118 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861121 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861123 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861126 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861129 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861132 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861135 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861137 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861140 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:17.865250 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861142 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861145 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861147 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861150 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861152 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861155 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861157 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861162 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861165 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861168 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861171 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861174 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861176 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861178 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861181 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861184 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861186 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861189 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861191 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861194 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:17.865735 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861197 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861201 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861204 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861207 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861209 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861212 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861216 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861222 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861225 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861228 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861231 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861234 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861237 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861239 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861242 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861244 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861247 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861249 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861252 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:17.866244 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.861254 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861344 2568 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861383 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861391 2568 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861398 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861402 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861405 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861410 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861415 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861418 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861421 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861438 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861442 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861446 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861449 2568 flags.go:64] FLAG: --cgroup-root="" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861453 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861456 2568 flags.go:64] FLAG: --client-ca-file="" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861459 2568 flags.go:64] FLAG: --cloud-provider="external" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861462 2568 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861467 2568 flags.go:64] FLAG: --cluster-domain="" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861471 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861474 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861477 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861481 2568 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 23:58:17.866735 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861485 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861487 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861490 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861494 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861497 2568 flags.go:64] FLAG: --contention-profiling="false" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861500 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861503 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861507 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861510 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861514 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861517 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861521 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861524 2568 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861527 2568 flags.go:64] FLAG: --enable-server="true" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861529 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861534 2568 flags.go:64] FLAG: --event-burst="100" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861537 2568 flags.go:64] FLAG: --event-qps="50" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861540 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861543 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861546 2568 flags.go:64] FLAG: --eviction-hard="" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861550 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861553 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861556 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861559 2568 flags.go:64] FLAG: --eviction-soft="" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861562 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 23:58:17.867341 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861565 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861568 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861571 2568 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861574 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861577 2568 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861580 2568 flags.go:64] FLAG: --feature-gates="" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861584 2568 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861587 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861590 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861593 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861596 2568 flags.go:64] FLAG: --healthz-port="10248" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861599 2568 flags.go:64] FLAG: --help="false" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861602 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-141-42.ec2.internal" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861605 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861608 2568 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861610 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861614 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861617 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861621 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861624 2568 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861627 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861630 2568 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861633 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861636 2568 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 23:58:17.868114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861640 2568 flags.go:64] FLAG: --kube-reserved="" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861643 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861646 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861649 2568 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861651 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861654 2568 flags.go:64] FLAG: --lock-file="" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861657 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861660 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861663 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861669 2568 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861672 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861674 2568 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861677 2568 flags.go:64] FLAG: --logging-format="text" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861680 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861683 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861686 2568 flags.go:64] FLAG: --manifest-url="" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861688 2568 flags.go:64] FLAG: --manifest-url-header="" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861693 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861696 2568 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861700 2568 flags.go:64] FLAG: --max-pods="110" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861702 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861705 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861708 2568 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861711 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861714 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 23:58:17.868696 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861717 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861721 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861728 2568 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861732 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861735 2568 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861738 2568 flags.go:64] FLAG: --pod-cidr="" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861741 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861747 2568 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861750 2568 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861753 2568 flags.go:64] FLAG: --pods-per-core="0" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861756 2568 flags.go:64] FLAG: --port="10250" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861759 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861762 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c49127b4f929a59b" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861765 2568 flags.go:64] FLAG: --qos-reserved="" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861768 2568 flags.go:64] FLAG: --read-only-port="10255" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861772 2568 flags.go:64] FLAG: --register-node="true" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861775 2568 flags.go:64] FLAG: --register-with-taints="" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861778 2568 flags.go:64] FLAG: --registry-burst="10" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861781 2568 flags.go:64] FLAG: --registry-qps="5" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861784 2568 flags.go:64] FLAG: --reserved-cpus="" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861787 2568 flags.go:64] FLAG: --reserved-memory="" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861791 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861794 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861797 2568 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861800 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 23:58:17.869358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861803 2568 flags.go:64] FLAG: --runonce="false" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861806 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861809 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861812 2568 flags.go:64] FLAG: --seccomp-default="false" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861815 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861818 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861821 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861824 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861829 2568 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861832 2568 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861834 2568 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861837 2568 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861840 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861843 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861846 2568 flags.go:64] FLAG: --system-cgroups="" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861849 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861855 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861858 2568 flags.go:64] FLAG: --tls-cert-file="" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861867 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861873 2568 flags.go:64] FLAG: --tls-min-version="" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861876 2568 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861880 2568 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861883 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861899 2568 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861903 2568 flags.go:64] FLAG: --v="2" Sep 18 23:58:17.870015 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861907 2568 flags.go:64] FLAG: --version="false" Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861911 2568 flags.go:64] FLAG: --vmodule="" Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861914 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.861918 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862060 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862064 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862067 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862071 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862074 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862078 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862080 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862083 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862086 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862088 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862091 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862096 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862099 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862102 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862104 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862107 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:17.870630 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862110 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862112 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862115 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862117 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862121 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862124 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862133 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862136 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862140 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862143 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862145 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862148 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862151 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862153 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862156 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862159 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862161 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862164 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862166 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862169 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:17.871127 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862172 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862174 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862177 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862179 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862182 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862184 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862187 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862190 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862193 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862196 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862199 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862202 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862204 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862207 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862210 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862212 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862215 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862218 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862220 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:17.871616 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862223 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862227 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862230 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862232 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862235 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862237 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862240 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862243 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862245 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862248 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862250 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862253 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862255 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862258 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862260 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862263 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862266 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862268 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862271 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862274 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:17.872097 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862277 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862280 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862282 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862285 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862288 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862290 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862294 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862298 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862301 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862304 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862307 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862310 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862312 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862316 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862319 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862322 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862324 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862327 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862330 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:17.872601 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862332 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862335 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862338 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862341 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.862343 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.862851 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.870538 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.870553 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.871589 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.871597 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871664 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871670 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871673 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871676 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871679 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:17.873099 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871682 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871685 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871687 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871690 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871693 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871696 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871698 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871701 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871704 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871706 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871709 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871712 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871715 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871718 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871720 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871723 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871725 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871729 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871732 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871735 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:17.873515 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871737 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871740 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871742 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871745 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871748 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871751 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871754 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871757 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871759 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871762 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871765 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871767 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871770 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871773 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871775 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871778 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871781 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871784 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871787 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871792 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:17.874017 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871795 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871798 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871801 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871804 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871808 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871810 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871813 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871816 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871818 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871821 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871824 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871826 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871830 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871834 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871837 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871839 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871843 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871846 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871849 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:17.874493 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871852 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871854 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871857 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871860 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871862 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871865 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871867 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871870 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871872 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871875 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871878 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871880 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871883 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871895 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871898 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871901 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871904 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871906 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871911 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:17.875037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871914 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871917 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871920 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871923 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871926 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871929 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871932 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871935 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871937 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871941 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871943 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871946 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871949 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871951 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871954 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:17.875505 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.871957 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.871962 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872085 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872090 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872093 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872096 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872099 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872101 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872104 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872107 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872110 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872113 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872116 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872120 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 23:58:17.875989 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872124 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872126 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872129 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872133 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872135 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872139 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872142 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872145 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872147 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872150 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872153 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872156 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872159 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872161 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872164 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872166 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872169 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872172 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872174 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872177 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 23:58:17.876350 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872179 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872182 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872185 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872188 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872192 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872195 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872198 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872201 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872203 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872206 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872209 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872211 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872214 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872216 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872219 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872221 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872224 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872226 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872229 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 23:58:17.876980 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872232 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872235 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872238 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872240 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872243 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872245 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872248 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872250 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872253 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872255 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872258 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872261 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872263 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872266 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872268 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872271 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872273 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872292 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872295 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872298 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 23:58:17.877472 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872301 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872304 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872307 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872310 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872312 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872315 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872317 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872320 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872323 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872325 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872328 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872331 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872334 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872337 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872339 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872342 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872344 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872347 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872350 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 23:58:17.878076 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872353 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872355 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872358 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872360 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872363 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872365 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872368 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872370 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:17.872373 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.872377 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.872488 2568 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.874616 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.875619 2568 server.go:1019] "Starting client certificate rotation" Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.875740 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 23:58:17.878720 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.875782 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 23:58:17.880273 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.880239 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 23:58:17.882648 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.882629 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 23:58:17.893055 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.893038 2568 log.go:25] "Validated CRI v1 runtime API" Sep 18 23:58:17.894586 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.894572 2568 log.go:25] "Validated CRI v1 image API" Sep 18 23:58:17.895467 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.895451 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 23:58:17.898388 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.898369 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7c415149-1491-4417-ad5b-84e98bad2c6f:/dev/nvme0n1p3 969c3b12-fdbd-4289-86ed-d5d518006188:/dev/nvme0n1p4] Sep 18 23:58:17.898468 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.898386 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 23:58:17.903252 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.903139 2568 manager.go:216] Machine: {Timestamp:2026-09-18 23:58:17.90194991 +0000 UTC m=+0.320674309 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101880 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27068e71dbb0b7f539541bc9ac4d44 SystemUUID:ec27068e-71db-b0b7-f539-541bc9ac4d44 BootID:05104d88-5b67-4928-9cfc-80ed16abbc7b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c7:b4:38:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c7:b4:38:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:b0:45:84:76:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 23:58:17.903252 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.903243 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 23:58:17.903386 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.903321 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 23:58:17.904431 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.904411 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 23:58:17.904581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.904433 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 23:58:17.905118 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.905108 2568 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 23:58:17.905196 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.905120 2568 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 23:58:17.905196 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.905128 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 23:58:17.906484 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.906474 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 23:58:17.908013 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.908000 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 23:58:17.911102 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.911084 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 23:58:17.912743 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.912731 2568 state_mem.go:36] "Initialized new in-memory state store" Sep 18 23:58:17.912842 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.912833 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 23:58:17.912884 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.912861 2568 kubelet.go:486] "Attempting to sync node with API server" Sep 18 23:58:17.912884 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.912879 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 23:58:17.912950 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.912904 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 23:58:17.912950 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.912913 2568 kubelet.go:398] "Adding apiserver pod source" Sep 18 23:58:17.912950 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.912922 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 23:58:17.913268 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.913257 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 23:58:17.913307 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.913297 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 23:58:17.915750 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.915735 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 23:58:17.920425 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.920405 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 23:58:17.920491 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.920439 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 23:58:17.920611 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.920601 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 23:58:17.920641 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.920621 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 23:58:17.920641 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.920628 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 23:58:17.920641 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.920634 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 23:58:17.920734 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.920645 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 23:58:17.920734 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.920652 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 23:58:17.921486 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.921470 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 23:58:17.921486 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.921486 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 23:58:17.921581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.921498 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 23:58:17.921581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.921507 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 23:58:17.921581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.921532 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 23:58:17.921581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.921544 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 23:58:17.922350 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.922336 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 23:58:17.922350 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.922349 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 23:58:17.923703 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.923679 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 23:58:17.923756 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.923709 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 23:58:17.926108 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.926096 2568 server.go:1268] "Started kubelet" Sep 18 23:58:17.926202 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.926170 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 23:58:17.926288 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.926190 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 23:58:17.926288 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.926253 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 23:58:17.926547 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.926530 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 23:58:17.927038 ip-10-0-141-42 systemd[1]: Started Kubernetes Kubelet. Sep 18 23:58:17.928083 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.928068 2568 server.go:310] "Adding debug handlers to kubelet server" Sep 18 23:58:17.932649 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.932624 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 23:58:17.934272 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.934254 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 23:58:17.935366 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.934288 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-42.ec2.internal.18d68fb24f7061fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-42.ec2.internal,UID:ip-10-0-141-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-42.ec2.internal,},FirstTimestamp:2026-09-18 23:58:17.926066686 +0000 UTC m=+0.344791085,LastTimestamp:2026-09-18 23:58:17.926066686 +0000 UTC m=+0.344791085,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-42.ec2.internal,}" Sep 18 23:58:17.937807 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.937791 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 23:58:17.938488 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.938472 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 23:58:17.938648 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.938627 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:17.939243 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939228 2568 factory.go:55] Registering systemd factory Sep 18 23:58:17.939243 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939245 2568 factory.go:223] Registration of the systemd container factory successfully Sep 18 23:58:17.939350 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939292 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 23:58:17.939350 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939293 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 23:58:17.939350 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939315 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 23:58:17.939456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939402 2568 reconstruct.go:97] "Volume reconstruction finished" Sep 18 23:58:17.939456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939411 2568 reconciler.go:29] "Reconciler: start to sync state" Sep 18 23:58:17.939559 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939484 2568 factory.go:153] Registering CRI-O factory Sep 18 23:58:17.939559 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939497 2568 factory.go:223] Registration of the crio container factory successfully Sep 18 23:58:17.939559 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939541 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 23:58:17.939689 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939562 2568 factory.go:103] Registering Raw factory Sep 18 23:58:17.939689 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939577 2568 manager.go:1196] Started watching for new ooms in manager Sep 18 23:58:17.939981 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.939970 2568 manager.go:349] Starting recovery of all containers Sep 18 23:58:17.943528 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.943500 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 23:58:17.944089 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.944062 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 23:58:17.949825 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.949679 2568 manager.go:354] Recovery completed Sep 18 23:58:17.951997 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.951963 2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 18 23:58:17.955200 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.955186 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:17.956874 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.956850 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:17.956954 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.956902 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:17.956954 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.956916 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:17.957512 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.957499 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:17.957594 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.957500 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 23:58:17.957594 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.957568 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 23:58:17.957594 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.957588 2568 state_mem.go:36] "Initialized new in-memory state store" Sep 18 23:58:17.958182 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.958164 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:17.958249 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.958193 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:17.958249 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.958203 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:17.959401 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.959333 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-42.ec2.internal.18d68fb2514679eb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-42.ec2.internal,UID:ip-10-0-141-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-42.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-42.ec2.internal,},FirstTimestamp:2026-09-18 23:58:17.956874731 +0000 UTC m=+0.375599137,LastTimestamp:2026-09-18 23:58:17.956874731 +0000 UTC m=+0.375599137,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-42.ec2.internal,}" Sep 18 23:58:17.959830 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.959816 2568 policy_none.go:49] "None policy: Start" Sep 18 23:58:17.959830 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.959833 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 23:58:17.959943 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.959843 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 23:58:17.961842 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.961830 2568 policy_none.go:47] "Start" Sep 18 23:58:17.972529 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.972464 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-42.ec2.internal.18d68fb25147003b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-42.ec2.internal,UID:ip-10-0-141-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-42.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-42.ec2.internal,},FirstTimestamp:2026-09-18 23:58:17.956909115 +0000 UTC m=+0.375633516,LastTimestamp:2026-09-18 23:58:17.956909115 +0000 UTC m=+0.375633516,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-42.ec2.internal,}" Sep 18 23:58:17.974732 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.974716 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5skm5" Sep 18 23:58:17.984013 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:17.983995 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5skm5" Sep 18 23:58:17.984301 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:17.984232 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-42.ec2.internal.18d68fb2514733c6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-42.ec2.internal,UID:ip-10-0-141-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-42.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-42.ec2.internal,},FirstTimestamp:2026-09-18 23:58:17.95692231 +0000 UTC m=+0.375646716,LastTimestamp:2026-09-18 23:58:17.95692231 +0000 UTC m=+0.375646716,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-42.ec2.internal,}" Sep 18 23:58:18.008452 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.008439 2568 manager.go:337] "Starting Device Plugin manager" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.008471 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.008481 2568 server.go:87] "Starting device plugin registration server" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.008826 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.008839 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.008942 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.009037 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.009045 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.011689 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.011734 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.014496 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.015625 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.015664 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.015684 2568 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.015750 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 23:58:18.022156 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.017609 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:18.109925 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.109824 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:18.110820 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.110804 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:18.110885 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.110840 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:18.110885 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.110854 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:18.110885 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.110876 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.115849 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.115829 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal"] Sep 18 23:58:18.115965 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.115953 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:18.117572 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.117557 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:18.117660 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.117592 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:18.117660 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.117606 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:18.119844 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.119827 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.119929 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.119852 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-42.ec2.internal\": node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.119991 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.119968 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:18.120091 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.120074 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.120132 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.120106 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:18.120708 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.120692 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:18.120708 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.120704 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:18.120839 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.120722 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:18.120839 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.120728 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:18.120839 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.120737 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:18.120839 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.120742 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:18.122979 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.122964 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.123066 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.122992 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:18.123657 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.123639 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:18.123732 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.123673 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:18.123732 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.123688 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:18.140369 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.140349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31fc66dad6df1899f546ef5f61b06def-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal\" (UID: \"31fc66dad6df1899f546ef5f61b06def\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.140456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.140380 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31fc66dad6df1899f546ef5f61b06def-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal\" (UID: \"31fc66dad6df1899f546ef5f61b06def\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.140456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.140416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2c137e820cf81485eca551db40735ae-config\") pod \"kube-apiserver-proxy-ip-10-0-141-42.ec2.internal\" (UID: \"e2c137e820cf81485eca551db40735ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.140535 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.140451 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-42.ec2.internal\" not found" node="ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.144801 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.144785 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-42.ec2.internal\" not found" node="ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.146954 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.146939 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.241185 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.241157 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31fc66dad6df1899f546ef5f61b06def-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal\" (UID: \"31fc66dad6df1899f546ef5f61b06def\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.241185 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.241186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31fc66dad6df1899f546ef5f61b06def-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal\" (UID: \"31fc66dad6df1899f546ef5f61b06def\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.241348 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.241202 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2c137e820cf81485eca551db40735ae-config\") pod \"kube-apiserver-proxy-ip-10-0-141-42.ec2.internal\" (UID: \"e2c137e820cf81485eca551db40735ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.241348 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.241252 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31fc66dad6df1899f546ef5f61b06def-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal\" (UID: \"31fc66dad6df1899f546ef5f61b06def\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.241348 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.241261 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31fc66dad6df1899f546ef5f61b06def-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal\" (UID: \"31fc66dad6df1899f546ef5f61b06def\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.241348 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.241260 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2c137e820cf81485eca551db40735ae-config\") pod \"kube-apiserver-proxy-ip-10-0-141-42.ec2.internal\" (UID: \"e2c137e820cf81485eca551db40735ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.247278 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.247263 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.347792 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.347743 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.444647 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.444567 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.448712 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.448693 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.450452 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.450430 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" Sep 18 23:58:18.549690 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.549655 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.650217 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.650196 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.750759 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.750692 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.770639 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.770619 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:18.850902 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.850859 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.874966 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.874946 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 23:58:18.875310 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.875102 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 23:58:18.875310 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.875098 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 23:58:18.951501 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:18.951476 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:18.989949 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.989911 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 23:53:18 +0000 UTC" deadline="2028-05-26 12:21:53.943566408 +0000 UTC" Sep 18 23:58:18.990060 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:18.989951 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14772h23m34.953621627s" Sep 18 23:58:19.024482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.024435 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 23:58:19.025533 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.025516 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientMemory" Sep 18 23:58:19.025618 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.025548 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 23:58:19.025618 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.025559 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeHasSufficientPID" Sep 18 23:58:19.051768 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:19.051547 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:19.151830 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:19.151794 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:19.181140 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:19.181102 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c137e820cf81485eca551db40735ae.slice/crio-34afef4f034976f0749eac0cd678c35cb46914d7a8fd53b4ca880b7d069a4811 WatchSource:0}: Error finding container 34afef4f034976f0749eac0cd678c35cb46914d7a8fd53b4ca880b7d069a4811: Status 404 returned error can't find the container with id 34afef4f034976f0749eac0cd678c35cb46914d7a8fd53b4ca880b7d069a4811 Sep 18 23:58:19.181767 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:19.181743 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fc66dad6df1899f546ef5f61b06def.slice/crio-c64fb814d899bc1a1f6f4ea9db65a785211de8de664b7e38403730247738bb10 WatchSource:0}: Error finding container c64fb814d899bc1a1f6f4ea9db65a785211de8de664b7e38403730247738bb10: Status 404 returned error can't find the container with id c64fb814d899bc1a1f6f4ea9db65a785211de8de664b7e38403730247738bb10 Sep 18 23:58:19.189126 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.189109 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 23:58:19.252986 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:19.252951 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:19.354163 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:19.354073 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:19.358165 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.358138 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:19.455105 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:19.455060 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-42.ec2.internal\" not found" Sep 18 23:58:19.489907 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.489878 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:19.541943 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.541912 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" Sep 18 23:58:19.554761 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.554740 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 23:58:19.556051 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.556033 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" Sep 18 23:58:19.564829 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.564808 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 23:58:19.748226 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.748193 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:19.914342 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.914309 2568 apiserver.go:52] "Watching apiserver" Sep 18 23:58:19.922764 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.922738 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 23:58:19.924832 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.924803 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hdpmx","kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8n2zk","openshift-image-registry/node-ca-b6w24","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal","openshift-multus/multus-zqnnn","kube-system/konnectivity-agent-h9wwn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm","openshift-dns/node-resolver-rfjg9","openshift-multus/multus-additional-cni-plugins-dcgk5","openshift-multus/network-metrics-daemon-hsq9l","openshift-network-diagnostics/network-check-target-sbd75","openshift-network-operator/iptables-alerter-sqv8p","openshift-ovn-kubernetes/ovnkube-node-svtxw"] Sep 18 23:58:19.927510 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.927477 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:19.929805 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.929785 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:19.929909 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:19.929858 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:19.930701 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.930679 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 23:58:19.930802 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.930773 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 23:58:19.930951 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.930902 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mlgcs\"" Sep 18 23:58:19.932421 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.932386 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.935205 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.935144 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5gl2h\"" Sep 18 23:58:19.935942 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.935321 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:19.935942 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.935600 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:19.935942 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.935674 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:19.940666 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.940645 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:19.940757 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:19.940718 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:19.941485 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.940899 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 23:58:19.941485 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.940952 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.941934 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.941917 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zd2sm\"" Sep 18 23:58:19.942302 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.942286 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 23:58:19.942855 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.942329 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 23:58:19.943055 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.942431 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 23:58:19.943170 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.942477 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:19.943747 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.943720 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 23:58:19.944351 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.944119 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rj8nk\"" Sep 18 23:58:19.944351 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.944292 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 23:58:19.944510 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.944386 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 23:58:19.944569 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.944536 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 23:58:19.945383 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.945354 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:19.946742 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.946721 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 23:58:19.946860 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.946843 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 23:58:19.948258 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.948143 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:19.948484 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.948466 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:19.949517 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.949498 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nnln5\"" Sep 18 23:58:19.949818 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.949796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-cni-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.949894 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.949837 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b4a64ff-90af-40db-9b12-27b5e90fdd10-cni-binary-copy\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.949894 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.949868 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-host\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.950036 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.949894 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca959ba2-530f-459a-a5b6-312bdd5c166d-tmp\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.950036 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.949928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8g46\" (UniqueName: \"kubernetes.io/projected/ca959ba2-530f-459a-a5b6-312bdd5c166d-kube-api-access-x8g46\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.950036 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.949957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-serviceca\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:19.950036 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-k8s-cni-cncf-io\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950248 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950040 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-cni-bin\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950248 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysctl-d\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.950248 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-systemd\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.950248 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950123 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-cni-multus\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950248 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-hostroot\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950248 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-conf-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950549 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950331 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-multus-certs\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950549 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:19.950549 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57eafa90-ad4e-4321-97d8-fa435df69596-hosts-file\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:19.950549 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-modprobe-d\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.950753 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950583 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-system-cni-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950753 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-etc-kubernetes\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950753 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mvv\" (UniqueName: \"kubernetes.io/projected/4b4a64ff-90af-40db-9b12-27b5e90fdd10-kube-api-access-82mvv\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.950753 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd4c1e6-84c6-41de-a1f8-b2fb1c489624-agent-certs\") pod \"konnectivity-agent-h9wwn\" (UID: \"6fd4c1e6-84c6-41de-a1f8-b2fb1c489624\") " pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:19.950753 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950725 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd4c1e6-84c6-41de-a1f8-b2fb1c489624-konnectivity-ca\") pod \"konnectivity-agent-h9wwn\" (UID: \"6fd4c1e6-84c6-41de-a1f8-b2fb1c489624\") " pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:19.951020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9djk\" (UniqueName: \"kubernetes.io/projected/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-kube-api-access-d9djk\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:19.951020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eafa90-ad4e-4321-97d8-fa435df69596-tmp-dir\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:19.951020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-var-lib-kubelet\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.951020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950855 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-tuned\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.951020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950916 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-socket-dir-parent\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.951020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950944 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-kubelet\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.951020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.950990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-kubernetes\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.951020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-netns\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951045 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-lib-modules\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-host\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-run\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-daemon-config\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vzf7\" (UniqueName: \"kubernetes.io/projected/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-kube-api-access-9vzf7\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951234 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-cnibin\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951299 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgr9\" (UniqueName: \"kubernetes.io/projected/57eafa90-ad4e-4321-97d8-fa435df69596-kube-api-access-rzgr9\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951336 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysconfig\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysctl-conf\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.951426 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.951390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-sys\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:19.952933 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.952913 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:19.953204 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.953185 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kqppx\"" Sep 18 23:58:19.953430 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.953412 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 23:58:19.954874 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.954135 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q67ct\"" Sep 18 23:58:19.954874 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.954151 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 23:58:19.954874 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.954431 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:19.954874 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:19.954507 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:19.956086 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.956066 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 23:58:19.959444 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.958953 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:19.961054 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.960991 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:19.962691 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.962668 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.962910 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.963055 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t94r9\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.963108 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.963175 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.964690 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.964789 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-btxx4\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.964789 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.964933 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.965020 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.965037 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 23:58:19.966176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.965107 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 23:58:19.974513 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.974491 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-swf9j" Sep 18 23:58:19.984067 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:19.984045 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-swf9j" Sep 18 23:58:20.022164 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.022108 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" event={"ID":"e2c137e820cf81485eca551db40735ae","Type":"ContainerStarted","Data":"34afef4f034976f0749eac0cd678c35cb46914d7a8fd53b4ca880b7d069a4811"} Sep 18 23:58:20.024029 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.024002 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" event={"ID":"31fc66dad6df1899f546ef5f61b06def","Type":"ContainerStarted","Data":"c64fb814d899bc1a1f6f4ea9db65a785211de8de664b7e38403730247738bb10"} Sep 18 23:58:20.040284 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.040259 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 23:58:20.052438 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-run\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.052559 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-daemon-config\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.052559 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqm2v\" (UniqueName: \"kubernetes.io/projected/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-kube-api-access-mqm2v\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.052673 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052551 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-run-netns\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.052673 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-node-log\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.052673 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-run\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.052673 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052623 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovn-node-metrics-cert\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.052673 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vzf7\" (UniqueName: \"kubernetes.io/projected/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-kube-api-access-9vzf7\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052730 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysconfig\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052809 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysconfig\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysctl-conf\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-serviceca\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052882 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mvv\" (UniqueName: \"kubernetes.io/projected/4b4a64ff-90af-40db-9b12-27b5e90fdd10-kube-api-access-82mvv\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd4c1e6-84c6-41de-a1f8-b2fb1c489624-agent-certs\") pod \"konnectivity-agent-h9wwn\" (UID: \"6fd4c1e6-84c6-41de-a1f8-b2fb1c489624\") " pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:20.052989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.052947 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-cni-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053022 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-cni-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053088 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysctl-conf\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.053293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053109 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-daemon-config\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b4a64ff-90af-40db-9b12-27b5e90fdd10-cni-binary-copy\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053178 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8g46\" (UniqueName: \"kubernetes.io/projected/ca959ba2-530f-459a-a5b6-312bdd5c166d-kube-api-access-x8g46\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.053293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-cni-bin\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053271 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-cni-bin\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053299 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-hostroot\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-conf-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd4c1e6-84c6-41de-a1f8-b2fb1c489624-konnectivity-ca\") pod \"konnectivity-agent-h9wwn\" (UID: \"6fd4c1e6-84c6-41de-a1f8-b2fb1c489624\") " pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053374 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-serviceca\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053380 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-socket-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053418 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-hostroot\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053460 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-conf-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053480 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-cni-bin\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57eafa90-ad4e-4321-97d8-fa435df69596-hosts-file\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/57eafa90-ad4e-4321-97d8-fa435df69596-hosts-file\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-system-cni-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053622 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b4a64ff-90af-40db-9b12-27b5e90fdd10-cni-binary-copy\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053663 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9djk\" (UniqueName: \"kubernetes.io/projected/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-kube-api-access-d9djk\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053696 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-system-cni-dir\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053730 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/842a810a-8527-41e6-9d16-b6abb2cb9fbb-kubelet-config\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-systemd-units\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053767 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053768 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd4c1e6-84c6-41de-a1f8-b2fb1c489624-konnectivity-ca\") pod \"konnectivity-agent-h9wwn\" (UID: \"6fd4c1e6-84c6-41de-a1f8-b2fb1c489624\") " pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.053863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053850 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-socket-dir-parent\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ckvp\" (UniqueName: \"kubernetes.io/projected/c4d8ad04-7c96-426c-ae38-66ca8a42017c-kube-api-access-5ckvp\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-var-lib-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzpfq\" (UniqueName: \"kubernetes.io/projected/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-kube-api-access-vzpfq\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.053979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-kubernetes\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054030 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054044 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-kubernetes\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-etc-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054092 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-kubelet\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054104 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-multus-socket-dir-parent\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-device-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054138 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-host-slash\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-cnibin\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgr9\" (UniqueName: \"kubernetes.io/projected/57eafa90-ad4e-4321-97d8-fa435df69596-kube-api-access-rzgr9\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054216 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-cnibin\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-sys\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054299 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-sys\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.054482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-k8s-cni-cncf-io\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054362 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-k8s-cni-cncf-io\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054506 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-host\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca959ba2-530f-459a-a5b6-312bdd5c166d-tmp\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-multus-certs\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054647 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-host\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054688 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/842a810a-8527-41e6-9d16-b6abb2cb9fbb-dbus\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054732 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-multus-certs\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.054762 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.054791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-env-overrides\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.054879 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs podName:7666a16c-bef5-4d6f-9984-768b7d1a0a9d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:20.55484641 +0000 UTC m=+2.973570816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs") pod "network-metrics-daemon-hsq9l" (UID: "7666a16c-bef5-4d6f-9984-768b7d1a0a9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055312 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovnkube-script-lib\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.055344 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysctl-d\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-systemd\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-cni-multus\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055451 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9jd7\" (UniqueName: \"kubernetes.io/projected/45509027-2edb-48a5-aa49-5f53a3bd55b6-kube-api-access-j9jd7\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055474 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-cni-netd\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055493 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovnkube-config\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055497 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-sysctl-d\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-sys-fs\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-modprobe-d\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-etc-kubernetes\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-cnibin\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055557 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-systemd\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-log-socket\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055614 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eafa90-ad4e-4321-97d8-fa435df69596-tmp-dir\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055607 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-etc-kubernetes\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.056030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055634 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-var-lib-kubelet\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055647 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-modprobe-d\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055551 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-cni-multus\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-tuned\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055684 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-kubelet\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055699 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-systemd\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-netns\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055712 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-var-lib-kubelet\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055725 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-registration-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-system-cni-dir\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-ovn\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055799 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-lib-modules\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055851 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-run-netns\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055888 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b4a64ff-90af-40db-9b12-27b5e90fdd10-host-var-lib-kubelet\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-host\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055950 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-iptables-alerter-script\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.055968 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eafa90-ad4e-4321-97d8-fa435df69596-tmp-dir\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:20.056782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.056001 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-slash\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.057647 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.056027 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-run-ovn-kubernetes\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.057647 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.056045 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-host\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:20.057647 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.056055 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.057647 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.056139 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca959ba2-530f-459a-a5b6-312bdd5c166d-lib-modules\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.059125 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.059102 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca959ba2-530f-459a-a5b6-312bdd5c166d-etc-tuned\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.059534 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.059512 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca959ba2-530f-459a-a5b6-312bdd5c166d-tmp\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.059635 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.059616 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd4c1e6-84c6-41de-a1f8-b2fb1c489624-agent-certs\") pod \"konnectivity-agent-h9wwn\" (UID: \"6fd4c1e6-84c6-41de-a1f8-b2fb1c489624\") " pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:20.065924 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.065899 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:20.066036 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.065935 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:20.066036 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.065951 2568 projected.go:196] Error preparing data for projected volume kube-api-access-2chcx for pod openshift-network-diagnostics/network-check-target-sbd75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:20.066219 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.066037 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx podName:6c9dc933-a79e-4c05-82ec-60c15d90c5ad nodeName:}" failed. No retries permitted until 2026-09-18 23:58:20.566017243 +0000 UTC m=+2.984741648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2chcx" (UniqueName: "kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx") pod "network-check-target-sbd75" (UID: "6c9dc933-a79e-4c05-82ec-60c15d90c5ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:20.067866 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.067823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mvv\" (UniqueName: \"kubernetes.io/projected/4b4a64ff-90af-40db-9b12-27b5e90fdd10-kube-api-access-82mvv\") pod \"multus-zqnnn\" (UID: \"4b4a64ff-90af-40db-9b12-27b5e90fdd10\") " pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.068860 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.068825 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vzf7\" (UniqueName: \"kubernetes.io/projected/63a5cc39-c810-4bde-9a3a-5cd26e38b83e-kube-api-access-9vzf7\") pod \"node-ca-b6w24\" (UID: \"63a5cc39-c810-4bde-9a3a-5cd26e38b83e\") " pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:20.069349 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.069324 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8g46\" (UniqueName: \"kubernetes.io/projected/ca959ba2-530f-459a-a5b6-312bdd5c166d-kube-api-access-x8g46\") pod \"tuned-8n2zk\" (UID: \"ca959ba2-530f-459a-a5b6-312bdd5c166d\") " pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.069886 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.069862 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgr9\" (UniqueName: \"kubernetes.io/projected/57eafa90-ad4e-4321-97d8-fa435df69596-kube-api-access-rzgr9\") pod \"node-resolver-rfjg9\" (UID: \"57eafa90-ad4e-4321-97d8-fa435df69596\") " pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:20.070071 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.070049 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9djk\" (UniqueName: \"kubernetes.io/projected/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-kube-api-access-d9djk\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:20.157204 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-iptables-alerter-script\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.157204 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157207 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-slash\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-run-ovn-kubernetes\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqm2v\" (UniqueName: \"kubernetes.io/projected/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-kube-api-access-mqm2v\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-run-netns\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157311 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-slash\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157317 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-run-ovn-kubernetes\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157368 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-node-log\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157376 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-run-netns\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157379 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-node-log\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovn-node-metrics-cert\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157451 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157518 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-socket-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157595 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-cni-bin\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157644 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-cni-bin\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157675 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/842a810a-8527-41e6-9d16-b6abb2cb9fbb-kubelet-config\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-systemd-units\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157731 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ckvp\" (UniqueName: \"kubernetes.io/projected/c4d8ad04-7c96-426c-ae38-66ca8a42017c-kube-api-access-5ckvp\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157800 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-var-lib-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzpfq\" (UniqueName: \"kubernetes.io/projected/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-kube-api-access-vzpfq\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157836 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-iptables-alerter-script\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.157882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157875 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-etc-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157892 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-systemd-units\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157900 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-kubelet\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157926 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-device-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-host-slash\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.157994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158021 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/842a810a-8527-41e6-9d16-b6abb2cb9fbb-dbus\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158063 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-env-overrides\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovnkube-script-lib\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158103 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/842a810a-8527-41e6-9d16-b6abb2cb9fbb-kubelet-config\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158128 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-socket-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158149 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-kubelet\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9jd7\" (UniqueName: \"kubernetes.io/projected/45509027-2edb-48a5-aa49-5f53a3bd55b6-kube-api-access-j9jd7\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158182 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-cni-netd\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158193 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.158442 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovnkube-config\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-sys-fs\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-cnibin\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158315 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-log-socket\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.157998 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158393 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-systemd\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.158439 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret podName:842a810a-8527-41e6-9d16-b6abb2cb9fbb nodeName:}" failed. No retries permitted until 2026-09-18 23:58:20.658417498 +0000 UTC m=+3.077141907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret") pod "global-pull-secret-syncer-hdpmx" (UID: "842a810a-8527-41e6-9d16-b6abb2cb9fbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158560 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovnkube-config\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158576 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-var-lib-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158675 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158680 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-device-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158736 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-host-slash\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158793 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/842a810a-8527-41e6-9d16-b6abb2cb9fbb-dbus\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158851 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158872 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-etc-openvswitch\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158924 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-sys-fs\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158977 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158986 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-cnibin\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.158342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-systemd\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159025 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-registration-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-system-cni-dir\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159061 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-host-cni-netd\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-ovn\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159092 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-env-overrides\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159104 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4d8ad04-7c96-426c-ae38-66ca8a42017c-registration-dir\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-log-socket\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159139 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-run-ovn\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159159 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45509027-2edb-48a5-aa49-5f53a3bd55b6-system-cni-dir\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45509027-2edb-48a5-aa49-5f53a3bd55b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.159687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.159571 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovnkube-script-lib\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.160416 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.160184 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-ovn-node-metrics-cert\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.169912 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.169866 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqm2v\" (UniqueName: \"kubernetes.io/projected/3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a-kube-api-access-mqm2v\") pod \"iptables-alerter-sqv8p\" (UID: \"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a\") " pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.171491 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.171466 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ckvp\" (UniqueName: \"kubernetes.io/projected/c4d8ad04-7c96-426c-ae38-66ca8a42017c-kube-api-access-5ckvp\") pod \"aws-ebs-csi-driver-node-ll8bm\" (UID: \"c4d8ad04-7c96-426c-ae38-66ca8a42017c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.171732 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.171716 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9jd7\" (UniqueName: \"kubernetes.io/projected/45509027-2edb-48a5-aa49-5f53a3bd55b6-kube-api-access-j9jd7\") pod \"multus-additional-cni-plugins-dcgk5\" (UID: \"45509027-2edb-48a5-aa49-5f53a3bd55b6\") " pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.171872 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.171857 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzpfq\" (UniqueName: \"kubernetes.io/projected/0c116a60-f35f-42b6-a83b-76b66b7b7ae4-kube-api-access-vzpfq\") pod \"ovnkube-node-svtxw\" (UID: \"0c116a60-f35f-42b6-a83b-76b66b7b7ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.242894 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.242862 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:20.252979 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.252890 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" Sep 18 23:58:20.271146 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.271119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b6w24" Sep 18 23:58:20.278024 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.278002 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqnnn" Sep 18 23:58:20.288878 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.288859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rfjg9" Sep 18 23:58:20.297703 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.297683 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sqv8p" Sep 18 23:58:20.305581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.305563 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" Sep 18 23:58:20.314411 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.314390 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" Sep 18 23:58:20.323330 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.323309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:20.562454 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.562382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:20.562600 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.562570 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:20.562668 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.562654 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs podName:7666a16c-bef5-4d6f-9984-768b7d1a0a9d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:21.56263225 +0000 UTC m=+3.981356657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs") pod "network-metrics-daemon-hsq9l" (UID: "7666a16c-bef5-4d6f-9984-768b7d1a0a9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:20.663165 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.663124 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:20.663165 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.663170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:20.663428 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.663301 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:20.663428 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.663382 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret podName:842a810a-8527-41e6-9d16-b6abb2cb9fbb nodeName:}" failed. No retries permitted until 2026-09-18 23:58:21.663362512 +0000 UTC m=+4.082086915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret") pod "global-pull-secret-syncer-hdpmx" (UID: "842a810a-8527-41e6-9d16-b6abb2cb9fbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:20.663428 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.663313 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:20.663428 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.663417 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:20.663428 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.663430 2568 projected.go:196] Error preparing data for projected volume kube-api-access-2chcx for pod openshift-network-diagnostics/network-check-target-sbd75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:20.663679 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:20.663478 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx podName:6c9dc933-a79e-4c05-82ec-60c15d90c5ad nodeName:}" failed. No retries permitted until 2026-09-18 23:58:21.66346668 +0000 UTC m=+4.082191091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2chcx" (UniqueName: "kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx") pod "network-check-target-sbd75" (UID: "6c9dc933-a79e-4c05-82ec-60c15d90c5ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:20.987932 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.987883 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 23:53:20 +0000 UTC" deadline="2028-07-01 09:35:19.729309144 +0000 UTC" Sep 18 23:58:20.987932 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:20.987929 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15633h36m58.741385257s" Sep 18 23:58:21.016434 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:21.016405 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:21.016586 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.016511 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:21.271398 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:21.271184 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca959ba2_530f_459a_a5b6_312bdd5c166d.slice/crio-66eb82f3ee8b2911ac85c8925a7890ed864510e71cafffefc63ed30559a6056b WatchSource:0}: Error finding container 66eb82f3ee8b2911ac85c8925a7890ed864510e71cafffefc63ed30559a6056b: Status 404 returned error can't find the container with id 66eb82f3ee8b2911ac85c8925a7890ed864510e71cafffefc63ed30559a6056b Sep 18 23:58:21.275375 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:21.275328 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d8ad04_7c96_426c_ae38_66ca8a42017c.slice/crio-e07084f5386bef1a8a0b5d00f6c06443d0a889fac681ce920eb709663ad7f62a WatchSource:0}: Error finding container e07084f5386bef1a8a0b5d00f6c06443d0a889fac681ce920eb709663ad7f62a: Status 404 returned error can't find the container with id e07084f5386bef1a8a0b5d00f6c06443d0a889fac681ce920eb709663ad7f62a Sep 18 23:58:21.276264 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:21.276188 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45509027_2edb_48a5_aa49_5f53a3bd55b6.slice/crio-cfe448a1853b8cc6a4c13e6b5b46cfcd0b4349e01a47bb76ef85b65d00b2b06b WatchSource:0}: Error finding container cfe448a1853b8cc6a4c13e6b5b46cfcd0b4349e01a47bb76ef85b65d00b2b06b: Status 404 returned error can't find the container with id cfe448a1853b8cc6a4c13e6b5b46cfcd0b4349e01a47bb76ef85b65d00b2b06b Sep 18 23:58:21.277173 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:21.277149 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4a64ff_90af_40db_9b12_27b5e90fdd10.slice/crio-4bdf5a771e62eb9080a32fa82bfead7b2d4466c7816477642963c9b5708e08c3 WatchSource:0}: Error finding container 4bdf5a771e62eb9080a32fa82bfead7b2d4466c7816477642963c9b5708e08c3: Status 404 returned error can't find the container with id 4bdf5a771e62eb9080a32fa82bfead7b2d4466c7816477642963c9b5708e08c3 Sep 18 23:58:21.280115 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:21.280093 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57eafa90_ad4e_4321_97d8_fa435df69596.slice/crio-c4deb2034202d00dc65510bd84410d16c636f765fe6978f557fe34417e04f912 WatchSource:0}: Error finding container c4deb2034202d00dc65510bd84410d16c636f765fe6978f557fe34417e04f912: Status 404 returned error can't find the container with id c4deb2034202d00dc65510bd84410d16c636f765fe6978f557fe34417e04f912 Sep 18 23:58:21.571125 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:21.571096 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:21.571258 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.571244 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:21.571309 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.571293 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs podName:7666a16c-bef5-4d6f-9984-768b7d1a0a9d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:23.57127982 +0000 UTC m=+5.990004222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs") pod "network-metrics-daemon-hsq9l" (UID: "7666a16c-bef5-4d6f-9984-768b7d1a0a9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:21.671608 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:21.671563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:21.671776 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:21.671617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:21.671776 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.671721 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:21.671776 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.671767 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:21.671929 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.671784 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:21.671929 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.671798 2568 projected.go:196] Error preparing data for projected volume kube-api-access-2chcx for pod openshift-network-diagnostics/network-check-target-sbd75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:21.671929 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.671803 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret podName:842a810a-8527-41e6-9d16-b6abb2cb9fbb nodeName:}" failed. No retries permitted until 2026-09-18 23:58:23.671781407 +0000 UTC m=+6.090505814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret") pod "global-pull-secret-syncer-hdpmx" (UID: "842a810a-8527-41e6-9d16-b6abb2cb9fbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:21.671929 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:21.671836 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx podName:6c9dc933-a79e-4c05-82ec-60c15d90c5ad nodeName:}" failed. No retries permitted until 2026-09-18 23:58:23.671823607 +0000 UTC m=+6.090548003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2chcx" (UniqueName: "kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx") pod "network-check-target-sbd75" (UID: "6c9dc933-a79e-4c05-82ec-60c15d90c5ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:21.678074 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:21.678051 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 23:58:21.988762 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:21.988696 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 23:53:20 +0000 UTC" deadline="2028-03-18 13:31:12.865417218 +0000 UTC" Sep 18 23:58:21.988762 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:21.988760 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13117h32m50.876660842s" Sep 18 23:58:22.017563 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.017087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:22.017563 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:22.017203 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:22.017994 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.017891 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:22.018125 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:22.018017 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:22.042533 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.042490 2568 generic.go:356] "Generic (PLEG): container finished" podID="31fc66dad6df1899f546ef5f61b06def" containerID="0c75e22e055ecd9298dc5c566ebba68a562586c1d0998c130a2012a55ce6cc98" exitCode=0 Sep 18 23:58:22.042708 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.042663 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" event={"ID":"31fc66dad6df1899f546ef5f61b06def","Type":"ContainerDied","Data":"0c75e22e055ecd9298dc5c566ebba68a562586c1d0998c130a2012a55ce6cc98"} Sep 18 23:58:22.052188 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.052144 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"f3ed0cf7c33d8ee19141e0f2f78617bce5dc189bfa4625d41eedc4b8601c852a"} Sep 18 23:58:22.059786 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.059756 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b6w24" event={"ID":"63a5cc39-c810-4bde-9a3a-5cd26e38b83e","Type":"ContainerStarted","Data":"72e48a0abc6a2d5d098c0586704a62810e5ba9f7ed5f921ea95e1c1b0584c214"} Sep 18 23:58:22.072716 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.072684 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h9wwn" event={"ID":"6fd4c1e6-84c6-41de-a1f8-b2fb1c489624","Type":"ContainerStarted","Data":"d456b72dde58c814911dd52b58913cf80b6279e450c7248fc878d802b2d47638"} Sep 18 23:58:22.081230 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.081197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" event={"ID":"c4d8ad04-7c96-426c-ae38-66ca8a42017c","Type":"ContainerStarted","Data":"e07084f5386bef1a8a0b5d00f6c06443d0a889fac681ce920eb709663ad7f62a"} Sep 18 23:58:22.104425 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.104354 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" event={"ID":"ca959ba2-530f-459a-a5b6-312bdd5c166d","Type":"ContainerStarted","Data":"66eb82f3ee8b2911ac85c8925a7890ed864510e71cafffefc63ed30559a6056b"} Sep 18 23:58:22.129194 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.129157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" event={"ID":"e2c137e820cf81485eca551db40735ae","Type":"ContainerStarted","Data":"bcad7fca9151dc3e90c364346cc532c448445e849ca43b8a5432b647987e5077"} Sep 18 23:58:22.137197 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.137159 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" event={"ID":"45509027-2edb-48a5-aa49-5f53a3bd55b6","Type":"ContainerStarted","Data":"cfe448a1853b8cc6a4c13e6b5b46cfcd0b4349e01a47bb76ef85b65d00b2b06b"} Sep 18 23:58:22.143913 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.143856 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-42.ec2.internal" podStartSLOduration=2.143836528 podStartE2EDuration="2.143836528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:22.143418634 +0000 UTC m=+4.562143047" watchObservedRunningTime="2026-09-18 23:58:22.143836528 +0000 UTC m=+4.562560940" Sep 18 23:58:22.171618 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.171584 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rfjg9" event={"ID":"57eafa90-ad4e-4321-97d8-fa435df69596","Type":"ContainerStarted","Data":"c4deb2034202d00dc65510bd84410d16c636f765fe6978f557fe34417e04f912"} Sep 18 23:58:22.180326 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.180285 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sqv8p" event={"ID":"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a","Type":"ContainerStarted","Data":"6a4e81b45aad2200e039acc91284c8398fe9371fb4d8bf05e06fc806dfe13112"} Sep 18 23:58:22.193799 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:22.193767 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqnnn" event={"ID":"4b4a64ff-90af-40db-9b12-27b5e90fdd10","Type":"ContainerStarted","Data":"4bdf5a771e62eb9080a32fa82bfead7b2d4466c7816477642963c9b5708e08c3"} Sep 18 23:58:23.016938 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:23.016300 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:23.016938 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.016438 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:23.211166 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:23.211025 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" event={"ID":"31fc66dad6df1899f546ef5f61b06def","Type":"ContainerStarted","Data":"47122d2875f9754ae484029281d5b30b085f6c25b4afc950b6ccbe90c5998b92"} Sep 18 23:58:23.588402 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:23.588310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:23.588583 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.588519 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:23.588656 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.588586 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs podName:7666a16c-bef5-4d6f-9984-768b7d1a0a9d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:27.588567527 +0000 UTC m=+10.007291930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs") pod "network-metrics-daemon-hsq9l" (UID: "7666a16c-bef5-4d6f-9984-768b7d1a0a9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:23.689698 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:23.688846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:23.689698 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:23.688897 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:23.689698 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.689088 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:23.689698 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.689109 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:23.689698 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.689123 2568 projected.go:196] Error preparing data for projected volume kube-api-access-2chcx for pod openshift-network-diagnostics/network-check-target-sbd75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:23.689698 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.689185 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx podName:6c9dc933-a79e-4c05-82ec-60c15d90c5ad nodeName:}" failed. No retries permitted until 2026-09-18 23:58:27.689165981 +0000 UTC m=+10.107890383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2chcx" (UniqueName: "kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx") pod "network-check-target-sbd75" (UID: "6c9dc933-a79e-4c05-82ec-60c15d90c5ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:23.689698 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.689596 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:23.689698 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:23.689649 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret podName:842a810a-8527-41e6-9d16-b6abb2cb9fbb nodeName:}" failed. No retries permitted until 2026-09-18 23:58:27.68963401 +0000 UTC m=+10.108358413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret") pod "global-pull-secret-syncer-hdpmx" (UID: "842a810a-8527-41e6-9d16-b6abb2cb9fbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:24.016729 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:24.016674 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:24.016907 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:24.016872 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:24.019174 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:24.017298 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:24.019174 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:24.017397 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:25.016195 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:25.016153 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:25.016382 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:25.016300 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:26.016948 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:26.016889 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:26.017325 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:26.016888 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:26.017325 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:26.017068 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:26.017325 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:26.017148 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:27.016460 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:27.016373 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:27.016601 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.016513 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:27.624396 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:27.624366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:27.624842 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.624500 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:27.624842 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.624562 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs podName:7666a16c-bef5-4d6f-9984-768b7d1a0a9d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:35.624543363 +0000 UTC m=+18.043267764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs") pod "network-metrics-daemon-hsq9l" (UID: "7666a16c-bef5-4d6f-9984-768b7d1a0a9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:27.725246 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:27.725213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:27.725418 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:27.725261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:27.725482 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.725417 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:27.725482 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.725438 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:27.725482 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.725450 2568 projected.go:196] Error preparing data for projected volume kube-api-access-2chcx for pod openshift-network-diagnostics/network-check-target-sbd75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:27.725628 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.725504 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx podName:6c9dc933-a79e-4c05-82ec-60c15d90c5ad nodeName:}" failed. No retries permitted until 2026-09-18 23:58:35.725485856 +0000 UTC m=+18.144210265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2chcx" (UniqueName: "kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx") pod "network-check-target-sbd75" (UID: "6c9dc933-a79e-4c05-82ec-60c15d90c5ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:27.725898 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.725861 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:27.725986 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:27.725926 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret podName:842a810a-8527-41e6-9d16-b6abb2cb9fbb nodeName:}" failed. No retries permitted until 2026-09-18 23:58:35.72591238 +0000 UTC m=+18.144636781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret") pod "global-pull-secret-syncer-hdpmx" (UID: "842a810a-8527-41e6-9d16-b6abb2cb9fbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:28.016956 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:28.016840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:28.017104 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:28.016967 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:28.017104 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:28.016991 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:28.017104 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:28.017089 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:29.016720 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:29.016684 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:29.017123 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:29.016815 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:30.016407 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:30.016003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:30.016407 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:30.016014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:30.016407 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:30.016129 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:30.016407 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:30.016183 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:31.016041 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:31.016012 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:31.016482 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:31.016113 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:32.016128 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:32.016102 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:32.016494 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:32.016102 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:32.016494 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:32.016235 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:32.016494 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:32.016319 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:33.016103 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:33.016074 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:33.016271 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:33.016188 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:34.016419 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:34.016371 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:34.016419 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:34.016421 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:34.016986 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:34.016532 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:34.016986 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:34.016665 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:35.016052 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:35.016018 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:35.016257 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.016129 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:35.680468 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:35.680439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:35.680849 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.680606 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:35.680849 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.680676 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs podName:7666a16c-bef5-4d6f-9984-768b7d1a0a9d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:51.680655757 +0000 UTC m=+34.099380158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs") pod "network-metrics-daemon-hsq9l" (UID: "7666a16c-bef5-4d6f-9984-768b7d1a0a9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:35.780824 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:35.780794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:35.781021 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:35.780834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:35.781021 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.780956 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:35.781021 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.780988 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:35.781021 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.781006 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:35.781021 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.781017 2568 projected.go:196] Error preparing data for projected volume kube-api-access-2chcx for pod openshift-network-diagnostics/network-check-target-sbd75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:35.781211 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.781016 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret podName:842a810a-8527-41e6-9d16-b6abb2cb9fbb nodeName:}" failed. No retries permitted until 2026-09-18 23:58:51.781002963 +0000 UTC m=+34.199727364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret") pod "global-pull-secret-syncer-hdpmx" (UID: "842a810a-8527-41e6-9d16-b6abb2cb9fbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:35.781211 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:35.781076 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx podName:6c9dc933-a79e-4c05-82ec-60c15d90c5ad nodeName:}" failed. No retries permitted until 2026-09-18 23:58:51.781060517 +0000 UTC m=+34.199784908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2chcx" (UniqueName: "kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx") pod "network-check-target-sbd75" (UID: "6c9dc933-a79e-4c05-82ec-60c15d90c5ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:36.016632 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:36.016553 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:36.016785 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:36.016567 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:36.016785 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:36.016698 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:36.016785 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:36.016757 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:37.016570 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:37.016535 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:37.017034 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:37.016642 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:38.017007 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:38.016975 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:38.017449 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:38.017105 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:38.017449 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:38.017169 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:38.017449 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:38.017301 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:39.016879 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:39.016845 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:39.017059 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:39.016974 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:40.016851 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.016683 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:40.017042 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.016763 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:40.017042 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:40.016983 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:40.017042 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:40.017033 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:40.246214 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.246184 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" event={"ID":"c4d8ad04-7c96-426c-ae38-66ca8a42017c","Type":"ContainerStarted","Data":"18e300b41e90361c69e5d1842cdf65dda464cc1cdfe9ddfe93dc62adc0939c3c"} Sep 18 23:58:40.248309 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.247842 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" event={"ID":"ca959ba2-530f-459a-a5b6-312bdd5c166d","Type":"ContainerStarted","Data":"e1a4d6ec6b4c308dadb7028c882aa6d7bd41d9782bffe9ef3daecfd2100870cb"} Sep 18 23:58:40.249530 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.249504 2568 generic.go:356] "Generic (PLEG): container finished" podID="45509027-2edb-48a5-aa49-5f53a3bd55b6" containerID="dba059fbf9481eee1c7bce42f357a35b4fc41d96e7b173f146342f8c2b181891" exitCode=0 Sep 18 23:58:40.249647 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.249586 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" event={"ID":"45509027-2edb-48a5-aa49-5f53a3bd55b6","Type":"ContainerDied","Data":"dba059fbf9481eee1c7bce42f357a35b4fc41d96e7b173f146342f8c2b181891"} Sep 18 23:58:40.252769 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.251925 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rfjg9" event={"ID":"57eafa90-ad4e-4321-97d8-fa435df69596","Type":"ContainerStarted","Data":"32bde474680d047edf80deec726ebe181b884a6222ee07bbb0edd26fc0d5370d"} Sep 18 23:58:40.253845 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.253823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqnnn" event={"ID":"4b4a64ff-90af-40db-9b12-27b5e90fdd10","Type":"ContainerStarted","Data":"9583ac4aa58f5cabd4ed63701c7ac37664f77366bfbd271e2d4736bafa4a0d45"} Sep 18 23:58:40.257584 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.257551 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"132763de372b16c655cc22a0bd95987d9576df575c129cd7dfcc8733574b101c"} Sep 18 23:58:40.257691 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.257642 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"19bac4bb5dfbd0a231a6ae4180af575256f10d8c61e01b6b24e2f291c9fa0e41"} Sep 18 23:58:40.257739 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.257693 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"9441885e598b8ed5889c36b5f8f90bfa09d481c9fb83a6e9be1042bd72f8b8af"} Sep 18 23:58:40.257773 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.257746 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"b78237af89f1d509d81a5dbb28ed06933f38f0ec2f72b78a5f2e3e651ada7265"} Sep 18 23:58:40.257804 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.257797 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"98f54d63ea36ea165918dfb4d97c952bf693ddb90d8865233783cf3aa55f163d"} Sep 18 23:58:40.257860 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.257841 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"569636715c8e419656c08408a59cffe3b999b1aefd70ed97de45a51066ccd432"} Sep 18 23:58:40.259146 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.259114 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b6w24" event={"ID":"63a5cc39-c810-4bde-9a3a-5cd26e38b83e","Type":"ContainerStarted","Data":"37bc3cee30809904896434ab1d67e827a046fbaab8b1bb71fd12ac28c175acae"} Sep 18 23:58:40.261430 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.261408 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h9wwn" event={"ID":"6fd4c1e6-84c6-41de-a1f8-b2fb1c489624","Type":"ContainerStarted","Data":"354212be0b26a4c2116292c8d2ebd1afd4292540121d363446f0d3a63e91cd99"} Sep 18 23:58:40.266009 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.265959 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-42.ec2.internal" podStartSLOduration=20.265943738 podStartE2EDuration="20.265943738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:23.227585864 +0000 UTC m=+5.646310276" watchObservedRunningTime="2026-09-18 23:58:40.265943738 +0000 UTC m=+22.684668147" Sep 18 23:58:40.279586 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.279552 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8n2zk" podStartSLOduration=4.152517177 podStartE2EDuration="22.279539006s" totalImagesPullingTime="18.127021829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:40.265916614 +0000 UTC m=+22.684641022" watchObservedRunningTime="2026-09-18 23:58:40.279539006 +0000 UTC m=+22.698263415" Sep 18 23:58:40.279711 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.279639 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b6w24" podStartSLOduration=4.188192651 podStartE2EDuration="22.279633851s" totalImagesPullingTime="18.0914412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:40.279255911 +0000 UTC m=+22.697980320" watchObservedRunningTime="2026-09-18 23:58:40.279633851 +0000 UTC m=+22.698358260" Sep 18 23:58:40.301467 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.301425 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zqnnn" podStartSLOduration=3.999349213 podStartE2EDuration="22.30141325s" totalImagesPullingTime="18.302064037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:40.300993296 +0000 UTC m=+22.719717703" watchObservedRunningTime="2026-09-18 23:58:40.30141325 +0000 UTC m=+22.720137687" Sep 18 23:58:40.316967 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.316918 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rfjg9" podStartSLOduration=4.217067819 podStartE2EDuration="22.316903761s" totalImagesPullingTime="18.099835942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:40.316453449 +0000 UTC m=+22.735177859" watchObservedRunningTime="2026-09-18 23:58:40.316903761 +0000 UTC m=+22.735628162" Sep 18 23:58:40.350643 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:40.350588 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h9wwn" podStartSLOduration=8.010146978 podStartE2EDuration="22.350567575s" totalImagesPullingTime="14.340420597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:40.349757537 +0000 UTC m=+22.768481945" watchObservedRunningTime="2026-09-18 23:58:40.350567575 +0000 UTC m=+22.769291983" Sep 18 23:58:41.016236 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:41.016067 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:41.016452 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:41.016305 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:41.025139 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:41.025113 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 23:58:41.266338 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:41.266254 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" event={"ID":"c4d8ad04-7c96-426c-ae38-66ca8a42017c","Type":"ContainerStarted","Data":"1c9f089d5e7239f6f3606af9612550f326cdf971cea7fa396f6ce224a79844c8"} Sep 18 23:58:41.267678 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:41.267657 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sqv8p" event={"ID":"3674c1f9-f37c-4c4a-b30e-7b6dfbfebe2a","Type":"ContainerStarted","Data":"003cbab60600352d13f924190ff1f76b47276ffbec9f5c8b03e7d8ec29ef2771"} Sep 18 23:58:41.282661 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:41.282621 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sqv8p" podStartSLOduration=5.167456284 podStartE2EDuration="23.282608823s" totalImagesPullingTime="18.115152539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:41.282250293 +0000 UTC m=+23.700974702" watchObservedRunningTime="2026-09-18 23:58:41.282608823 +0000 UTC m=+23.701333230" Sep 18 23:58:41.931224 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:41.931189 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:42.018767 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.016754 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:42.018767 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:42.016910 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:42.018767 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.016948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:42.018767 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:42.017034 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:42.018767 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.017639 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T23:58:41.025131906Z","UUID":"88f39e19-897d-463e-b98d-7bdcd1e07b57","Handler":null,"Name":"","Endpoint":""} Sep 18 23:58:42.019480 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.019458 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 23:58:42.019593 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.019492 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 23:58:42.143051 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.143013 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:42.143685 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.143665 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:42.272844 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.272752 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" event={"ID":"c4d8ad04-7c96-426c-ae38-66ca8a42017c","Type":"ContainerStarted","Data":"0229dc2215a66015b281537f64f152470a075190f666dd4c22cd78dd2fa38a68"} Sep 18 23:58:42.273578 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.273547 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h9wwn" Sep 18 23:58:42.289245 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:42.289186 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll8bm" podStartSLOduration=3.071781491 podStartE2EDuration="23.289166418s" totalImagesPullingTime="20.217384927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:42.288387465 +0000 UTC m=+24.707111876" watchObservedRunningTime="2026-09-18 23:58:42.289166418 +0000 UTC m=+24.707890829" Sep 18 23:58:43.016077 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:43.016043 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:43.016254 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:43.016143 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:43.279431 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:43.279347 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"7e7f56b1aeece879b5451805535fe4c28d080d50c7b25c690b9ff65b2b8f2243"} Sep 18 23:58:44.016232 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:44.016199 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:44.016403 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:44.016199 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:44.016403 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:44.016327 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:44.016403 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:44.016366 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:45.016765 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:45.016605 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:45.017202 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:45.016837 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:45.288090 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:45.288001 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" event={"ID":"0c116a60-f35f-42b6-a83b-76b66b7b7ae4","Type":"ContainerStarted","Data":"c40ba5aa5e719a52f507443854dbda79f803bea4c03eedb6e8203a06b2eacff7"} Sep 18 23:58:45.288336 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:45.288317 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:45.289900 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:45.289862 2568 generic.go:356] "Generic (PLEG): container finished" podID="45509027-2edb-48a5-aa49-5f53a3bd55b6" containerID="98008d9e4ae4238c5909b67900846287a110dcb8109f38bf72632a7deba10da6" exitCode=0 Sep 18 23:58:45.289989 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:45.289913 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" event={"ID":"45509027-2edb-48a5-aa49-5f53a3bd55b6","Type":"ContainerDied","Data":"98008d9e4ae4238c5909b67900846287a110dcb8109f38bf72632a7deba10da6"} Sep 18 23:58:45.304115 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:45.304092 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:45.316056 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:45.316015 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" podStartSLOduration=8.176203258 podStartE2EDuration="26.316003917s" totalImagesPullingTime="18.139800659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:45.315311956 +0000 UTC m=+27.734036364" watchObservedRunningTime="2026-09-18 23:58:45.316003917 +0000 UTC m=+27.734728325" Sep 18 23:58:46.017519 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.017069 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:46.017519 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:46.017211 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:46.018217 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.017590 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:46.018217 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:46.017683 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:46.294638 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.294551 2568 generic.go:356] "Generic (PLEG): container finished" podID="45509027-2edb-48a5-aa49-5f53a3bd55b6" containerID="759878027d0fcefc963b2445692bbbef5139a1b81c26397c1861291f021190db" exitCode=0 Sep 18 23:58:46.294789 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.294632 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" event={"ID":"45509027-2edb-48a5-aa49-5f53a3bd55b6","Type":"ContainerDied","Data":"759878027d0fcefc963b2445692bbbef5139a1b81c26397c1861291f021190db"} Sep 18 23:58:46.295111 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.295082 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:46.295222 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.295151 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:46.309789 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.309768 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:58:46.621110 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.621081 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sbd75"] Sep 18 23:58:46.621254 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.621180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:46.621309 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:46.621267 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:46.624255 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.624233 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hdpmx"] Sep 18 23:58:46.624374 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.624329 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:46.624442 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:46.624420 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:46.624787 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.624768 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hsq9l"] Sep 18 23:58:46.624902 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:46.624844 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:46.624965 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:46.624941 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:47.299413 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:47.299326 2568 generic.go:356] "Generic (PLEG): container finished" podID="45509027-2edb-48a5-aa49-5f53a3bd55b6" containerID="1ca3a1eba699ffdc9beda8afd4c155e1374872b60bec8fc43421d770f2e7ec76" exitCode=0 Sep 18 23:58:47.299922 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:47.299403 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" event={"ID":"45509027-2edb-48a5-aa49-5f53a3bd55b6","Type":"ContainerDied","Data":"1ca3a1eba699ffdc9beda8afd4c155e1374872b60bec8fc43421d770f2e7ec76"} Sep 18 23:58:48.017354 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:48.017318 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:48.017526 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:48.017404 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:48.017526 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:48.017447 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:48.017526 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:48.017471 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:48.017681 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:48.017523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:48.017681 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:48.017589 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:50.016710 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:50.016471 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:50.017221 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:50.016471 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:50.017221 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:50.016807 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:50.017221 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:50.016533 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:50.017221 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:50.016929 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:50.017221 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:50.017039 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:51.696176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:51.696141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:51.696575 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:51.696262 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:51.696575 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:51.696321 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs podName:7666a16c-bef5-4d6f-9984-768b7d1a0a9d nodeName:}" failed. No retries permitted until 2026-09-18 23:59:23.696304642 +0000 UTC m=+66.115029028 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs") pod "network-metrics-daemon-hsq9l" (UID: "7666a16c-bef5-4d6f-9984-768b7d1a0a9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 23:58:51.797459 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:51.797422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:51.797602 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:51.797465 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:51.797602 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:51.797577 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:51.797602 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:51.797598 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 23:58:51.797716 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:51.797613 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 23:58:51.797716 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:51.797622 2568 projected.go:196] Error preparing data for projected volume kube-api-access-2chcx for pod openshift-network-diagnostics/network-check-target-sbd75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:51.797716 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:51.797651 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret podName:842a810a-8527-41e6-9d16-b6abb2cb9fbb nodeName:}" failed. No retries permitted until 2026-09-18 23:59:23.79763578 +0000 UTC m=+66.216360190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret") pod "global-pull-secret-syncer-hdpmx" (UID: "842a810a-8527-41e6-9d16-b6abb2cb9fbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 23:58:51.797716 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:51.797667 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx podName:6c9dc933-a79e-4c05-82ec-60c15d90c5ad nodeName:}" failed. No retries permitted until 2026-09-18 23:59:23.797660947 +0000 UTC m=+66.216385332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2chcx" (UniqueName: "kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx") pod "network-check-target-sbd75" (UID: "6c9dc933-a79e-4c05-82ec-60c15d90c5ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 23:58:52.015839 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.015815 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:52.015986 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.015816 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:52.015986 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.015919 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdpmx" podUID="842a810a-8527-41e6-9d16-b6abb2cb9fbb" Sep 18 23:58:52.016079 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.015816 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:52.016079 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.016001 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hsq9l" podUID="7666a16c-bef5-4d6f-9984-768b7d1a0a9d" Sep 18 23:58:52.016079 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.016060 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbd75" podUID="6c9dc933-a79e-4c05-82ec-60c15d90c5ad" Sep 18 23:58:52.315940 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.315839 2568 generic.go:356] "Generic (PLEG): container finished" podID="45509027-2edb-48a5-aa49-5f53a3bd55b6" containerID="0f898bdd452063305734401346199cb885d58549da639c161bd56d31b4f2f8e3" exitCode=0 Sep 18 23:58:52.315940 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.315880 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" event={"ID":"45509027-2edb-48a5-aa49-5f53a3bd55b6","Type":"ContainerDied","Data":"0f898bdd452063305734401346199cb885d58549da639c161bd56d31b4f2f8e3"} Sep 18 23:58:52.420192 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.420168 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-42.ec2.internal" event="NodeReady" Sep 18 23:58:52.420319 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.420293 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 23:58:52.455995 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.455972 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp"] Sep 18 23:58:52.475103 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.474967 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h"] Sep 18 23:58:52.477032 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.475108 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:52.478301 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.478039 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 18 23:58:52.478301 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.478287 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rh2f4\"" Sep 18 23:58:52.478524 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.478428 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.479166 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.479147 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.497254 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.497234 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75b98f4cf5-gw47b"] Sep 18 23:58:52.497403 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.497386 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.501586 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.501334 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 18 23:58:52.502103 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.501973 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 18 23:58:52.502103 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.501985 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-p4hlt\"" Sep 18 23:58:52.502103 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.502022 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.502103 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.502064 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.513362 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.513330 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv"] Sep 18 23:58:52.513507 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.513486 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.516065 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.516040 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 23:58:52.516065 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.516057 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 23:58:52.516237 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.516188 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8qxt\"" Sep 18 23:58:52.516600 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.516350 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 23:58:52.521810 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.521790 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 23:58:52.528416 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.528399 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-qgd4d"] Sep 18 23:58:52.528523 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.528507 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.530945 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.530927 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.531049 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.530963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 18 23:58:52.531049 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.530972 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.531134 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.531051 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 18 23:58:52.531233 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.531203 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qwqs7\"" Sep 18 23:58:52.538685 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.538667 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-t2l6g"] Sep 18 23:58:52.538800 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.538786 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.541112 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.541092 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.541212 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.541191 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 18 23:58:52.541329 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.541314 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 18 23:58:52.542177 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.541692 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kpmsz\"" Sep 18 23:58:52.542177 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.541739 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.546872 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.546767 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq"] Sep 18 23:58:52.547008 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.546982 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.547169 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.547148 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 18 23:58:52.549517 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.549501 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 18 23:58:52.549616 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.549514 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 18 23:58:52.549616 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.549554 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.549961 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.549935 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.550134 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.550120 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-m25jk\"" Sep 18 23:58:52.554400 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.554384 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 18 23:58:52.554729 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.554717 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp"] Sep 18 23:58:52.554784 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.554742 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69bdf69d78-p2kl4"] Sep 18 23:58:52.554862 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.554840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq" Sep 18 23:58:52.557268 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.557252 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.557358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.557254 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-www6s\"" Sep 18 23:58:52.557358 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.557321 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.568966 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.568949 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq"] Sep 18 23:58:52.569055 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.568978 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv"] Sep 18 23:58:52.569055 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.568996 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-qgd4d"] Sep 18 23:58:52.569055 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.569014 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-t2l6g"] Sep 18 23:58:52.569055 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.569032 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75b98f4cf5-gw47b"] Sep 18 23:58:52.569055 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.569048 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.569286 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.569051 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn"] Sep 18 23:58:52.571385 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.571368 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 18 23:58:52.571575 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.571556 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.571680 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.571637 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 18 23:58:52.571680 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.571640 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 18 23:58:52.571782 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.571694 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d67kv\"" Sep 18 23:58:52.571899 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.571876 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 18 23:58:52.572110 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.572095 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.587224 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.587207 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7"] Sep 18 23:58:52.587323 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.587310 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.588674 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.588656 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:52.589545 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.589530 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 18 23:58:52.589619 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.589551 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-949zc\"" Sep 18 23:58:52.589807 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.589794 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.590074 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.590060 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.590074 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.590071 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 18 23:58:52.601402 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.601385 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h"] Sep 18 23:58:52.601479 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.601454 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m"] Sep 18 23:58:52.601479 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.601392 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7" Sep 18 23:58:52.601816 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.601798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xcd\" (UniqueName: \"kubernetes.io/projected/eff01b5f-b50c-486f-a499-0c17ff65babf-kube-api-access-x6xcd\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.601908 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.601834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-installation-pull-secrets\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.601908 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.601866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1f6cb64-a53b-40f4-a470-bac55725c938-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.601983 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.601961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:52.602019 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.601992 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgx8h\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-kube-api-access-wgx8h\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.602053 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602020 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1f6cb64-a53b-40f4-a470-bac55725c938-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.602091 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602049 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-ca-trust-extracted\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.602091 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602078 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-image-registry-private-configuration\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.602180 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-bound-sa-token\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.602180 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb9w5\" (UniqueName: \"kubernetes.io/projected/7990ba17-27bf-493d-bbc7-b7632abd0a55-kube-api-access-rb9w5\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:52.602180 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602147 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eff01b5f-b50c-486f-a499-0c17ff65babf-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.602180 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-trusted-ca\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.602369 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-certificates\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.602369 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602235 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.602369 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.602369 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.602267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbj2\" (UniqueName: \"kubernetes.io/projected/a1f6cb64-a53b-40f4-a470-bac55725c938-kube-api-access-zsbj2\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.604177 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.603992 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.604177 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.604024 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-clll7\"" Sep 18 23:58:52.604364 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.604248 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.615127 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.615109 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cc99k"] Sep 18 23:58:52.615240 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.615226 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:52.617764 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.617747 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 18 23:58:52.617872 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.617857 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 18 23:58:52.617971 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.617958 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-48j4f\"" Sep 18 23:58:52.629183 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.629157 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bvxsk"] Sep 18 23:58:52.629297 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.629281 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cc99k" Sep 18 23:58:52.631607 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.631589 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 23:58:52.631691 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.631661 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kfzh4\"" Sep 18 23:58:52.631812 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.631797 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 23:58:52.631928 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.631913 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 23:58:52.636096 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.636081 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69bdf69d78-p2kl4"] Sep 18 23:58:52.636167 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.636111 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn"] Sep 18 23:58:52.636167 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.636131 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7"] Sep 18 23:58:52.636167 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.636148 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bvxsk"] Sep 18 23:58:52.636259 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.636169 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m"] Sep 18 23:58:52.636259 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.636187 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.636328 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.636191 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cc99k"] Sep 18 23:58:52.638494 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.638474 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 23:58:52.638566 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.638532 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 23:58:52.638631 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.638578 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ljxt7\"" Sep 18 23:58:52.675384 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.675363 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:52.703489 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703462 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgx8h\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-kube-api-access-wgx8h\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703495 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/082a8d06-c6bc-495e-b0d8-c026a33cbddb-serving-cert\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703512 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtksp\" (UniqueName: \"kubernetes.io/projected/082a8d06-c6bc-495e-b0d8-c026a33cbddb-kube-api-access-qtksp\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cd5h\" (UniqueName: \"kubernetes.io/projected/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-kube-api-access-9cd5h\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703545 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-image-registry-private-configuration\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eff01b5f-b50c-486f-a499-0c17ff65babf-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-trusted-ca\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703661 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-serving-cert\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cts4b\" (UniqueName: \"kubernetes.io/projected/8c88d1ed-ac5e-4e02-bf24-4cc04456e056-kube-api-access-cts4b\") pod \"network-check-source-7cbc45fddc-bbzk7\" (UID: \"8c88d1ed-ac5e-4e02-bf24-4cc04456e056\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-certificates\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703757 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.703803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.703840 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.703912 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls podName:eff01b5f-b50c-486f-a499-0c17ff65babf nodeName:}" failed. No retries permitted until 2026-09-18 23:58:53.203875403 +0000 UTC m=+35.622599789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bqz6h" (UID: "eff01b5f-b50c-486f-a499-0c17ff65babf") : secret "cluster-monitoring-operator-tls" not found Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm45s\" (UniqueName: \"kubernetes.io/projected/f1cfe40f-de5e-4935-8c53-aa6c931dc940-kube-api-access-vm45s\") pod \"volume-data-source-validator-5c4db8bdf9-k9fkq\" (UID: \"f1cfe40f-de5e-4935-8c53-aa6c931dc940\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703952 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbj2\" (UniqueName: \"kubernetes.io/projected/a1f6cb64-a53b-40f4-a470-bac55725c938-kube-api-access-zsbj2\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703969 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xcd\" (UniqueName: \"kubernetes.io/projected/eff01b5f-b50c-486f-a499-0c17ff65babf-kube-api-access-x6xcd\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.703990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/082a8d06-c6bc-495e-b0d8-c026a33cbddb-config\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-default-certificate\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74xr\" (UniqueName: \"kubernetes.io/projected/53e9c2c3-7159-405c-9078-11e083b84d16-kube-api-access-b74xr\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-installation-pull-secrets\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704179 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ea81138-5709-41f2-819c-bc743cd7b9d7-cert\") pod \"ingress-canary-cc99k\" (UID: \"0ea81138-5709-41f2-819c-bc743cd7b9d7\") " pod="openshift-ingress-canary/ingress-canary-cc99k" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704273 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-stats-auth\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.704360 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-tmp\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704315 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-certificates\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704395 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eff01b5f-b50c-486f-a499-0c17ff65babf-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1f6cb64-a53b-40f4-a470-bac55725c938-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.704448 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704473 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/082a8d06-c6bc-495e-b0d8-c026a33cbddb-trusted-ca\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.704489 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls podName:7990ba17-27bf-493d-bbc7-b7632abd0a55 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:53.204473462 +0000 UTC m=+35.623197859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xzltp" (UID: "7990ba17-27bf-493d-bbc7-b7632abd0a55") : secret "samples-operator-tls" not found Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704525 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-ca-trust-extracted\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704544 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b1f30b8-b607-494a-9894-c7cc4817b64d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-bound-sa-token\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb9w5\" (UniqueName: \"kubernetes.io/projected/7990ba17-27bf-493d-bbc7-b7632abd0a55-kube-api-access-rb9w5\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lnth\" (UniqueName: \"kubernetes.io/projected/0ea81138-5709-41f2-819c-bc743cd7b9d7-kube-api-access-6lnth\") pod \"ingress-canary-cc99k\" (UID: \"0ea81138-5709-41f2-819c-bc743cd7b9d7\") " pod="openshift-ingress-canary/ingress-canary-cc99k" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704683 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-trusted-ca\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-snapshots\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.705070 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704746 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51331aed-dfac-49dc-91fc-52a60666e981-config\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704787 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-ca-trust-extracted\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51331aed-dfac-49dc-91fc-52a60666e981-serving-cert\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5xk\" (UniqueName: \"kubernetes.io/projected/51331aed-dfac-49dc-91fc-52a60666e981-kube-api-access-ng5xk\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.704909 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704916 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.704932 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b98f4cf5-gw47b: secret "image-registry-tls" not found Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.704946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1f6cb64-a53b-40f4-a470-bac55725c938-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.704968 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls podName:5b086dd8-58e6-4da9-abdd-bd1ed42b64da nodeName:}" failed. No retries permitted until 2026-09-18 23:58:53.20495469 +0000 UTC m=+35.623679075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls") pod "image-registry-75b98f4cf5-gw47b" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da") : secret "image-registry-tls" not found Sep 18 23:58:52.705758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.705020 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1f6cb64-a53b-40f4-a470-bac55725c938-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.707686 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.707667 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1f6cb64-a53b-40f4-a470-bac55725c938-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.707806 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.707791 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-installation-pull-secrets\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.710280 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.710249 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-image-registry-private-configuration\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.712307 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.712264 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbj2\" (UniqueName: \"kubernetes.io/projected/a1f6cb64-a53b-40f4-a470-bac55725c938-kube-api-access-zsbj2\") pod \"kube-storage-version-migrator-operator-55889f7b47-t5hrv\" (UID: \"a1f6cb64-a53b-40f4-a470-bac55725c938\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.712498 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.712474 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgx8h\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-kube-api-access-wgx8h\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.712942 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.712868 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-bound-sa-token\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:52.712942 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.712869 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xcd\" (UniqueName: \"kubernetes.io/projected/eff01b5f-b50c-486f-a499-0c17ff65babf-kube-api-access-x6xcd\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:52.713498 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.713478 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb9w5\" (UniqueName: \"kubernetes.io/projected/7990ba17-27bf-493d-bbc7-b7632abd0a55-kube-api-access-rb9w5\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:52.765169 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.765142 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:52.805280 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805255 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/082a8d06-c6bc-495e-b0d8-c026a33cbddb-trusted-ca\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.805400 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b1f30b8-b607-494a-9894-c7cc4817b64d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:52.805400 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwk8\" (UniqueName: \"kubernetes.io/projected/244cbdac-c648-406b-aa72-775b79b10756-kube-api-access-7mwk8\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.805400 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lnth\" (UniqueName: \"kubernetes.io/projected/0ea81138-5709-41f2-819c-bc743cd7b9d7-kube-api-access-6lnth\") pod \"ingress-canary-cc99k\" (UID: \"0ea81138-5709-41f2-819c-bc743cd7b9d7\") " pod="openshift-ingress-canary/ingress-canary-cc99k" Sep 18 23:58:52.805400 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-snapshots\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.805400 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51331aed-dfac-49dc-91fc-52a60666e981-config\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.805596 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805405 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51331aed-dfac-49dc-91fc-52a60666e981-serving-cert\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.805596 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805461 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5xk\" (UniqueName: \"kubernetes.io/projected/51331aed-dfac-49dc-91fc-52a60666e981-kube-api-access-ng5xk\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.805596 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805500 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/244cbdac-c648-406b-aa72-775b79b10756-config-volume\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.805596 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.805779 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.805662 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:53.305643548 +0000 UTC m=+35.724367953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : configmap references non-existent config key: service-ca.crt Sep 18 23:58:52.805779 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/082a8d06-c6bc-495e-b0d8-c026a33cbddb-serving-cert\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.805779 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805761 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtksp\" (UniqueName: \"kubernetes.io/projected/082a8d06-c6bc-495e-b0d8-c026a33cbddb-kube-api-access-qtksp\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.805965 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805790 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cd5h\" (UniqueName: \"kubernetes.io/projected/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-kube-api-access-9cd5h\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.805965 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805839 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-serving-cert\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.805965 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cts4b\" (UniqueName: \"kubernetes.io/projected/8c88d1ed-ac5e-4e02-bf24-4cc04456e056-kube-api-access-cts4b\") pod \"network-check-source-7cbc45fddc-bbzk7\" (UID: \"8c88d1ed-ac5e-4e02-bf24-4cc04456e056\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7" Sep 18 23:58:52.805965 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.806162 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.805987 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.806162 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm45s\" (UniqueName: \"kubernetes.io/projected/f1cfe40f-de5e-4935-8c53-aa6c931dc940-kube-api-access-vm45s\") pod \"volume-data-source-validator-5c4db8bdf9-k9fkq\" (UID: \"f1cfe40f-de5e-4935-8c53-aa6c931dc940\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq" Sep 18 23:58:52.806162 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806042 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-snapshots\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.806162 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/082a8d06-c6bc-495e-b0d8-c026a33cbddb-config\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.806162 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806064 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51331aed-dfac-49dc-91fc-52a60666e981-config\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.806162 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-default-certificate\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b74xr\" (UniqueName: \"kubernetes.io/projected/53e9c2c3-7159-405c-9078-11e083b84d16-kube-api-access-b74xr\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806280 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.806293 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ea81138-5709-41f2-819c-bc743cd7b9d7-cert\") pod \"ingress-canary-cc99k\" (UID: \"0ea81138-5709-41f2-819c-bc743cd7b9d7\") " pod="openshift-ingress-canary/ingress-canary-cc99k" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806337 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806218 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/082a8d06-c6bc-495e-b0d8-c026a33cbddb-trusted-ca\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806361 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-stats-auth\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806398 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-tmp\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.806581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/244cbdac-c648-406b-aa72-775b79b10756-tmp-dir\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.807081 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806620 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.807081 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806696 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b1f30b8-b607-494a-9894-c7cc4817b64d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:52.807081 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.806767 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 23:58:52.807081 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.806812 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert podName:6b1f30b8-b607-494a-9894-c7cc4817b64d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:53.306797372 +0000 UTC m=+35.725521772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jvm6m" (UID: "6b1f30b8-b607-494a-9894-c7cc4817b64d") : secret "networking-console-plugin-cert" not found Sep 18 23:58:52.807081 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.806915 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-tmp\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.808382 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.807395 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:53.307374503 +0000 UTC m=+35.726098905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : secret "router-metrics-certs-default" not found Sep 18 23:58:52.808382 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.807720 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/082a8d06-c6bc-495e-b0d8-c026a33cbddb-config\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.808382 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.808318 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.808382 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.808329 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51331aed-dfac-49dc-91fc-52a60666e981-serving-cert\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.809235 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.808987 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-serving-cert\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.809235 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.809189 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ea81138-5709-41f2-819c-bc743cd7b9d7-cert\") pod \"ingress-canary-cc99k\" (UID: \"0ea81138-5709-41f2-819c-bc743cd7b9d7\") " pod="openshift-ingress-canary/ingress-canary-cc99k" Sep 18 23:58:52.809353 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.809245 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-stats-auth\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.809353 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.809307 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-default-certificate\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.809690 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.809669 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/082a8d06-c6bc-495e-b0d8-c026a33cbddb-serving-cert\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.814792 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.814764 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cts4b\" (UniqueName: \"kubernetes.io/projected/8c88d1ed-ac5e-4e02-bf24-4cc04456e056-kube-api-access-cts4b\") pod \"network-check-source-7cbc45fddc-bbzk7\" (UID: \"8c88d1ed-ac5e-4e02-bf24-4cc04456e056\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7" Sep 18 23:58:52.815422 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.815179 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5xk\" (UniqueName: \"kubernetes.io/projected/51331aed-dfac-49dc-91fc-52a60666e981-kube-api-access-ng5xk\") pod \"service-ca-operator-57cdc4b768-hhrgn\" (UID: \"51331aed-dfac-49dc-91fc-52a60666e981\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.815608 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.815586 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lnth\" (UniqueName: \"kubernetes.io/projected/0ea81138-5709-41f2-819c-bc743cd7b9d7-kube-api-access-6lnth\") pod \"ingress-canary-cc99k\" (UID: \"0ea81138-5709-41f2-819c-bc743cd7b9d7\") " pod="openshift-ingress-canary/ingress-canary-cc99k" Sep 18 23:58:52.815608 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.815590 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtksp\" (UniqueName: \"kubernetes.io/projected/082a8d06-c6bc-495e-b0d8-c026a33cbddb-kube-api-access-qtksp\") pod \"console-operator-fd4bb46c-qgd4d\" (UID: \"082a8d06-c6bc-495e-b0d8-c026a33cbddb\") " pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.815758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.815671 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cd5h\" (UniqueName: \"kubernetes.io/projected/63e3b0fa-d932-4e4e-901d-f0cdf089c5d3-kube-api-access-9cd5h\") pod \"insights-operator-6f9c644dd9-t2l6g\" (UID: \"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3\") " pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.815946 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.815928 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm45s\" (UniqueName: \"kubernetes.io/projected/f1cfe40f-de5e-4935-8c53-aa6c931dc940-kube-api-access-vm45s\") pod \"volume-data-source-validator-5c4db8bdf9-k9fkq\" (UID: \"f1cfe40f-de5e-4935-8c53-aa6c931dc940\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq" Sep 18 23:58:52.816126 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.816111 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74xr\" (UniqueName: \"kubernetes.io/projected/53e9c2c3-7159-405c-9078-11e083b84d16-kube-api-access-b74xr\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:52.865773 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.865695 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" Sep 18 23:58:52.871883 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.871859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:58:52.877640 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.877620 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" Sep 18 23:58:52.883448 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.883421 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq" Sep 18 23:58:52.895638 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.895466 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" Sep 18 23:58:52.907032 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.906995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/244cbdac-c648-406b-aa72-775b79b10756-config-volume\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.907144 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.907089 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.907248 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.907203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/244cbdac-c648-406b-aa72-775b79b10756-tmp-dir\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.910012 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.907266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwk8\" (UniqueName: \"kubernetes.io/projected/244cbdac-c648-406b-aa72-775b79b10756-kube-api-access-7mwk8\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.910012 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.907354 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:58:52.910012 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:52.907433 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls podName:244cbdac-c648-406b-aa72-775b79b10756 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:53.407412823 +0000 UTC m=+35.826137225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls") pod "dns-default-bvxsk" (UID: "244cbdac-c648-406b-aa72-775b79b10756") : secret "dns-default-metrics-tls" not found Sep 18 23:58:52.910012 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.908216 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/244cbdac-c648-406b-aa72-775b79b10756-tmp-dir\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.910012 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.908408 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/244cbdac-c648-406b-aa72-775b79b10756-config-volume\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.910278 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.910034 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7" Sep 18 23:58:52.917317 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.917290 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwk8\" (UniqueName: \"kubernetes.io/projected/244cbdac-c648-406b-aa72-775b79b10756-kube-api-access-7mwk8\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:52.937601 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:52.937574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cc99k" Sep 18 23:58:53.185216 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.185184 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-qgd4d"] Sep 18 23:58:53.186516 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.186453 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-t2l6g"] Sep 18 23:58:53.187729 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.187712 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq"] Sep 18 23:58:53.188925 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.188865 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv"] Sep 18 23:58:53.189276 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:53.189114 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cfe40f_de5e_4935_8c53_aa6c931dc940.slice/crio-500257a4f3e0f5d962c2818c20128a85b7257765e3324010b15f4b4b519107c9 WatchSource:0}: Error finding container 500257a4f3e0f5d962c2818c20128a85b7257765e3324010b15f4b4b519107c9: Status 404 returned error can't find the container with id 500257a4f3e0f5d962c2818c20128a85b7257765e3324010b15f4b4b519107c9 Sep 18 23:58:53.191102 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:53.189443 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e3b0fa_d932_4e4e_901d_f0cdf089c5d3.slice/crio-a7d4df1277e2eb908bee6a802ca629f3edd573d4bc6213f2458e8432a5df4e5a WatchSource:0}: Error finding container a7d4df1277e2eb908bee6a802ca629f3edd573d4bc6213f2458e8432a5df4e5a: Status 404 returned error can't find the container with id a7d4df1277e2eb908bee6a802ca629f3edd573d4bc6213f2458e8432a5df4e5a Sep 18 23:58:53.192216 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:53.192196 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082a8d06_c6bc_495e_b0d8_c026a33cbddb.slice/crio-88b6af8c709a763d1a0189955c45010832e146d1fa6d25063b051cdd7d5cc473 WatchSource:0}: Error finding container 88b6af8c709a763d1a0189955c45010832e146d1fa6d25063b051cdd7d5cc473: Status 404 returned error can't find the container with id 88b6af8c709a763d1a0189955c45010832e146d1fa6d25063b051cdd7d5cc473 Sep 18 23:58:53.193299 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:53.193275 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f6cb64_a53b_40f4_a470_bac55725c938.slice/crio-b41618d8c7d335923d45427a6c9bde724b1a95569ca46a39c77603b52ec8b090 WatchSource:0}: Error finding container b41618d8c7d335923d45427a6c9bde724b1a95569ca46a39c77603b52ec8b090: Status 404 returned error can't find the container with id b41618d8c7d335923d45427a6c9bde724b1a95569ca46a39c77603b52ec8b090 Sep 18 23:58:53.210575 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.210547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:53.210669 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.210619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:53.210669 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.210661 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:53.210751 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.210691 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 23:58:53.210751 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.210744 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls podName:eff01b5f-b50c-486f-a499-0c17ff65babf nodeName:}" failed. No retries permitted until 2026-09-18 23:58:54.210724963 +0000 UTC m=+36.629449353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bqz6h" (UID: "eff01b5f-b50c-486f-a499-0c17ff65babf") : secret "cluster-monitoring-operator-tls" not found Sep 18 23:58:53.210836 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.210770 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 23:58:53.210836 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.210786 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 23:58:53.210836 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.210799 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b98f4cf5-gw47b: secret "image-registry-tls" not found Sep 18 23:58:53.210836 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.210834 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls podName:7990ba17-27bf-493d-bbc7-b7632abd0a55 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:54.210817612 +0000 UTC m=+36.629542003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xzltp" (UID: "7990ba17-27bf-493d-bbc7-b7632abd0a55") : secret "samples-operator-tls" not found Sep 18 23:58:53.210836 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.210849 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls podName:5b086dd8-58e6-4da9-abdd-bd1ed42b64da nodeName:}" failed. No retries permitted until 2026-09-18 23:58:54.210842539 +0000 UTC m=+36.629566926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls") pod "image-registry-75b98f4cf5-gw47b" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da") : secret "image-registry-tls" not found Sep 18 23:58:53.217185 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.217163 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn"] Sep 18 23:58:53.220070 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:53.220038 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51331aed_dfac_49dc_91fc_52a60666e981.slice/crio-05353bc482ba572895d4afd93fd6d859818d0a3ffea13b275bbe89cbeaf29ffa WatchSource:0}: Error finding container 05353bc482ba572895d4afd93fd6d859818d0a3ffea13b275bbe89cbeaf29ffa: Status 404 returned error can't find the container with id 05353bc482ba572895d4afd93fd6d859818d0a3ffea13b275bbe89cbeaf29ffa Sep 18 23:58:53.229600 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.229580 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7"] Sep 18 23:58:53.232008 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:53.231983 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c88d1ed_ac5e_4e02_bf24_4cc04456e056.slice/crio-d0cf678b9854cf0ec482e95f1b0c383ab1651690a930683372fd2611ff89f032 WatchSource:0}: Error finding container d0cf678b9854cf0ec482e95f1b0c383ab1651690a930683372fd2611ff89f032: Status 404 returned error can't find the container with id d0cf678b9854cf0ec482e95f1b0c383ab1651690a930683372fd2611ff89f032 Sep 18 23:58:53.252460 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.252440 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cc99k"] Sep 18 23:58:53.255374 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:58:53.255352 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea81138_5709_41f2_819c_bc743cd7b9d7.slice/crio-87df99cba28c286f58718961b244bc7dd6928ad64334e0956ff3d11afdf4677f WatchSource:0}: Error finding container 87df99cba28c286f58718961b244bc7dd6928ad64334e0956ff3d11afdf4677f: Status 404 returned error can't find the container with id 87df99cba28c286f58718961b244bc7dd6928ad64334e0956ff3d11afdf4677f Sep 18 23:58:53.311470 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.311445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:53.311617 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.311482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:53.311617 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.311569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:53.311617 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.311594 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 23:58:53.311763 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.311628 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 23:58:53.311763 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.311648 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:54.311634487 +0000 UTC m=+36.730358891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : secret "router-metrics-certs-default" not found Sep 18 23:58:53.311763 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.311680 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert podName:6b1f30b8-b607-494a-9894-c7cc4817b64d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:54.311668145 +0000 UTC m=+36.730392557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jvm6m" (UID: "6b1f30b8-b607-494a-9894-c7cc4817b64d") : secret "networking-console-plugin-cert" not found Sep 18 23:58:53.311763 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.311698 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:54.311689042 +0000 UTC m=+36.730413430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : configmap references non-existent config key: service-ca.crt Sep 18 23:58:53.319359 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.319336 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cc99k" event={"ID":"0ea81138-5709-41f2-819c-bc743cd7b9d7","Type":"ContainerStarted","Data":"87df99cba28c286f58718961b244bc7dd6928ad64334e0956ff3d11afdf4677f"} Sep 18 23:58:53.324127 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.320798 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" event={"ID":"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3","Type":"ContainerStarted","Data":"a7d4df1277e2eb908bee6a802ca629f3edd573d4bc6213f2458e8432a5df4e5a"} Sep 18 23:58:53.324127 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.322365 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" event={"ID":"a1f6cb64-a53b-40f4-a470-bac55725c938","Type":"ContainerStarted","Data":"b41618d8c7d335923d45427a6c9bde724b1a95569ca46a39c77603b52ec8b090"} Sep 18 23:58:53.324127 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.323873 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7" event={"ID":"8c88d1ed-ac5e-4e02-bf24-4cc04456e056","Type":"ContainerStarted","Data":"d0cf678b9854cf0ec482e95f1b0c383ab1651690a930683372fd2611ff89f032"} Sep 18 23:58:53.327368 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.327347 2568 generic.go:356] "Generic (PLEG): container finished" podID="45509027-2edb-48a5-aa49-5f53a3bd55b6" containerID="8c3655771cf3ede2fd888f3fcf058c7a36d7be4e19af56454920641fe8062629" exitCode=0 Sep 18 23:58:53.327449 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.327408 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" event={"ID":"45509027-2edb-48a5-aa49-5f53a3bd55b6","Type":"ContainerDied","Data":"8c3655771cf3ede2fd888f3fcf058c7a36d7be4e19af56454920641fe8062629"} Sep 18 23:58:53.328508 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.328489 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" event={"ID":"51331aed-dfac-49dc-91fc-52a60666e981","Type":"ContainerStarted","Data":"05353bc482ba572895d4afd93fd6d859818d0a3ffea13b275bbe89cbeaf29ffa"} Sep 18 23:58:53.329584 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.329568 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq" event={"ID":"f1cfe40f-de5e-4935-8c53-aa6c931dc940","Type":"ContainerStarted","Data":"500257a4f3e0f5d962c2818c20128a85b7257765e3324010b15f4b4b519107c9"} Sep 18 23:58:53.330773 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.330755 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" event={"ID":"082a8d06-c6bc-495e-b0d8-c026a33cbddb","Type":"ContainerStarted","Data":"88b6af8c709a763d1a0189955c45010832e146d1fa6d25063b051cdd7d5cc473"} Sep 18 23:58:53.391590 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.391565 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:53.411944 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.411918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:53.412077 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.412057 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:58:53.412142 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:53.412125 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls podName:244cbdac-c648-406b-aa72-775b79b10756 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:54.412107308 +0000 UTC m=+36.830831711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls") pod "dns-default-bvxsk" (UID: "244cbdac-c648-406b-aa72-775b79b10756") : secret "dns-default-metrics-tls" not found Sep 18 23:58:53.747433 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.747348 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:53.804778 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:53.804445 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:54.021447 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.019864 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:58:54.021447 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.020373 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:58:54.021447 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.020764 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:58:54.024359 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.023276 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 23:58:54.024359 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.023497 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 23:58:54.024883 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.024630 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ggrtp\"" Sep 18 23:58:54.024883 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.024650 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jgg6h\"" Sep 18 23:58:54.218375 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.218338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:54.218568 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.218427 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:54.218568 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.218508 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:54.218685 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.218674 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 23:58:54.218734 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.218689 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b98f4cf5-gw47b: secret "image-registry-tls" not found Sep 18 23:58:54.218782 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.218743 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls podName:5b086dd8-58e6-4da9-abdd-bd1ed42b64da nodeName:}" failed. No retries permitted until 2026-09-18 23:58:56.218725609 +0000 UTC m=+38.637450002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls") pod "image-registry-75b98f4cf5-gw47b" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da") : secret "image-registry-tls" not found Sep 18 23:58:54.219626 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.219148 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 23:58:54.219626 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.219207 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls podName:eff01b5f-b50c-486f-a499-0c17ff65babf nodeName:}" failed. No retries permitted until 2026-09-18 23:58:56.219191444 +0000 UTC m=+38.637915836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bqz6h" (UID: "eff01b5f-b50c-486f-a499-0c17ff65babf") : secret "cluster-monitoring-operator-tls" not found Sep 18 23:58:54.219626 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.219266 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 23:58:54.219626 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.219299 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls podName:7990ba17-27bf-493d-bbc7-b7632abd0a55 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:56.219288022 +0000 UTC m=+38.638012414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xzltp" (UID: "7990ba17-27bf-493d-bbc7-b7632abd0a55") : secret "samples-operator-tls" not found Sep 18 23:58:54.320689 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.319933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:54.320689 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.319983 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:54.320689 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.320073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:54.320689 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.320215 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:56.320193946 +0000 UTC m=+38.738918337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : configmap references non-existent config key: service-ca.crt Sep 18 23:58:54.320689 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.320423 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 23:58:54.320689 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.320495 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert podName:6b1f30b8-b607-494a-9894-c7cc4817b64d nodeName:}" failed. No retries permitted until 2026-09-18 23:58:56.32047783 +0000 UTC m=+38.739202221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jvm6m" (UID: "6b1f30b8-b607-494a-9894-c7cc4817b64d") : secret "networking-console-plugin-cert" not found Sep 18 23:58:54.320689 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.320553 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 23:58:54.320689 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.320584 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:56.320573304 +0000 UTC m=+38.739297692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : secret "router-metrics-certs-default" not found Sep 18 23:58:54.345141 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.344564 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" event={"ID":"45509027-2edb-48a5-aa49-5f53a3bd55b6","Type":"ContainerStarted","Data":"f584781a6ee09c10029e231262249fe9a98310c926d166c3eac18cc3967bd76a"} Sep 18 23:58:54.364928 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.363630 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dcgk5" podStartSLOduration=8.046486748 podStartE2EDuration="36.363611165s" totalImagesPullingTime="28.317124417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:58:54.362638088 +0000 UTC m=+36.781362496" watchObservedRunningTime="2026-09-18 23:58:54.363611165 +0000 UTC m=+36.782335567" Sep 18 23:58:54.422916 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.421473 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:54.422916 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.422092 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:58:54.422916 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:54.422149 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls podName:244cbdac-c648-406b-aa72-775b79b10756 nodeName:}" failed. No retries permitted until 2026-09-18 23:58:56.422132377 +0000 UTC m=+38.840856778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls") pod "dns-default-bvxsk" (UID: "244cbdac-c648-406b-aa72-775b79b10756") : secret "dns-default-metrics-tls" not found Sep 18 23:58:54.543365 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.543245 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:54.599918 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.599814 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:54.958028 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:54.957877 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:55.057647 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:55.057584 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:55.371876 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:55.371803 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:55.662622 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:55.662525 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:56.239627 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:56.239598 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:56.239705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.239756 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.239773 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b98f4cf5-gw47b: secret "image-registry-tls" not found Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:56.239778 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.239832 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls podName:5b086dd8-58e6-4da9-abdd-bd1ed42b64da nodeName:}" failed. No retries permitted until 2026-09-18 23:59:00.239813752 +0000 UTC m=+42.658538158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls") pod "image-registry-75b98f4cf5-gw47b" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da") : secret "image-registry-tls" not found Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.239862 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.239932 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.239956 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls podName:eff01b5f-b50c-486f-a499-0c17ff65babf nodeName:}" failed. No retries permitted until 2026-09-18 23:59:00.239935211 +0000 UTC m=+42.658659625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bqz6h" (UID: "eff01b5f-b50c-486f-a499-0c17ff65babf") : secret "cluster-monitoring-operator-tls" not found Sep 18 23:58:56.240040 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.239977 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls podName:7990ba17-27bf-493d-bbc7-b7632abd0a55 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:00.239964797 +0000 UTC m=+42.658689199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xzltp" (UID: "7990ba17-27bf-493d-bbc7-b7632abd0a55") : secret "samples-operator-tls" not found Sep 18 23:58:56.341235 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:56.341199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:56.341416 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:56.341404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:58:56.341483 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.341432 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:00.341406666 +0000 UTC m=+42.760131069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : configmap references non-existent config key: service-ca.crt Sep 18 23:58:56.341541 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.341486 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 23:58:56.341541 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:56.341490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:58:56.341629 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.341623 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:00.341606075 +0000 UTC m=+42.760330478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : secret "router-metrics-certs-default" not found Sep 18 23:58:56.341713 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.341693 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 23:58:56.341806 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.341794 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert podName:6b1f30b8-b607-494a-9894-c7cc4817b64d nodeName:}" failed. No retries permitted until 2026-09-18 23:59:00.341778406 +0000 UTC m=+42.760502802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jvm6m" (UID: "6b1f30b8-b607-494a-9894-c7cc4817b64d") : secret "networking-console-plugin-cert" not found Sep 18 23:58:56.442664 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:56.442586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:58:56.442818 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.442752 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:58:56.442876 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:58:56.442830 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls podName:244cbdac-c648-406b-aa72-775b79b10756 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:00.442810121 +0000 UTC m=+42.861534528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls") pod "dns-default-bvxsk" (UID: "244cbdac-c648-406b-aa72-775b79b10756") : secret "dns-default-metrics-tls" not found Sep 18 23:58:57.215290 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:57.215214 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:57.264746 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:57.264710 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:58.258836 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:58.258805 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:58:58.355319 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:58:58.355286 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:00.278553 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:00.278521 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:00.278580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:00.278664 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.278692 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.278747 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.278764 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b98f4cf5-gw47b: secret "image-registry-tls" not found Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.278767 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls podName:7990ba17-27bf-493d-bbc7-b7632abd0a55 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.27874737 +0000 UTC m=+50.697471766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xzltp" (UID: "7990ba17-27bf-493d-bbc7-b7632abd0a55") : secret "samples-operator-tls" not found Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.278807 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls podName:5b086dd8-58e6-4da9-abdd-bd1ed42b64da nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.278797011 +0000 UTC m=+50.697521403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls") pod "image-registry-75b98f4cf5-gw47b" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da") : secret "image-registry-tls" not found Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.278808 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 23:59:00.279023 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.278869 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls podName:eff01b5f-b50c-486f-a499-0c17ff65babf nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.278852861 +0000 UTC m=+50.697577270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bqz6h" (UID: "eff01b5f-b50c-486f-a499-0c17ff65babf") : secret "cluster-monitoring-operator-tls" not found Sep 18 23:59:00.379516 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:00.379478 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:00.379705 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:00.379533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:59:00.379705 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:00.379630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:00.379705 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.379632 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 23:59:00.379851 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.379744 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.379725669 +0000 UTC m=+50.798450078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : secret "router-metrics-certs-default" not found Sep 18 23:59:00.379851 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.379644 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 23:59:00.379851 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.379786 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.379768155 +0000 UTC m=+50.798492560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : configmap references non-existent config key: service-ca.crt Sep 18 23:59:00.379851 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.379818 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert podName:6b1f30b8-b607-494a-9894-c7cc4817b64d nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.379806461 +0000 UTC m=+50.798530852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jvm6m" (UID: "6b1f30b8-b607-494a-9894-c7cc4817b64d") : secret "networking-console-plugin-cert" not found Sep 18 23:59:00.481114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:00.481073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:59:00.481290 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.481253 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:59:00.481350 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:00.481328 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls podName:244cbdac-c648-406b-aa72-775b79b10756 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:08.481308675 +0000 UTC m=+50.900033076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls") pod "dns-default-bvxsk" (UID: "244cbdac-c648-406b-aa72-775b79b10756") : secret "dns-default-metrics-tls" not found Sep 18 23:59:01.367728 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.367654 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/0.log" Sep 18 23:59:01.367728 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.367696 2568 generic.go:356] "Generic (PLEG): container finished" podID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" containerID="120affca7dcf5f57b7e1fbc0f366b60d75752775b5b066986961217ecce62013" exitCode=255 Sep 18 23:59:01.368208 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.367791 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" event={"ID":"082a8d06-c6bc-495e-b0d8-c026a33cbddb","Type":"ContainerDied","Data":"120affca7dcf5f57b7e1fbc0f366b60d75752775b5b066986961217ecce62013"} Sep 18 23:59:01.368208 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.368052 2568 scope.go:117] "RemoveContainer" containerID="120affca7dcf5f57b7e1fbc0f366b60d75752775b5b066986961217ecce62013" Sep 18 23:59:01.369815 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.369765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cc99k" event={"ID":"0ea81138-5709-41f2-819c-bc743cd7b9d7","Type":"ContainerStarted","Data":"3ed1ee458345f8fb26379486bd685d29140c8d711deafdaee62282ec8ed6404f"} Sep 18 23:59:01.371453 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.371431 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" event={"ID":"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3","Type":"ContainerStarted","Data":"af7ab49a69549f0a99e856babc5bc20939ac20f0c1a347ca195dfb8b2135dd70"} Sep 18 23:59:01.373299 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.373165 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" event={"ID":"a1f6cb64-a53b-40f4-a470-bac55725c938","Type":"ContainerStarted","Data":"3143cd5e27f882413e5ff2504810663baf4a0d80e2a26d1f8a7131c40b510dba"} Sep 18 23:59:01.375005 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.374983 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7" event={"ID":"8c88d1ed-ac5e-4e02-bf24-4cc04456e056","Type":"ContainerStarted","Data":"76498d5ff7475ac7b0c751d5325623e9870ca8f7f196c3deda0ade28698bec16"} Sep 18 23:59:01.376707 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.376643 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" event={"ID":"51331aed-dfac-49dc-91fc-52a60666e981","Type":"ContainerStarted","Data":"375c5db3e71e5d7968b9d5d07d0f92c1e5b9d349f55c8e93fae8d77c38647a77"} Sep 18 23:59:01.378450 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.378427 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq" event={"ID":"f1cfe40f-de5e-4935-8c53-aa6c931dc940","Type":"ContainerStarted","Data":"99e39e97c847f7219376a59183bcd299a4c28134ff1c83fad8bd8bfa19fc009e"} Sep 18 23:59:01.401733 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.401682 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cc99k" podStartSLOduration=1.9616063289999999 podStartE2EDuration="9.401668671s" totalImagesPullingTime="7.440062342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:01.40156284 +0000 UTC m=+43.820287250" watchObservedRunningTime="2026-09-18 23:59:01.401668671 +0000 UTC m=+43.820393070" Sep 18 23:59:01.424875 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.424817 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-bbzk7" podStartSLOduration=23.666288853 podStartE2EDuration="31.424778957s" totalImagesPullingTime="7.758490104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:01.424046818 +0000 UTC m=+43.842771222" watchObservedRunningTime="2026-09-18 23:59:01.424778957 +0000 UTC m=+43.843503368" Sep 18 23:59:01.453473 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.453425 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" podStartSLOduration=23.971858509 podStartE2EDuration="31.453408339s" totalImagesPullingTime="7.48154983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:01.453031909 +0000 UTC m=+43.871756319" watchObservedRunningTime="2026-09-18 23:59:01.453408339 +0000 UTC m=+43.872132746" Sep 18 23:59:01.470009 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.468989 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" podStartSLOduration=23.967012806 podStartE2EDuration="31.468968549s" totalImagesPullingTime="7.501955743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:01.468385201 +0000 UTC m=+43.887109624" watchObservedRunningTime="2026-09-18 23:59:01.468968549 +0000 UTC m=+43.887692958" Sep 18 23:59:01.505701 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.505638 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" podStartSLOduration=24.002794396 podStartE2EDuration="31.505614504s" totalImagesPullingTime="7.502820108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:01.485073219 +0000 UTC m=+43.903797628" watchObservedRunningTime="2026-09-18 23:59:01.505614504 +0000 UTC m=+43.924338915" Sep 18 23:59:01.506438 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.506393 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-k9fkq" podStartSLOduration=24.044019535 podStartE2EDuration="31.506378491s" totalImagesPullingTime="7.462358956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:01.505542881 +0000 UTC m=+43.924267288" watchObservedRunningTime="2026-09-18 23:59:01.506378491 +0000 UTC m=+43.925102899" Sep 18 23:59:01.593307 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:01.593273 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:02.390258 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.390228 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/1.log" Sep 18 23:59:02.390695 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.390684 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/0.log" Sep 18 23:59:02.390769 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.390716 2568 generic.go:356] "Generic (PLEG): container finished" podID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" containerID="02959598f309863012cea32b4e54f55dd8dd7d0d344f584864f6112785a44bd9" exitCode=255 Sep 18 23:59:02.390845 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.390823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" event={"ID":"082a8d06-c6bc-495e-b0d8-c026a33cbddb","Type":"ContainerDied","Data":"02959598f309863012cea32b4e54f55dd8dd7d0d344f584864f6112785a44bd9"} Sep 18 23:59:02.402718 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.402688 2568 scope.go:117] "RemoveContainer" containerID="120affca7dcf5f57b7e1fbc0f366b60d75752775b5b066986961217ecce62013" Sep 18 23:59:02.402847 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.402802 2568 scope.go:117] "RemoveContainer" containerID="02959598f309863012cea32b4e54f55dd8dd7d0d344f584864f6112785a44bd9" Sep 18 23:59:02.403023 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:02.402980 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-qgd4d_openshift-console-operator(082a8d06-c6bc-495e-b0d8-c026a33cbddb)\"" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" podUID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" Sep 18 23:59:02.749740 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.749650 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ggr6r"] Sep 18 23:59:02.769094 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.769064 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:02.786862 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.786837 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ggr6r"] Sep 18 23:59:02.787035 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.787000 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.789921 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.789858 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 23:59:02.790036 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.789945 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2jsqb\"" Sep 18 23:59:02.790121 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.790107 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 23:59:02.805666 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.805638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.805767 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.805683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-crio-socket\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.805820 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.805754 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-data-volume\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.805820 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.805799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.805951 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.805884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58b7l\" (UniqueName: \"kubernetes.io/projected/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-api-access-58b7l\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.872990 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.872960 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:59:02.873143 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.873009 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:59:02.906670 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.906631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-data-volume\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.906808 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.906694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.906877 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.906809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58b7l\" (UniqueName: \"kubernetes.io/projected/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-api-access-58b7l\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.906877 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:02.906844 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:02.907001 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.906906 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.907001 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:02.906936 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:03.406914561 +0000 UTC m=+45.825638969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:02.907001 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:02.906968 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 23:59:02.907001 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.906981 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-data-volume\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.907001 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.906986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-crio-socket\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.907240 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:02.907028 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:03.407009589 +0000 UTC m=+45.825733989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : configmap "kube-rbac-proxy" not found Sep 18 23:59:02.907240 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.907050 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-crio-socket\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:02.918503 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:02.918482 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58b7l\" (UniqueName: \"kubernetes.io/projected/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-api-access-58b7l\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:03.035953 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:03.035862 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:03.135999 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:03.135961 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:03.395147 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:03.395118 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/1.log" Sep 18 23:59:03.395500 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:03.395436 2568 scope.go:117] "RemoveContainer" containerID="02959598f309863012cea32b4e54f55dd8dd7d0d344f584864f6112785a44bd9" Sep 18 23:59:03.395607 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:03.395588 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-qgd4d_openshift-console-operator(082a8d06-c6bc-495e-b0d8-c026a33cbddb)\"" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" podUID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" Sep 18 23:59:03.412758 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:03.412716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:03.412944 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:03.412821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:03.412944 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:03.412866 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 23:59:03.413066 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:03.412948 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:04.412929927 +0000 UTC m=+46.831654327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : configmap "kube-rbac-proxy" not found Sep 18 23:59:03.413066 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:03.412980 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:03.413066 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:03.413031 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:04.413019238 +0000 UTC m=+46.831743628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:04.014636 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.014603 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:04.066030 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.066001 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:04.129707 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.129677 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rfjg9_57eafa90-ad4e-4321-97d8-fa435df69596/dns-node-resolver/0.log" Sep 18 23:59:04.330228 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.330149 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:04.398994 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.398967 2568 scope.go:117] "RemoveContainer" containerID="02959598f309863012cea32b4e54f55dd8dd7d0d344f584864f6112785a44bd9" Sep 18 23:59:04.399344 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:04.399120 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-qgd4d_openshift-console-operator(082a8d06-c6bc-495e-b0d8-c026a33cbddb)\"" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" podUID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" Sep 18 23:59:04.405287 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.405260 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:04.421648 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.421624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:04.421858 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:04.421839 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:04.421923 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:04.421913 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:06.421883774 +0000 UTC m=+48.840608174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:04.421998 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.421977 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:04.422076 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:04.422061 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 23:59:04.422129 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:04.422116 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:06.422102084 +0000 UTC m=+48.840826470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : configmap "kube-rbac-proxy" not found Sep 18 23:59:04.764996 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.764957 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:04.865741 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.865708 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:04.930019 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:04.929991 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b6w24_63a5cc39-c810-4bde-9a3a-5cd26e38b83e/node-ca/0.log" Sep 18 23:59:05.039650 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:05.039577 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:05.140701 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:05.140669 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:05.530197 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:05.530166 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc99k_0ea81138-5709-41f2-819c-bc743cd7b9d7/serve-healthcheck-canary/0.log" Sep 18 23:59:06.440531 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:06.440496 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:06.440707 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:06.440561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:06.440707 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:06.440619 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 23:59:06.440707 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:06.440676 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:06.440707 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:06.440697 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:10.440677613 +0000 UTC m=+52.859402016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : configmap "kube-rbac-proxy" not found Sep 18 23:59:06.440840 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:06.440722 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:10.440711965 +0000 UTC m=+52.859436352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:06.702020 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:06.701927 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:06.801446 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:06.801414 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:07.488519 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:07.488484 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:08.204478 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.204445 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:08.305336 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.305305 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:08.358613 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.358576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:59:08.358773 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.358641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:59:08.358773 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.358716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:59:08.358773 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.358728 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 23:59:08.358873 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.358789 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls podName:7990ba17-27bf-493d-bbc7-b7632abd0a55 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:24.358774558 +0000 UTC m=+66.777498944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xzltp" (UID: "7990ba17-27bf-493d-bbc7-b7632abd0a55") : secret "samples-operator-tls" not found Sep 18 23:59:08.358873 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.358789 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 23:59:08.358873 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.358798 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 23:59:08.358873 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.358806 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b98f4cf5-gw47b: secret "image-registry-tls" not found Sep 18 23:59:08.358873 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.358839 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls podName:eff01b5f-b50c-486f-a499-0c17ff65babf nodeName:}" failed. No retries permitted until 2026-09-18 23:59:24.358827997 +0000 UTC m=+66.777552382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bqz6h" (UID: "eff01b5f-b50c-486f-a499-0c17ff65babf") : secret "cluster-monitoring-operator-tls" not found Sep 18 23:59:08.358873 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.358852 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls podName:5b086dd8-58e6-4da9-abdd-bd1ed42b64da nodeName:}" failed. No retries permitted until 2026-09-18 23:59:24.358844667 +0000 UTC m=+66.777569053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls") pod "image-registry-75b98f4cf5-gw47b" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da") : secret "image-registry-tls" not found Sep 18 23:59:08.459535 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.459451 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:08.459678 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.459546 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:08.459678 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.459567 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:59:08.459678 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.459611 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:24.459592234 +0000 UTC m=+66.878316634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : configmap references non-existent config key: service-ca.crt Sep 18 23:59:08.459678 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.459654 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 23:59:08.459678 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.459674 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 23:59:08.459861 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.459703 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert podName:6b1f30b8-b607-494a-9894-c7cc4817b64d nodeName:}" failed. No retries permitted until 2026-09-18 23:59:24.459689883 +0000 UTC m=+66.878414287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jvm6m" (UID: "6b1f30b8-b607-494a-9894-c7cc4817b64d") : secret "networking-console-plugin-cert" not found Sep 18 23:59:08.459861 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.459717 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs podName:53e9c2c3-7159-405c-9078-11e083b84d16 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:24.459710941 +0000 UTC m=+66.878435327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs") pod "router-default-69bdf69d78-p2kl4" (UID: "53e9c2c3-7159-405c-9078-11e083b84d16") : secret "router-metrics-certs-default" not found Sep 18 23:59:08.560354 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.560311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:59:08.560537 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.560457 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 23:59:08.560537 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:08.560531 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls podName:244cbdac-c648-406b-aa72-775b79b10756 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:24.560515933 +0000 UTC m=+66.979240339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls") pod "dns-default-bvxsk" (UID: "244cbdac-c648-406b-aa72-775b79b10756") : secret "dns-default-metrics-tls" not found Sep 18 23:59:08.906573 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:08.906545 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:10.478449 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:10.478396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:10.478863 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:10.478487 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:10.478863 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:10.478616 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 23:59:10.478863 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:10.478686 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls podName:1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:18.478673188 +0000 UTC m=+60.897397575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggr6r" (UID: "1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3") : secret "insights-runtime-extractor-tls" not found Sep 18 23:59:10.479011 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:10.478949 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:10.527831 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:10.527800 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:10.630853 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:10.630824 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:10.775882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:10.775776 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:10.877501 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:10.877468 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:10.977452 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:10.977423 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:11.080550 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:11.080461 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:11.180900 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:11.180867 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:11.277483 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:11.277444 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:11.873645 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:11.873612 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:12.674270 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:12.674237 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:13.074996 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:13.074911 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:13.274374 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:13.274338 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:13.474580 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:13.474546 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:13.860057 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:13.859980 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:13.957108 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:13.957077 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:14.272196 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:14.272165 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:14.451404 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:14.451374 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:14.502930 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:14.502884 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:14.871118 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:14.871089 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:15.273059 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:15.272982 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:15.374311 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:15.374279 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:15.674391 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:15.674360 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:15.872526 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:15.872497 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:15.973311 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:15.973238 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:16.029326 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:16.029300 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:16.472293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:16.472246 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:16.763819 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:16.763736 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:16.874581 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:16.874550 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:17.275957 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:17.275905 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:17.674475 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:17.674447 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:18.075843 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.075765 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:18.313053 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.313024 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svtxw" Sep 18 23:59:18.470831 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.470799 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:18.549208 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.549175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:18.551371 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.551354 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggr6r\" (UID: \"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3\") " pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:18.700191 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.700162 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2jsqb\"" Sep 18 23:59:18.708353 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.708328 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ggr6r" Sep 18 23:59:18.872418 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.872380 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:18.975364 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:18.975333 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ggr6r"] Sep 18 23:59:18.979037 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:18.979013 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e26e64b_fefc_4d0d_bcaf_290a1b9a50e3.slice/crio-7beaf63cf3ef205f77a92838215ddf7c7f83ef9f5eb403526fd148a15718254e WatchSource:0}: Error finding container 7beaf63cf3ef205f77a92838215ddf7c7f83ef9f5eb403526fd148a15718254e: Status 404 returned error can't find the container with id 7beaf63cf3ef205f77a92838215ddf7c7f83ef9f5eb403526fd148a15718254e Sep 18 23:59:19.016580 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.016561 2568 scope.go:117] "RemoveContainer" containerID="02959598f309863012cea32b4e54f55dd8dd7d0d344f584864f6112785a44bd9" Sep 18 23:59:19.067638 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.067590 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:19.447155 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.444041 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 18 23:59:19.447636 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.447615 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/1.log" Sep 18 23:59:19.447703 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.447657 2568 generic.go:356] "Generic (PLEG): container finished" podID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" containerID="edf9dfa54379f0f6344a21cb313902989e586250ca793ea1f1a83e968e49df9e" exitCode=255 Sep 18 23:59:19.447763 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.447740 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" event={"ID":"082a8d06-c6bc-495e-b0d8-c026a33cbddb","Type":"ContainerDied","Data":"edf9dfa54379f0f6344a21cb313902989e586250ca793ea1f1a83e968e49df9e"} Sep 18 23:59:19.447844 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.447829 2568 scope.go:117] "RemoveContainer" containerID="02959598f309863012cea32b4e54f55dd8dd7d0d344f584864f6112785a44bd9" Sep 18 23:59:19.448208 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.448192 2568 scope.go:117] "RemoveContainer" containerID="edf9dfa54379f0f6344a21cb313902989e586250ca793ea1f1a83e968e49df9e" Sep 18 23:59:19.448386 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:19.448366 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-qgd4d_openshift-console-operator(082a8d06-c6bc-495e-b0d8-c026a33cbddb)\"" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" podUID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" Sep 18 23:59:19.449521 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.449499 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggr6r" event={"ID":"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3","Type":"ContainerStarted","Data":"6d307f3885d4f2b23553998a8ac450fdfe0fa865ad246b34703b6d3e62677fee"} Sep 18 23:59:19.449575 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.449552 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggr6r" event={"ID":"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3","Type":"ContainerStarted","Data":"7beaf63cf3ef205f77a92838215ddf7c7f83ef9f5eb403526fd148a15718254e"} Sep 18 23:59:19.476884 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:19.476859 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:20.071042 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:20.071014 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:20.454742 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:20.454715 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 18 23:59:20.456524 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:20.456499 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggr6r" event={"ID":"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3","Type":"ContainerStarted","Data":"e5c903c7217ef630522106cd577baa1776598170b69892e1bce871217dc84258"} Sep 18 23:59:20.644209 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:20.644178 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:20.745234 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:20.745149 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:20.873872 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:20.873798 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:21.077089 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:21.077024 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:21.279084 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:21.279053 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:22.465934 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:22.465898 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggr6r" event={"ID":"1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3","Type":"ContainerStarted","Data":"0948b1123dd304aa1728c083cdcd06508063fc75c7515a82ba241cdcd92b33c7"} Sep 18 23:59:22.483242 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:22.483194 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ggr6r" podStartSLOduration=18.142546558 podStartE2EDuration="20.483178788s" totalImagesPullingTime="2.34063223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:59:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:22.481281107 +0000 UTC m=+64.900005516" watchObservedRunningTime="2026-09-18 23:59:22.483178788 +0000 UTC m=+64.901903195" Sep 18 23:59:22.872985 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:22.872955 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:59:22.873143 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:22.873016 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:59:22.873379 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:22.873364 2568 scope.go:117] "RemoveContainer" containerID="edf9dfa54379f0f6344a21cb313902989e586250ca793ea1f1a83e968e49df9e" Sep 18 23:59:22.873549 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:22.873531 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-qgd4d_openshift-console-operator(082a8d06-c6bc-495e-b0d8-c026a33cbddb)\"" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" podUID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" Sep 18 23:59:23.698246 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.698209 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:59:23.700676 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.700659 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 23:59:23.710772 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.710745 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7666a16c-bef5-4d6f-9984-768b7d1a0a9d-metrics-certs\") pod \"network-metrics-daemon-hsq9l\" (UID: \"7666a16c-bef5-4d6f-9984-768b7d1a0a9d\") " pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:59:23.757593 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.757565 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ggrtp\"" Sep 18 23:59:23.765584 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.765565 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hsq9l" Sep 18 23:59:23.799396 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.799359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:59:23.799540 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.799411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:59:23.802278 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.802249 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 23:59:23.802430 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.802403 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chcx\" (UniqueName: \"kubernetes.io/projected/6c9dc933-a79e-4c05-82ec-60c15d90c5ad-kube-api-access-2chcx\") pod \"network-check-target-sbd75\" (UID: \"6c9dc933-a79e-4c05-82ec-60c15d90c5ad\") " pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:59:23.813857 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:23.812984 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842a810a-8527-41e6-9d16-b6abb2cb9fbb-original-pull-secret\") pod \"global-pull-secret-syncer-hdpmx\" (UID: \"842a810a-8527-41e6-9d16-b6abb2cb9fbb\") " pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:59:24.041155 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.041084 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jgg6h\"" Sep 18 23:59:24.045509 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.045486 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hsq9l"] Sep 18 23:59:24.048061 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.048046 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdpmx" Sep 18 23:59:24.048385 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:24.048366 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7666a16c_bef5_4d6f_9984_768b7d1a0a9d.slice/crio-0cd8cfa2fad3dbfbe0e78a28f84e2f11407752fb7da2f83a3b5000e3a12a274f WatchSource:0}: Error finding container 0cd8cfa2fad3dbfbe0e78a28f84e2f11407752fb7da2f83a3b5000e3a12a274f: Status 404 returned error can't find the container with id 0cd8cfa2fad3dbfbe0e78a28f84e2f11407752fb7da2f83a3b5000e3a12a274f Sep 18 23:59:24.049119 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.049103 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:59:24.321289 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.321208 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sbd75"] Sep 18 23:59:24.322235 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.322212 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hdpmx"] Sep 18 23:59:24.325016 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:24.324990 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842a810a_8527_41e6_9d16_b6abb2cb9fbb.slice/crio-38de9db05ac28525e483d2a1e2132f390a4204a35c5a06dd65068bb26d7ff6cb WatchSource:0}: Error finding container 38de9db05ac28525e483d2a1e2132f390a4204a35c5a06dd65068bb26d7ff6cb: Status 404 returned error can't find the container with id 38de9db05ac28525e483d2a1e2132f390a4204a35c5a06dd65068bb26d7ff6cb Sep 18 23:59:24.325632 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:24.325523 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9dc933_a79e_4c05_82ec_60c15d90c5ad.slice/crio-9a8e569438b4ed9898106bce6d151cf93564d97394314b76b09e5fbd1a25577f WatchSource:0}: Error finding container 9a8e569438b4ed9898106bce6d151cf93564d97394314b76b09e5fbd1a25577f: Status 404 returned error can't find the container with id 9a8e569438b4ed9898106bce6d151cf93564d97394314b76b09e5fbd1a25577f Sep 18 23:59:24.404652 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.404629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:59:24.404745 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.404687 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:59:24.404745 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.404729 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:59:24.406803 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.406783 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"image-registry-75b98f4cf5-gw47b\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:59:24.407040 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.407017 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7990ba17-27bf-493d-bbc7-b7632abd0a55-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xzltp\" (UID: \"7990ba17-27bf-493d-bbc7-b7632abd0a55\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:59:24.407087 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.407054 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eff01b5f-b50c-486f-a499-0c17ff65babf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bqz6h\" (UID: \"eff01b5f-b50c-486f-a499-0c17ff65babf\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:59:24.472958 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.472920 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hsq9l" event={"ID":"7666a16c-bef5-4d6f-9984-768b7d1a0a9d","Type":"ContainerStarted","Data":"0cd8cfa2fad3dbfbe0e78a28f84e2f11407752fb7da2f83a3b5000e3a12a274f"} Sep 18 23:59:24.474386 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.474367 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sbd75" event={"ID":"6c9dc933-a79e-4c05-82ec-60c15d90c5ad","Type":"ContainerStarted","Data":"2d4ba597c14b9f0246d30effdf7c71aed7ce4aca21ee35fadfd6c7ecb1f06d90"} Sep 18 23:59:24.474471 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.474401 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sbd75" event={"ID":"6c9dc933-a79e-4c05-82ec-60c15d90c5ad","Type":"ContainerStarted","Data":"9a8e569438b4ed9898106bce6d151cf93564d97394314b76b09e5fbd1a25577f"} Sep 18 23:59:24.474471 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.474420 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:59:24.475478 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.475461 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hdpmx" event={"ID":"842a810a-8527-41e6-9d16-b6abb2cb9fbb","Type":"ContainerStarted","Data":"38de9db05ac28525e483d2a1e2132f390a4204a35c5a06dd65068bb26d7ff6cb"} Sep 18 23:59:24.488189 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.488146 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sbd75" podStartSLOduration=66.488133474 podStartE2EDuration="1m6.488133474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:24.487359268 +0000 UTC m=+66.906083678" watchObservedRunningTime="2026-09-18 23:59:24.488133474 +0000 UTC m=+66.906857872" Sep 18 23:59:24.505678 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.505657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:24.505749 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.505685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:59:24.505749 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.505727 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:24.506289 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.506272 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53e9c2c3-7159-405c-9078-11e083b84d16-service-ca-bundle\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:24.508094 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.508071 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b1f30b8-b607-494a-9894-c7cc4817b64d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jvm6m\" (UID: \"6b1f30b8-b607-494a-9894-c7cc4817b64d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:59:24.508161 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.508071 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53e9c2c3-7159-405c-9078-11e083b84d16-metrics-certs\") pod \"router-default-69bdf69d78-p2kl4\" (UID: \"53e9c2c3-7159-405c-9078-11e083b84d16\") " pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:24.590032 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.589958 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rh2f4\"" Sep 18 23:59:24.597314 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.597290 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" Sep 18 23:59:24.606405 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.606379 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:59:24.608902 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.608871 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/244cbdac-c648-406b-aa72-775b79b10756-metrics-tls\") pod \"dns-default-bvxsk\" (UID: \"244cbdac-c648-406b-aa72-775b79b10756\") " pod="openshift-dns/dns-default-bvxsk" Sep 18 23:59:24.665458 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.665410 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8qxt\"" Sep 18 23:59:24.665599 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.665495 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-p4hlt\"" Sep 18 23:59:24.670424 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.670406 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:59:24.674853 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.674830 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" Sep 18 23:59:24.690432 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.690241 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d67kv\"" Sep 18 23:59:24.698380 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.698358 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:24.725794 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.725762 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-48j4f\"" Sep 18 23:59:24.736172 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.734036 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" Sep 18 23:59:24.748768 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.747146 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ljxt7\"" Sep 18 23:59:24.755504 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.755471 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bvxsk" Sep 18 23:59:24.873176 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.873152 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp"] Sep 18 23:59:24.960271 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.960241 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h"] Sep 18 23:59:24.963739 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.963714 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75b98f4cf5-gw47b"] Sep 18 23:59:24.997478 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:24.997426 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69bdf69d78-p2kl4"] Sep 18 23:59:25.038031 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.037843 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m"] Sep 18 23:59:25.063068 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.063042 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bvxsk"] Sep 18 23:59:25.086606 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:25.086577 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1f30b8_b607_494a_9894_c7cc4817b64d.slice/crio-af36dc95ce112928b5e64cd357d7f22887a5dd8a851a86cc3710a27081f2e94a WatchSource:0}: Error finding container af36dc95ce112928b5e64cd357d7f22887a5dd8a851a86cc3710a27081f2e94a: Status 404 returned error can't find the container with id af36dc95ce112928b5e64cd357d7f22887a5dd8a851a86cc3710a27081f2e94a Sep 18 23:59:25.087343 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:25.087267 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244cbdac_c648_406b_aa72_775b79b10756.slice/crio-33ff7808addd72fa0c842b227799fa99760ba76f63efe13a81a04f1b653a5d8e WatchSource:0}: Error finding container 33ff7808addd72fa0c842b227799fa99760ba76f63efe13a81a04f1b653a5d8e: Status 404 returned error can't find the container with id 33ff7808addd72fa0c842b227799fa99760ba76f63efe13a81a04f1b653a5d8e Sep 18 23:59:25.088320 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:25.088282 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b086dd8_58e6_4da9_abdd_bd1ed42b64da.slice/crio-1da5a393d2fea1bc6459503bbe91370b76643a54b5328fe334825a6b48adcb1a WatchSource:0}: Error finding container 1da5a393d2fea1bc6459503bbe91370b76643a54b5328fe334825a6b48adcb1a: Status 404 returned error can't find the container with id 1da5a393d2fea1bc6459503bbe91370b76643a54b5328fe334825a6b48adcb1a Sep 18 23:59:25.089711 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:25.089658 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff01b5f_b50c_486f_a499_0c17ff65babf.slice/crio-80b2916d1178ad5e57c0989d3323e6b43872f2ef2804dde9202568b1611057d1 WatchSource:0}: Error finding container 80b2916d1178ad5e57c0989d3323e6b43872f2ef2804dde9202568b1611057d1: Status 404 returned error can't find the container with id 80b2916d1178ad5e57c0989d3323e6b43872f2ef2804dde9202568b1611057d1 Sep 18 23:59:25.091347 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:25.091265 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e9c2c3_7159_405c_9078_11e083b84d16.slice/crio-9abe87e50f6c9cc9de1fe8a85077e70522ccc6ffa1babfc3dbf579b9bb944fc6 WatchSource:0}: Error finding container 9abe87e50f6c9cc9de1fe8a85077e70522ccc6ffa1babfc3dbf579b9bb944fc6: Status 404 returned error can't find the container with id 9abe87e50f6c9cc9de1fe8a85077e70522ccc6ffa1babfc3dbf579b9bb944fc6 Sep 18 23:59:25.482330 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.482248 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" event={"ID":"eff01b5f-b50c-486f-a499-0c17ff65babf","Type":"ContainerStarted","Data":"80b2916d1178ad5e57c0989d3323e6b43872f2ef2804dde9202568b1611057d1"} Sep 18 23:59:25.485243 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.484928 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" event={"ID":"5b086dd8-58e6-4da9-abdd-bd1ed42b64da","Type":"ContainerStarted","Data":"a3234fa3cf32510d9b9786bc5fc99606e534543f0311aedc8f34a5459797c973"} Sep 18 23:59:25.485243 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.484988 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" event={"ID":"5b086dd8-58e6-4da9-abdd-bd1ed42b64da","Type":"ContainerStarted","Data":"1da5a393d2fea1bc6459503bbe91370b76643a54b5328fe334825a6b48adcb1a"} Sep 18 23:59:25.485243 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.485027 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:59:25.487472 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.487442 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hsq9l" event={"ID":"7666a16c-bef5-4d6f-9984-768b7d1a0a9d","Type":"ContainerStarted","Data":"96db56b2b395e82e8419634860b13582420ecc8182a6ead00d82ba20e014a904"} Sep 18 23:59:25.487593 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.487500 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hsq9l" event={"ID":"7666a16c-bef5-4d6f-9984-768b7d1a0a9d","Type":"ContainerStarted","Data":"fa2875b47ea51bb2a113f7de2f507b89e5b3a76f5b9642e15d7bdd937a5d0a53"} Sep 18 23:59:25.489427 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.489389 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" event={"ID":"53e9c2c3-7159-405c-9078-11e083b84d16","Type":"ContainerStarted","Data":"5eb6bd12667c3ccea28d2ecc793aefec306af1129ec319f628d7d8ac5c5d7412"} Sep 18 23:59:25.489532 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.489429 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" event={"ID":"53e9c2c3-7159-405c-9078-11e083b84d16","Type":"ContainerStarted","Data":"9abe87e50f6c9cc9de1fe8a85077e70522ccc6ffa1babfc3dbf579b9bb944fc6"} Sep 18 23:59:25.491076 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.491046 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bvxsk" event={"ID":"244cbdac-c648-406b-aa72-775b79b10756","Type":"ContainerStarted","Data":"33ff7808addd72fa0c842b227799fa99760ba76f63efe13a81a04f1b653a5d8e"} Sep 18 23:59:25.493447 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.493394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" event={"ID":"6b1f30b8-b607-494a-9894-c7cc4817b64d","Type":"ContainerStarted","Data":"af36dc95ce112928b5e64cd357d7f22887a5dd8a851a86cc3710a27081f2e94a"} Sep 18 23:59:25.494838 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.494771 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" event={"ID":"7990ba17-27bf-493d-bbc7-b7632abd0a55","Type":"ContainerStarted","Data":"9bd290354d81b41d326cb6a3595b6c8b68a30fbb88e28b01a242f3c59ae67e50"} Sep 18 23:59:25.509941 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.508796 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" podStartSLOduration=67.508779286 podStartE2EDuration="1m7.508779286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:25.507971417 +0000 UTC m=+67.926695826" watchObservedRunningTime="2026-09-18 23:59:25.508779286 +0000 UTC m=+67.927503696" Sep 18 23:59:25.535908 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.534335 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" podStartSLOduration=55.534316897 podStartE2EDuration="55.534316897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:25.533954653 +0000 UTC m=+67.952679062" watchObservedRunningTime="2026-09-18 23:59:25.534316897 +0000 UTC m=+67.953041307" Sep 18 23:59:25.560615 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.560304 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hsq9l" podStartSLOduration=66.486815009 podStartE2EDuration="1m7.560283212s" totalImagesPullingTime="1.073468203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:25.558434905 +0000 UTC m=+67.977159337" watchObservedRunningTime="2026-09-18 23:59:25.560283212 +0000 UTC m=+67.979007621" Sep 18 23:59:25.699357 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.699245 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:25.702244 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.702036 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:25.732437 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.732333 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:25.804296 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.804188 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:25.903363 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:25.903256 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:26.003244 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:26.003100 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:26.503010 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:26.502960 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:26.505131 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:26.504946 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69bdf69d78-p2kl4" Sep 18 23:59:27.507538 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:27.507502 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" event={"ID":"6b1f30b8-b607-494a-9894-c7cc4817b64d","Type":"ContainerStarted","Data":"7c92a0e64b346c530d3b7b63b9b952721b25f77bc5589c6575690b9928ab68ee"} Sep 18 23:59:27.523163 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:27.523109 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jvm6m" podStartSLOduration=37.028044578 podStartE2EDuration="38.523086539s" totalImagesPullingTime="1.495041961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:27.52288184 +0000 UTC m=+69.941606250" watchObservedRunningTime="2026-09-18 23:59:27.523086539 +0000 UTC m=+69.941810949" Sep 18 23:59:27.646464 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:27.646429 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:27.699301 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:27.699270 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:28.721420 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:28.721367 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:28.774429 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:28.774345 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:29.459630 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:29.459590 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:29.557738 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:29.557703 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:30.344869 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.344805 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:30.447076 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.447033 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:30.507052 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.507013 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:30.507212 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.507196 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh"] Sep 18 23:59:30.520450 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.520426 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh"] Sep 18 23:59:30.520573 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.520532 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" Sep 18 23:59:30.522952 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.522926 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 23:59:30.523074 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.522973 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gtn79\"" Sep 18 23:59:30.523601 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.523573 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bvxsk" event={"ID":"244cbdac-c648-406b-aa72-775b79b10756","Type":"ContainerStarted","Data":"99a55407991124a3d080676360699a256ea79079807d660a5e1562b116b11c71"} Sep 18 23:59:30.523711 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.523625 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bvxsk" event={"ID":"244cbdac-c648-406b-aa72-775b79b10756","Type":"ContainerStarted","Data":"c6d9ff7b30b3ca34c1f7a79bf658962286b048ac1e8e0b43be330534bf68204e"} Sep 18 23:59:30.523711 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.523656 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bvxsk" Sep 18 23:59:30.525804 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.525747 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" event={"ID":"7990ba17-27bf-493d-bbc7-b7632abd0a55","Type":"ContainerStarted","Data":"8c1e5c7cec5d7f31c2b4ea76bccdbb950b03b69bb1b15c46bd905abaf89ced43"} Sep 18 23:59:30.525804 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.525794 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" event={"ID":"7990ba17-27bf-493d-bbc7-b7632abd0a55","Type":"ContainerStarted","Data":"84f8f21fe2ba396d57b807ae5c606541c097760cedeeaa453263d52e6d0022c1"} Sep 18 23:59:30.527391 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.527367 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hdpmx" event={"ID":"842a810a-8527-41e6-9d16-b6abb2cb9fbb","Type":"ContainerStarted","Data":"8f927009304a5150031aa364af50f574c0992864cf80e2581a008a347e3605c6"} Sep 18 23:59:30.529346 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.529322 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" event={"ID":"eff01b5f-b50c-486f-a499-0c17ff65babf","Type":"ContainerStarted","Data":"80354d22cd24b89669aada9e73513e2c0e7bf460b47ee1ac1d5c523f5c8f2222"} Sep 18 23:59:30.550543 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.550459 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bvxsk" podStartSLOduration=33.664222243 podStartE2EDuration="38.550441313s" totalImagesPullingTime="4.88621907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:30.548257739 +0000 UTC m=+72.966982184" watchObservedRunningTime="2026-09-18 23:59:30.550441313 +0000 UTC m=+72.969165722" Sep 18 23:59:30.568323 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.568281 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xzltp" podStartSLOduration=55.732564223 podStartE2EDuration="1m0.568267021s" totalImagesPullingTime="4.835702798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:30.567319316 +0000 UTC m=+72.986043735" watchObservedRunningTime="2026-09-18 23:59:30.568267021 +0000 UTC m=+72.986991429" Sep 18 23:59:30.581694 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.581648 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bqz6h" podStartSLOduration=55.698106694 podStartE2EDuration="1m0.581637211s" totalImagesPullingTime="4.883530517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:30.581119597 +0000 UTC m=+72.999844008" watchObservedRunningTime="2026-09-18 23:59:30.581637211 +0000 UTC m=+73.000361619" Sep 18 23:59:30.594961 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.594913 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hdpmx" podStartSLOduration=65.933045728 podStartE2EDuration="1m11.594876613s" totalImagesPullingTime="5.661830885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 23:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:30.593817642 +0000 UTC m=+73.012542050" watchObservedRunningTime="2026-09-18 23:59:30.594876613 +0000 UTC m=+73.013601020" Sep 18 23:59:30.659293 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.659258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a20550a4-f032-4ccc-905c-8e161e586f3a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-rq7wh\" (UID: \"a20550a4-f032-4ccc-905c-8e161e586f3a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" Sep 18 23:59:30.760419 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.760379 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a20550a4-f032-4ccc-905c-8e161e586f3a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-rq7wh\" (UID: \"a20550a4-f032-4ccc-905c-8e161e586f3a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" Sep 18 23:59:30.760568 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:30.760526 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 18 23:59:30.760608 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:30.760592 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a20550a4-f032-4ccc-905c-8e161e586f3a-tls-certificates podName:a20550a4-f032-4ccc-905c-8e161e586f3a nodeName:}" failed. No retries permitted until 2026-09-18 23:59:31.26057644 +0000 UTC m=+73.679300826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a20550a4-f032-4ccc-905c-8e161e586f3a-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" (UID: "a20550a4-f032-4ccc-905c-8e161e586f3a") : secret "prometheus-operator-admission-webhook-tls" not found Sep 18 23:59:30.814205 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:30.814123 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:31.263828 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:31.263778 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a20550a4-f032-4ccc-905c-8e161e586f3a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-rq7wh\" (UID: \"a20550a4-f032-4ccc-905c-8e161e586f3a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" Sep 18 23:59:31.266329 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:31.266303 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a20550a4-f032-4ccc-905c-8e161e586f3a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-rq7wh\" (UID: \"a20550a4-f032-4ccc-905c-8e161e586f3a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" Sep 18 23:59:31.432441 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:31.432402 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" Sep 18 23:59:31.728909 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:31.728864 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh"] Sep 18 23:59:31.733373 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:31.733347 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20550a4_f032_4ccc_905c_8e161e586f3a.slice/crio-538b6adedd459e2d10241dd3256ca1e0a2af43323eb12fefedc9fd8ad40729bd WatchSource:0}: Error finding container 538b6adedd459e2d10241dd3256ca1e0a2af43323eb12fefedc9fd8ad40729bd: Status 404 returned error can't find the container with id 538b6adedd459e2d10241dd3256ca1e0a2af43323eb12fefedc9fd8ad40729bd Sep 18 23:59:31.757148 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:31.757119 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:31.810163 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:31.810138 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:32.539117 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:32.539013 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" event={"ID":"a20550a4-f032-4ccc-905c-8e161e586f3a","Type":"ContainerStarted","Data":"538b6adedd459e2d10241dd3256ca1e0a2af43323eb12fefedc9fd8ad40729bd"} Sep 18 23:59:33.544750 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:33.544716 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" event={"ID":"a20550a4-f032-4ccc-905c-8e161e586f3a","Type":"ContainerStarted","Data":"19cf2076d58488cd4c2b1d5f6c89363de41231f334d2af89050744cc1d1c6afc"} Sep 18 23:59:33.545163 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:33.545045 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" Sep 18 23:59:33.549598 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:33.549572 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" Sep 18 23:59:33.558557 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:33.558467 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-rq7wh" podStartSLOduration=1.989319246 podStartE2EDuration="3.558450511s" totalImagesPullingTime="1.569131265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:33.558355165 +0000 UTC m=+75.977079574" watchObservedRunningTime="2026-09-18 23:59:33.558450511 +0000 UTC m=+75.977174919" Sep 18 23:59:34.530447 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:34.530415 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:34.589732 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:34.589682 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:34.820164 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:34.820068 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:35.646278 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:35.646246 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:35.738458 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:35.738425 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:37.467562 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:37.467527 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:37.595931 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:37.595901 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:37.648858 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:37.648833 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:37.704262 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:37.704236 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:37.814971 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:37.814876 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:38.017704 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:38.017670 2568 scope.go:117] "RemoveContainer" containerID="edf9dfa54379f0f6344a21cb313902989e586250ca793ea1f1a83e968e49df9e" Sep 18 23:59:38.017899 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:38.017861 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-qgd4d_openshift-console-operator(082a8d06-c6bc-495e-b0d8-c026a33cbddb)\"" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" podUID="082a8d06-c6bc-495e-b0d8-c026a33cbddb" Sep 18 23:59:38.177365 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:38.177321 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:38.230112 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:38.230082 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:39.685260 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.685226 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:39.870459 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.870426 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:39.887654 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.887627 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m"] Sep 18 23:59:39.891429 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.891402 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:39.894556 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.894535 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 23:59:39.894683 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.894540 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hjw75\"" Sep 18 23:59:39.895100 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.895083 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 23:59:39.895647 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.895630 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 23:59:39.901528 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.901509 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m"] Sep 18 23:59:39.916066 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.916040 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qbprl"] Sep 18 23:59:39.918722 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.918704 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:39.921119 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.921098 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 23:59:39.921224 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.921135 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v4xfs\"" Sep 18 23:59:39.921488 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.921472 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 23:59:39.921535 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.921511 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 23:59:39.953680 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:39.953613 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.025794 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.025767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-sys\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.025794 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.025799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-tls\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.026007 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.025829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.026007 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.025857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46n6w\" (UniqueName: \"kubernetes.io/projected/21b5a120-7c58-4125-826e-603b98e9b2bd-kube-api-access-46n6w\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.026007 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.025938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95331bf5-3ba5-4f22-898f-18d5ce809037-metrics-client-ca\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.026007 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.025956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd7ww\" (UniqueName: \"kubernetes.io/projected/95331bf5-3ba5-4f22-898f-18d5ce809037-kube-api-access-cd7ww\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.026007 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.025977 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21b5a120-7c58-4125-826e-603b98e9b2bd-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.026007 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.026004 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.026206 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.026024 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-root\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.026206 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.026045 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-wtmp\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.026206 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.026067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-textfile\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.026206 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.026097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.026206 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.026114 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-accelerators-collector-config\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.068227 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.068196 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.126677 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.126641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.126846 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.126690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-accelerators-collector-config\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.126846 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.126736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-sys\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.126846 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.126768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-tls\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.126846 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.126821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.127097 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.126848 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46n6w\" (UniqueName: \"kubernetes.io/projected/21b5a120-7c58-4125-826e-603b98e9b2bd-kube-api-access-46n6w\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.127097 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.126851 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-sys\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127097 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:40.126923 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 23:59:40.127097 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:40.126992 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-tls podName:95331bf5-3ba5-4f22-898f-18d5ce809037 nodeName:}" failed. No retries permitted until 2026-09-18 23:59:40.626971009 +0000 UTC m=+83.045695413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-tls") pod "node-exporter-qbprl" (UID: "95331bf5-3ba5-4f22-898f-18d5ce809037") : secret "node-exporter-tls" not found Sep 18 23:59:40.127316 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.126924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95331bf5-3ba5-4f22-898f-18d5ce809037-metrics-client-ca\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127316 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127160 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd7ww\" (UniqueName: \"kubernetes.io/projected/95331bf5-3ba5-4f22-898f-18d5ce809037-kube-api-access-cd7ww\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127316 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21b5a120-7c58-4125-826e-603b98e9b2bd-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.127316 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.127316 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-root\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127316 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-wtmp\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127613 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-textfile\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127613 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:40.127329 2568 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 23:59:40.127613 ip-10-0-141-42 kubenswrapper[2568]: E0918 23:59:40.127410 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-tls podName:21b5a120-7c58-4125-826e-603b98e9b2bd nodeName:}" failed. No retries permitted until 2026-09-18 23:59:40.627388593 +0000 UTC m=+83.046112994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-5k66m" (UID: "21b5a120-7c58-4125-826e-603b98e9b2bd") : secret "openshift-state-metrics-tls" not found Sep 18 23:59:40.127613 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127511 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-accelerators-collector-config\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127613 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127574 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-root\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127872 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127659 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-wtmp\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.127872 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127857 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-textfile\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.128002 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.127960 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21b5a120-7c58-4125-826e-603b98e9b2bd-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.128167 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.128146 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95331bf5-3ba5-4f22-898f-18d5ce809037-metrics-client-ca\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.129545 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.129515 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.130054 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.130027 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.137568 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.137540 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd7ww\" (UniqueName: \"kubernetes.io/projected/95331bf5-3ba5-4f22-898f-18d5ce809037-kube-api-access-cd7ww\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.137672 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.137575 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46n6w\" (UniqueName: \"kubernetes.io/projected/21b5a120-7c58-4125-826e-603b98e9b2bd-kube-api-access-46n6w\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.168774 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.168747 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.273765 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.273692 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.379456 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.379422 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.515600 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.515574 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.535604 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.535540 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bvxsk" Sep 18 23:59:40.631836 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.631803 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-tls\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.631998 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.631855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.634229 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.634200 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95331bf5-3ba5-4f22-898f-18d5ce809037-node-exporter-tls\") pod \"node-exporter-qbprl\" (UID: \"95331bf5-3ba5-4f22-898f-18d5ce809037\") " pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.634353 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.634277 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/21b5a120-7c58-4125-826e-603b98e9b2bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-5k66m\" (UID: \"21b5a120-7c58-4125-826e-603b98e9b2bd\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.639178 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.639156 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.740213 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.740182 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.801849 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.801716 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" Sep 18 23:59:40.827099 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.827073 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qbprl" Sep 18 23:59:40.837781 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:40.837756 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95331bf5_3ba5_4f22_898f_18d5ce809037.slice/crio-cd64f7ff923645d679d7926994a58f90ea8d32b2c471134cce289d50a2a9e44b WatchSource:0}: Error finding container cd64f7ff923645d679d7926994a58f90ea8d32b2c471134cce289d50a2a9e44b: Status 404 returned error can't find the container with id cd64f7ff923645d679d7926994a58f90ea8d32b2c471134cce289d50a2a9e44b Sep 18 23:59:40.844270 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.844233 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:40.944324 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:40.944287 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:41.007135 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:41.007101 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:41.075143 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:41.075120 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m"] Sep 18 23:59:41.077082 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:41.077056 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b5a120_7c58_4125_826e_603b98e9b2bd.slice/crio-587874c4ccbcafdc6a0469ed9535c401bed40e7610ee13c59b254f6c2495b64c WatchSource:0}: Error finding container 587874c4ccbcafdc6a0469ed9535c401bed40e7610ee13c59b254f6c2495b64c: Status 404 returned error can't find the container with id 587874c4ccbcafdc6a0469ed9535c401bed40e7610ee13c59b254f6c2495b64c Sep 18 23:59:41.496094 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:41.496029 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:41.579335 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:41.579299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" event={"ID":"21b5a120-7c58-4125-826e-603b98e9b2bd","Type":"ContainerStarted","Data":"b466d1f5944485628827d0900c56e161db380c7bfab6b25c828442b8239c2709"} Sep 18 23:59:41.579521 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:41.579370 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" event={"ID":"21b5a120-7c58-4125-826e-603b98e9b2bd","Type":"ContainerStarted","Data":"623a533e7b7706c27d8bfb58c9f9395900f8ac4f6c3f9a9d9ac4953e83cd23c5"} Sep 18 23:59:41.579521 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:41.579403 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" event={"ID":"21b5a120-7c58-4125-826e-603b98e9b2bd","Type":"ContainerStarted","Data":"587874c4ccbcafdc6a0469ed9535c401bed40e7610ee13c59b254f6c2495b64c"} Sep 18 23:59:41.580749 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:41.580713 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qbprl" event={"ID":"95331bf5-3ba5-4f22-898f-18d5ce809037","Type":"ContainerStarted","Data":"cd64f7ff923645d679d7926994a58f90ea8d32b2c471134cce289d50a2a9e44b"} Sep 18 23:59:42.586991 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.586952 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" event={"ID":"21b5a120-7c58-4125-826e-603b98e9b2bd","Type":"ContainerStarted","Data":"3098de26d46cfb1ae5e1284185f4bd2c17587f78ab64221a62cd1a2f0f291976"} Sep 18 23:59:42.588533 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.588506 2568 generic.go:356] "Generic (PLEG): container finished" podID="95331bf5-3ba5-4f22-898f-18d5ce809037" containerID="367c905eae47c02854a31e88d753342ed8069fa6e03f08ac30d8969ed0163b9c" exitCode=0 Sep 18 23:59:42.588651 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.588544 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qbprl" event={"ID":"95331bf5-3ba5-4f22-898f-18d5ce809037","Type":"ContainerDied","Data":"367c905eae47c02854a31e88d753342ed8069fa6e03f08ac30d8969ed0163b9c"} Sep 18 23:59:42.603722 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.603678 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-5k66m" podStartSLOduration=2.682575818 podStartE2EDuration="3.603663603s" totalImagesPullingTime="921.087785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:42.602594654 +0000 UTC m=+85.021319086" watchObservedRunningTime="2026-09-18 23:59:42.603663603 +0000 UTC m=+85.022388011" Sep 18 23:59:42.816527 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.816495 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:42.878296 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.878262 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:42.881917 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.881877 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg"] Sep 18 23:59:42.884732 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.884716 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:42.887250 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.887229 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 23:59:42.887366 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.887253 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 23:59:42.887366 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.887261 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 23:59:42.887366 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.887285 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jfz8f\"" Sep 18 23:59:42.887366 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.887298 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 23:59:42.887366 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.887328 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-51jarucqsjlb0\"" Sep 18 23:59:42.887725 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.887701 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 23:59:42.897167 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:42.897149 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg"] Sep 18 23:59:43.053283 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.053249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b8gt\" (UniqueName: \"kubernetes.io/projected/ed536d74-1b8b-49cd-a7be-1115ca705a26-kube-api-access-8b8gt\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.053454 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.053299 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.053454 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.053325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-tls\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.053454 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.053379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.053454 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.053420 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.053454 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.053447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-grpc-tls\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.053678 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.053464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed536d74-1b8b-49cd-a7be-1115ca705a26-metrics-client-ca\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.053678 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.053558 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.089225 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.089197 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:43.154731 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.154647 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-grpc-tls\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.154731 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.154684 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed536d74-1b8b-49cd-a7be-1115ca705a26-metrics-client-ca\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.154731 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.154717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.154731 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.154735 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b8gt\" (UniqueName: \"kubernetes.io/projected/ed536d74-1b8b-49cd-a7be-1115ca705a26-kube-api-access-8b8gt\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.155083 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.154771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.155083 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.154797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-tls\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.155083 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.154819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.155083 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.154874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.155559 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.155529 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed536d74-1b8b-49cd-a7be-1115ca705a26-metrics-client-ca\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.157644 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.157432 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.157644 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.157589 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-tls\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.157820 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.157697 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.157873 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.157835 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.157873 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.157850 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.158054 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.157992 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed536d74-1b8b-49cd-a7be-1115ca705a26-secret-grpc-tls\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.162459 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.162438 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b8gt\" (UniqueName: \"kubernetes.io/projected/ed536d74-1b8b-49cd-a7be-1115ca705a26-kube-api-access-8b8gt\") pod \"thanos-querier-5f554b7cd8-zjxvg\" (UID: \"ed536d74-1b8b-49cd-a7be-1115ca705a26\") " pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.193867 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.193833 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:43.346356 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.346304 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:43.467395 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.467371 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg"] Sep 18 23:59:43.469482 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:43.469452 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded536d74_1b8b_49cd_a7be_1115ca705a26.slice/crio-f8a0246b03dade0caedf63b0732c556c4b83d44146b9e9e3e870030ead6e639f WatchSource:0}: Error finding container f8a0246b03dade0caedf63b0732c556c4b83d44146b9e9e3e870030ead6e639f: Status 404 returned error can't find the container with id f8a0246b03dade0caedf63b0732c556c4b83d44146b9e9e3e870030ead6e639f Sep 18 23:59:43.594277 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.594241 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" event={"ID":"ed536d74-1b8b-49cd-a7be-1115ca705a26","Type":"ContainerStarted","Data":"f8a0246b03dade0caedf63b0732c556c4b83d44146b9e9e3e870030ead6e639f"} Sep 18 23:59:43.596544 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.596515 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qbprl" event={"ID":"95331bf5-3ba5-4f22-898f-18d5ce809037","Type":"ContainerStarted","Data":"e561784408424dfd9ab85819d1cd0635fa9712ec03517f518da06d0f8ada6a65"} Sep 18 23:59:43.596664 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.596573 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qbprl" event={"ID":"95331bf5-3ba5-4f22-898f-18d5ce809037","Type":"ContainerStarted","Data":"07293e0f507daa4479432c988e4de441c61e92574c38cf1fc76400493ef513dd"} Sep 18 23:59:43.613580 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:43.613532 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qbprl" podStartSLOduration=3.621277909 podStartE2EDuration="4.613517802s" totalImagesPullingTime="920.198855ms" totalInitContainerRuntime="72.041038ms" isStatefulPod=true podCreationTimestamp="2026-09-18 23:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:43.612181198 +0000 UTC m=+86.030905602" watchObservedRunningTime="2026-09-18 23:59:43.613517802 +0000 UTC m=+86.032242210" Sep 18 23:59:44.202362 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.202325 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6759d9fdf6-mrrd6"] Sep 18 23:59:44.204635 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.204611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.208507 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.208485 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x9d6v\"" Sep 18 23:59:44.208507 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.208498 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 23:59:44.208687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.208512 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 23:59:44.208687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.208553 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 23:59:44.208687 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.208496 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dhbjldqrvh514\"" Sep 18 23:59:44.208882 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.208852 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 23:59:44.218981 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.218959 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6759d9fdf6-mrrd6"] Sep 18 23:59:44.363914 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.363860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqqzf\" (UniqueName: \"kubernetes.io/projected/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-kube-api-access-qqqzf\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.364110 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.363955 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-secret-metrics-server-client-certs\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.364110 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.363985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-audit-log\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.364110 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.364012 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-client-ca-bundle\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.364110 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.364036 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-secret-metrics-server-tls\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.364110 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.364058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-metrics-server-audit-profiles\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.364299 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.364129 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.465570 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.465478 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqqzf\" (UniqueName: \"kubernetes.io/projected/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-kube-api-access-qqqzf\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.465570 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.465553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-secret-metrics-server-client-certs\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.465788 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.465580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-audit-log\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.465788 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.465610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-client-ca-bundle\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.465788 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.465637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-secret-metrics-server-tls\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.465788 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.465665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-metrics-server-audit-profiles\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.465788 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.465711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.466883 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.466079 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-audit-log\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.466883 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.466581 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.466883 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.466827 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-metrics-server-audit-profiles\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.468540 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.468518 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-secret-metrics-server-client-certs\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.468764 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.468738 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-secret-metrics-server-tls\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.468833 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.468756 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-client-ca-bundle\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.473446 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.473425 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqqzf\" (UniqueName: \"kubernetes.io/projected/2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c-kube-api-access-qqqzf\") pod \"metrics-server-6759d9fdf6-mrrd6\" (UID: \"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c\") " pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.517258 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.517229 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 18 23:59:44.672197 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.672166 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8"] Sep 18 23:59:44.674771 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.674750 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:44.675840 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.675817 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:44.676985 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.676966 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 23:59:44.677049 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.677027 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-slptv\"" Sep 18 23:59:44.682458 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.682438 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8"] Sep 18 23:59:44.768612 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.768497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfkgl\" (UniqueName: \"kubernetes.io/projected/61d81069-e95b-4226-a4f4-e1f2f5e91a6d-kube-api-access-pfkgl\") pod \"monitoring-plugin-5984459ff8-w5fn8\" (UID: \"61d81069-e95b-4226-a4f4-e1f2f5e91a6d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:44.768742 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.768624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61d81069-e95b-4226-a4f4-e1f2f5e91a6d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-w5fn8\" (UID: \"61d81069-e95b-4226-a4f4-e1f2f5e91a6d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:44.786313 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.786288 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6759d9fdf6-mrrd6"] Sep 18 23:59:44.796250 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.796221 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:44.869452 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.869419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkgl\" (UniqueName: \"kubernetes.io/projected/61d81069-e95b-4226-a4f4-e1f2f5e91a6d-kube-api-access-pfkgl\") pod \"monitoring-plugin-5984459ff8-w5fn8\" (UID: \"61d81069-e95b-4226-a4f4-e1f2f5e91a6d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:44.869623 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.869475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61d81069-e95b-4226-a4f4-e1f2f5e91a6d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-w5fn8\" (UID: \"61d81069-e95b-4226-a4f4-e1f2f5e91a6d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:44.872265 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.872230 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61d81069-e95b-4226-a4f4-e1f2f5e91a6d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-w5fn8\" (UID: \"61d81069-e95b-4226-a4f4-e1f2f5e91a6d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:44.877233 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.877206 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfkgl\" (UniqueName: \"kubernetes.io/projected/61d81069-e95b-4226-a4f4-e1f2f5e91a6d-kube-api-access-pfkgl\") pod \"monitoring-plugin-5984459ff8-w5fn8\" (UID: \"61d81069-e95b-4226-a4f4-e1f2f5e91a6d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:44.985258 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:44.985225 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:45.257070 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:45.257039 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8199f2_f45d_4dbb_8bd3_515dd4cbca4c.slice/crio-5ef47628c23534c3c436df0f74038c9d2810b7f3d6c0beb9d0dc23da98d44de3 WatchSource:0}: Error finding container 5ef47628c23534c3c436df0f74038c9d2810b7f3d6c0beb9d0dc23da98d44de3: Status 404 returned error can't find the container with id 5ef47628c23534c3c436df0f74038c9d2810b7f3d6c0beb9d0dc23da98d44de3 Sep 18 23:59:45.528779 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:45.528750 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8"] Sep 18 23:59:45.530772 ip-10-0-141-42 kubenswrapper[2568]: W0918 23:59:45.530744 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d81069_e95b_4226_a4f4_e1f2f5e91a6d.slice/crio-782c572279f08314d03469831073ffb362278272393a87939159236493d12aff WatchSource:0}: Error finding container 782c572279f08314d03469831073ffb362278272393a87939159236493d12aff: Status 404 returned error can't find the container with id 782c572279f08314d03469831073ffb362278272393a87939159236493d12aff Sep 18 23:59:45.607041 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:45.607009 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" event={"ID":"ed536d74-1b8b-49cd-a7be-1115ca705a26","Type":"ContainerStarted","Data":"64a962481a0a396454b006866d8eb1a9d8d027288e717ef0f405eb7e997fbd36"} Sep 18 23:59:45.607184 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:45.607081 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" event={"ID":"ed536d74-1b8b-49cd-a7be-1115ca705a26","Type":"ContainerStarted","Data":"4f1001b878ed54b76e42ff3466fa3f1a1d69de4e6c76cb4e974adb54cb3c48d4"} Sep 18 23:59:45.607184 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:45.607121 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" event={"ID":"ed536d74-1b8b-49cd-a7be-1115ca705a26","Type":"ContainerStarted","Data":"990c885a04f8a6e6b91b7adca251ab37e50ea5383c01d66c346905cdb848f004"} Sep 18 23:59:45.608192 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:45.608157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" event={"ID":"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c","Type":"ContainerStarted","Data":"5ef47628c23534c3c436df0f74038c9d2810b7f3d6c0beb9d0dc23da98d44de3"} Sep 18 23:59:45.609307 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:45.609285 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" event={"ID":"61d81069-e95b-4226-a4f4-e1f2f5e91a6d","Type":"ContainerStarted","Data":"782c572279f08314d03469831073ffb362278272393a87939159236493d12aff"} Sep 18 23:59:46.086805 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:46.086776 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:46.507645 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:46.507619 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 18 23:59:46.740577 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:46.740543 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:46.793419 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:46.793336 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:47.621881 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.621838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" event={"ID":"ed536d74-1b8b-49cd-a7be-1115ca705a26","Type":"ContainerStarted","Data":"6db8f9d86d2c63a595c9829503d27fee73ad75928bf626a90a28ecdc3952e962"} Sep 18 23:59:47.622329 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.621963 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" event={"ID":"ed536d74-1b8b-49cd-a7be-1115ca705a26","Type":"ContainerStarted","Data":"4e02ec6dc5e75728010d5bd432406c86eccc80e871e0ec8c1d45883de9ca4cf2"} Sep 18 23:59:47.622329 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.622027 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:47.622329 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.622060 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" event={"ID":"ed536d74-1b8b-49cd-a7be-1115ca705a26","Type":"ContainerStarted","Data":"db0e1b558028498f90e6e49b20790632fc12fdeb4f39e2001412814f8564d1c1"} Sep 18 23:59:47.623490 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.623462 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" event={"ID":"2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c","Type":"ContainerStarted","Data":"9b6cfa35f1c835e57dfff90a967dcb6d1c47852f78bec0dee45773bcb8de34c6"} Sep 18 23:59:47.624905 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.624867 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" event={"ID":"61d81069-e95b-4226-a4f4-e1f2f5e91a6d","Type":"ContainerStarted","Data":"e64d60760a03aebca83dd4643380c73a6b425cc803a202247b0ad17d85ba4681"} Sep 18 23:59:47.625006 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.624990 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:47.630535 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.630503 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" Sep 18 23:59:47.644228 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.644187 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" podStartSLOduration=2.334749389 podStartE2EDuration="5.64417343s" totalImagesPullingTime="3.309424041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:47.642111552 +0000 UTC m=+90.060835961" watchObservedRunningTime="2026-09-18 23:59:47.64417343 +0000 UTC m=+90.062897838" Sep 18 23:59:47.656384 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.656332 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-w5fn8" podStartSLOduration=2.225301907 podStartE2EDuration="3.656316761s" totalImagesPullingTime="1.431014854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:47.655746202 +0000 UTC m=+90.074470610" watchObservedRunningTime="2026-09-18 23:59:47.656316761 +0000 UTC m=+90.075041169" Sep 18 23:59:47.676096 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:47.676041 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" podStartSLOduration=1.975549496 podStartE2EDuration="3.676021565s" totalImagesPullingTime="1.700472069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:47.67414402 +0000 UTC m=+90.092868432" watchObservedRunningTime="2026-09-18 23:59:47.676021565 +0000 UTC m=+90.094745976" Sep 18 23:59:48.507084 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:48.507049 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75b98f4cf5-gw47b"] Sep 18 23:59:48.573335 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:48.573305 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:48.740482 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:48.740451 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:48.790968 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:48.790878 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:49.762734 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:49.762697 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:49.863086 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:49.863053 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:50.643352 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:50.643318 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:50.745160 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:50.745127 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:52.017233 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.017204 2568 scope.go:117] "RemoveContainer" containerID="edf9dfa54379f0f6344a21cb313902989e586250ca793ea1f1a83e968e49df9e" Sep 18 23:59:52.649271 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.649244 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 18 23:59:52.649411 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.649308 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" event={"ID":"082a8d06-c6bc-495e-b0d8-c026a33cbddb","Type":"ContainerStarted","Data":"8057d95d8526b3742c5e52fb344f52f0661379992294828fc4387611cef979c8"} Sep 18 23:59:52.649586 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.649567 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:59:52.654155 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.654121 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" Sep 18 23:59:52.666381 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.666340 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-qgd4d" podStartSLOduration=75.163185468 podStartE2EDuration="1m22.666327164s" totalImagesPullingTime="7.503141696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 23:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 23:59:52.665109465 +0000 UTC m=+95.083833866" watchObservedRunningTime="2026-09-18 23:59:52.666327164 +0000 UTC m=+95.085051572" Sep 18 23:59:52.770278 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.770243 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:52.869233 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.869202 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:52.970050 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:52.969942 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:53.070301 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:53.070265 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:53.122048 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:53.121998 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:53.256939 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:53.256840 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:53.433762 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:53.433730 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:53.530531 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:53.530446 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:53.586276 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:53.586225 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:53.634991 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:53.634965 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f554b7cd8-zjxvg" Sep 18 23:59:54.637547 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:54.637517 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:54.715821 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:54.715784 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:54.837114 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:54.837054 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:55.260732 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:55.260696 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:55.497752 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:55.497726 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sbd75" Sep 18 23:59:56.103618 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:56.103586 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 18 23:59:56.155472 ip-10-0-141-42 kubenswrapper[2568]: I0918 23:59:56.155440 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:02.711160 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:02.711119 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:02.927182 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:02.927146 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:04.112109 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.112074 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d76d45b59-pxqxd"] Sep 19 00:00:04.160263 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.160229 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d76d45b59-pxqxd"] Sep 19 00:00:04.160410 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.160337 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.162826 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.162804 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 19 00:00:04.163169 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.163149 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 19 00:00:04.163261 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.163218 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 19 00:00:04.163317 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.163265 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 19 00:00:04.164106 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.164090 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 19 00:00:04.164184 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.164104 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jsngw\"" Sep 19 00:00:04.164420 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.164398 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 19 00:00:04.164511 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.164419 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 19 00:00:04.230254 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.230225 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-oauth-serving-cert\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.230254 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.230259 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6xq\" (UniqueName: \"kubernetes.io/projected/3dadd56b-1082-4205-af68-2606397eb577-kube-api-access-vt6xq\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.230430 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.230281 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-console-config\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.230430 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.230374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-oauth-config\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.230430 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.230410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-serving-cert\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.230553 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.230431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-service-ca\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.330884 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.330850 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-oauth-config\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.330884 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.330899 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-serving-cert\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.331099 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.330916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-service-ca\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.331099 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.330953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-oauth-serving-cert\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.331099 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.330972 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6xq\" (UniqueName: \"kubernetes.io/projected/3dadd56b-1082-4205-af68-2606397eb577-kube-api-access-vt6xq\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.331099 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.331006 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-console-config\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.331902 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.331854 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-oauth-serving-cert\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.331902 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.331878 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-service-ca\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.332072 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.331929 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-console-config\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.333488 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.333459 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-serving-cert\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.333488 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.333473 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-oauth-config\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.338445 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.338423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6xq\" (UniqueName: \"kubernetes.io/projected/3dadd56b-1082-4205-af68-2606397eb577-kube-api-access-vt6xq\") pod \"console-5d76d45b59-pxqxd\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.502386 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.502350 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:04.517997 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.517972 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 19 00:00:04.518118 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.518033 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 19 00:00:04.785880 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:04.785851 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d76d45b59-pxqxd"] Sep 19 00:00:04.788613 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:00:04.788587 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dadd56b_1082_4205_af68_2606397eb577.slice/crio-117b6b0488808f39b635daca6f3adf109d3caa884549f251595eb7fcda686968 WatchSource:0}: Error finding container 117b6b0488808f39b635daca6f3adf109d3caa884549f251595eb7fcda686968: Status 404 returned error can't find the container with id 117b6b0488808f39b635daca6f3adf109d3caa884549f251595eb7fcda686968 Sep 19 00:00:05.707820 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:05.707782 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d76d45b59-pxqxd" event={"ID":"3dadd56b-1082-4205-af68-2606397eb577","Type":"ContainerStarted","Data":"117b6b0488808f39b635daca6f3adf109d3caa884549f251595eb7fcda686968"} Sep 19 00:00:05.857319 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:05.857284 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:05.959573 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:05.959497 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:07.722156 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:07.722035 2568 generic.go:356] "Generic (PLEG): container finished" podID="63e3b0fa-d932-4e4e-901d-f0cdf089c5d3" containerID="af7ab49a69549f0a99e856babc5bc20939ac20f0c1a347ca195dfb8b2135dd70" exitCode=0 Sep 19 00:00:07.722156 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:07.722071 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" event={"ID":"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3","Type":"ContainerDied","Data":"af7ab49a69549f0a99e856babc5bc20939ac20f0c1a347ca195dfb8b2135dd70"} Sep 19 00:00:07.722698 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:07.722491 2568 scope.go:117] "RemoveContainer" containerID="af7ab49a69549f0a99e856babc5bc20939ac20f0c1a347ca195dfb8b2135dd70" Sep 19 00:00:08.086899 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:08.086854 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:08.559244 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:08.559211 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:10.539339 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:10.539313 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69bdf69d78-p2kl4_53e9c2c3-7159-405c-9078-11e083b84d16/router/0.log" Sep 19 00:00:10.544403 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:10.544382 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc99k_0ea81138-5709-41f2-819c-bc743cd7b9d7/serve-healthcheck-canary/0.log" Sep 19 00:00:10.736294 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:10.736255 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d76d45b59-pxqxd" event={"ID":"3dadd56b-1082-4205-af68-2606397eb577","Type":"ContainerStarted","Data":"4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d"} Sep 19 00:00:10.738199 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:10.738173 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-t2l6g" event={"ID":"63e3b0fa-d932-4e4e-901d-f0cdf089c5d3","Type":"ContainerStarted","Data":"fc1b46cd7a87a27c6f5e5df786490260dfc85b792dd92346afd05360f0d3dfe7"} Sep 19 00:00:10.753002 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:10.752949 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d76d45b59-pxqxd" podStartSLOduration=1.69062621 podStartE2EDuration="6.75293284s" totalImagesPullingTime="5.06230663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:00:10.752075391 +0000 UTC m=+113.170799801" watchObservedRunningTime="2026-09-19 00:00:10.75293284 +0000 UTC m=+113.171657245" Sep 19 00:00:12.055371 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:12.055339 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:12.107602 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:12.107563 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:12.748035 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:12.747999 2568 generic.go:356] "Generic (PLEG): container finished" podID="51331aed-dfac-49dc-91fc-52a60666e981" containerID="375c5db3e71e5d7968b9d5d07d0f92c1e5b9d349f55c8e93fae8d77c38647a77" exitCode=0 Sep 19 00:00:12.748217 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:12.748075 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" event={"ID":"51331aed-dfac-49dc-91fc-52a60666e981","Type":"ContainerDied","Data":"375c5db3e71e5d7968b9d5d07d0f92c1e5b9d349f55c8e93fae8d77c38647a77"} Sep 19 00:00:12.748407 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:12.748393 2568 scope.go:117] "RemoveContainer" containerID="375c5db3e71e5d7968b9d5d07d0f92c1e5b9d349f55c8e93fae8d77c38647a77" Sep 19 00:00:12.877741 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:12.877700 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:13.526644 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.526592 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" podUID="5b086dd8-58e6-4da9-abdd-bd1ed42b64da" containerName="registry" containerID="cri-o://a3234fa3cf32510d9b9786bc5fc99606e534543f0311aedc8f34a5459797c973" gracePeriod=30 Sep 19 00:00:13.754661 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.754328 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hhrgn" event={"ID":"51331aed-dfac-49dc-91fc-52a60666e981","Type":"ContainerStarted","Data":"957e27aba589b19a2f8be86c41238c65f651f040854f72cf845a8664231890d8"} Sep 19 00:00:13.755841 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.755816 2568 generic.go:356] "Generic (PLEG): container finished" podID="5b086dd8-58e6-4da9-abdd-bd1ed42b64da" containerID="a3234fa3cf32510d9b9786bc5fc99606e534543f0311aedc8f34a5459797c973" exitCode=0 Sep 19 00:00:13.755994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.755936 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" event={"ID":"5b086dd8-58e6-4da9-abdd-bd1ed42b64da","Type":"ContainerDied","Data":"a3234fa3cf32510d9b9786bc5fc99606e534543f0311aedc8f34a5459797c973"} Sep 19 00:00:13.769232 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.769200 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 19 00:00:13.812336 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.812259 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-ca-trust-extracted\") pod \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " Sep 19 00:00:13.812336 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.812305 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-bound-sa-token\") pod \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " Sep 19 00:00:13.812336 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.812333 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") pod \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " Sep 19 00:00:13.812605 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.812380 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-installation-pull-secrets\") pod \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " Sep 19 00:00:13.812605 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.812430 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-trusted-ca\") pod \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " Sep 19 00:00:13.812605 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.812454 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-certificates\") pod \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " Sep 19 00:00:13.812605 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.812492 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgx8h\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-kube-api-access-wgx8h\") pod \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " Sep 19 00:00:13.812605 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.812544 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-image-registry-private-configuration\") pod \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\" (UID: \"5b086dd8-58e6-4da9-abdd-bd1ed42b64da\") " Sep 19 00:00:13.813290 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.813144 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5b086dd8-58e6-4da9-abdd-bd1ed42b64da" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:00:13.814410 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.814383 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5b086dd8-58e6-4da9-abdd-bd1ed42b64da" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:00:13.815416 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.815351 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5b086dd8-58e6-4da9-abdd-bd1ed42b64da" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:00:13.817346 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.817321 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5b086dd8-58e6-4da9-abdd-bd1ed42b64da" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:00:13.817489 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.817458 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-kube-api-access-wgx8h" (OuterVolumeSpecName: "kube-api-access-wgx8h") pod "5b086dd8-58e6-4da9-abdd-bd1ed42b64da" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da"). InnerVolumeSpecName "kube-api-access-wgx8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:00:13.817604 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.817450 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5b086dd8-58e6-4da9-abdd-bd1ed42b64da" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:00:13.817669 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.817627 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5b086dd8-58e6-4da9-abdd-bd1ed42b64da" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:00:13.825644 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.825616 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5b086dd8-58e6-4da9-abdd-bd1ed42b64da" (UID: "5b086dd8-58e6-4da9-abdd-bd1ed42b64da"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:00:13.913938 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.913880 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-ca-trust-extracted\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:13.913938 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.913933 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-bound-sa-token\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:13.913938 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.913943 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-tls\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:13.913938 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.913951 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-installation-pull-secrets\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:13.914232 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.913959 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-trusted-ca\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:13.914232 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.913967 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-registry-certificates\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:13.914232 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.913975 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgx8h\" (UniqueName: \"kubernetes.io/projected/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-kube-api-access-wgx8h\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:13.914232 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:13.913984 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b086dd8-58e6-4da9-abdd-bd1ed42b64da-image-registry-private-configuration\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:14.502831 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.502793 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:14.503008 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.502856 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:14.507686 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.507661 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:14.761817 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.761735 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" Sep 19 00:00:14.761817 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.761781 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b98f4cf5-gw47b" event={"ID":"5b086dd8-58e6-4da9-abdd-bd1ed42b64da","Type":"ContainerDied","Data":"1da5a393d2fea1bc6459503bbe91370b76643a54b5328fe334825a6b48adcb1a"} Sep 19 00:00:14.762393 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.761846 2568 scope.go:117] "RemoveContainer" containerID="a3234fa3cf32510d9b9786bc5fc99606e534543f0311aedc8f34a5459797c973" Sep 19 00:00:14.766141 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.766121 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:14.778124 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.778102 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75b98f4cf5-gw47b"] Sep 19 00:00:14.781700 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:14.781680 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75b98f4cf5-gw47b"] Sep 19 00:00:16.022383 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:16.022350 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b086dd8-58e6-4da9-abdd-bd1ed42b64da" path="/var/lib/kubelet/pods/5b086dd8-58e6-4da9-abdd-bd1ed42b64da/volumes" Sep 19 00:00:16.465834 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:16.465797 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:16.516029 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:16.515997 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:17.777731 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:17.777701 2568 generic.go:356] "Generic (PLEG): container finished" podID="a1f6cb64-a53b-40f4-a470-bac55725c938" containerID="3143cd5e27f882413e5ff2504810663baf4a0d80e2a26d1f8a7131c40b510dba" exitCode=0 Sep 19 00:00:17.778110 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:17.777773 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" event={"ID":"a1f6cb64-a53b-40f4-a470-bac55725c938","Type":"ContainerDied","Data":"3143cd5e27f882413e5ff2504810663baf4a0d80e2a26d1f8a7131c40b510dba"} Sep 19 00:00:17.778156 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:17.778141 2568 scope.go:117] "RemoveContainer" containerID="3143cd5e27f882413e5ff2504810663baf4a0d80e2a26d1f8a7131c40b510dba" Sep 19 00:00:18.788079 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:18.788045 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-t5hrv" event={"ID":"a1f6cb64-a53b-40f4-a470-bac55725c938","Type":"ContainerStarted","Data":"e30fe1a7105e197399b27b07cabd5e1682a235d1b234faae51c978c3bea903c6"} Sep 19 00:00:19.268412 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:19.268373 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:19.321532 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:19.321494 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:20.644263 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:20.644222 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:20.721758 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:20.721721 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:23.985756 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:23.985710 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d76d45b59-pxqxd"] Sep 19 00:00:24.080675 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:24.080624 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:24.129181 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:24.129142 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:24.523784 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:24.523753 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 19 00:00:24.527902 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:24.527858 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6759d9fdf6-mrrd6" Sep 19 00:00:27.751525 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:27.751490 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:27.948567 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:27.948530 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:28.049206 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:28.049120 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:35.644865 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:35.644834 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:35.699501 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:35.699470 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:49.017477 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.017401 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d76d45b59-pxqxd" podUID="3dadd56b-1082-4205-af68-2606397eb577" containerName="console" containerID="cri-o://4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d" gracePeriod=15 Sep 19 00:00:49.254963 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.254941 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:49.412244 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412205 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-console-config\") pod \"3dadd56b-1082-4205-af68-2606397eb577\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " Sep 19 00:00:49.412438 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412256 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-serving-cert\") pod \"3dadd56b-1082-4205-af68-2606397eb577\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " Sep 19 00:00:49.412438 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412290 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt6xq\" (UniqueName: \"kubernetes.io/projected/3dadd56b-1082-4205-af68-2606397eb577-kube-api-access-vt6xq\") pod \"3dadd56b-1082-4205-af68-2606397eb577\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " Sep 19 00:00:49.412438 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412308 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-oauth-config\") pod \"3dadd56b-1082-4205-af68-2606397eb577\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " Sep 19 00:00:49.412438 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412331 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-oauth-serving-cert\") pod \"3dadd56b-1082-4205-af68-2606397eb577\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " Sep 19 00:00:49.412438 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412395 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-service-ca\") pod \"3dadd56b-1082-4205-af68-2606397eb577\" (UID: \"3dadd56b-1082-4205-af68-2606397eb577\") " Sep 19 00:00:49.412794 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412762 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-console-config" (OuterVolumeSpecName: "console-config") pod "3dadd56b-1082-4205-af68-2606397eb577" (UID: "3dadd56b-1082-4205-af68-2606397eb577"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:00:49.412927 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412793 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3dadd56b-1082-4205-af68-2606397eb577" (UID: "3dadd56b-1082-4205-af68-2606397eb577"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:00:49.412927 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.412843 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-service-ca" (OuterVolumeSpecName: "service-ca") pod "3dadd56b-1082-4205-af68-2606397eb577" (UID: "3dadd56b-1082-4205-af68-2606397eb577"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:00:49.414673 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.414647 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3dadd56b-1082-4205-af68-2606397eb577" (UID: "3dadd56b-1082-4205-af68-2606397eb577"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:00:49.414994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.414972 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dadd56b-1082-4205-af68-2606397eb577-kube-api-access-vt6xq" (OuterVolumeSpecName: "kube-api-access-vt6xq") pod "3dadd56b-1082-4205-af68-2606397eb577" (UID: "3dadd56b-1082-4205-af68-2606397eb577"). InnerVolumeSpecName "kube-api-access-vt6xq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:00:49.414994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.414974 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3dadd56b-1082-4205-af68-2606397eb577" (UID: "3dadd56b-1082-4205-af68-2606397eb577"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:00:49.513102 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.513069 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-console-config\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:49.513102 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.513095 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-serving-cert\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:49.513102 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.513105 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt6xq\" (UniqueName: \"kubernetes.io/projected/3dadd56b-1082-4205-af68-2606397eb577-kube-api-access-vt6xq\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:49.513314 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.513113 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dadd56b-1082-4205-af68-2606397eb577-console-oauth-config\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:49.513314 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.513122 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-oauth-serving-cert\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:49.513314 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.513129 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dadd56b-1082-4205-af68-2606397eb577-service-ca\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:00:49.918550 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.918508 2568 generic.go:356] "Generic (PLEG): container finished" podID="3dadd56b-1082-4205-af68-2606397eb577" containerID="4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d" exitCode=0 Sep 19 00:00:49.918721 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.918557 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d76d45b59-pxqxd" Sep 19 00:00:49.918721 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.918557 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d76d45b59-pxqxd" event={"ID":"3dadd56b-1082-4205-af68-2606397eb577","Type":"ContainerDied","Data":"4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d"} Sep 19 00:00:49.918721 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.918644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d76d45b59-pxqxd" event={"ID":"3dadd56b-1082-4205-af68-2606397eb577","Type":"ContainerDied","Data":"117b6b0488808f39b635daca6f3adf109d3caa884549f251595eb7fcda686968"} Sep 19 00:00:49.918721 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.918671 2568 scope.go:117] "RemoveContainer" containerID="4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d" Sep 19 00:00:49.927818 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.927800 2568 scope.go:117] "RemoveContainer" containerID="4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d" Sep 19 00:00:49.928148 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:00:49.928127 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d\": container with ID starting with 4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d not found: ID does not exist" containerID="4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d" Sep 19 00:00:49.928191 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.928158 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d"} err="failed to get container status \"4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d\": rpc error: code = NotFound desc = could not find container \"4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d\": container with ID starting with 4651651e498c8842fa17be4afc287332e8c984aad781c11556049cddb573b10d not found: ID does not exist" Sep 19 00:00:49.939533 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.939506 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d76d45b59-pxqxd"] Sep 19 00:00:49.944619 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:49.944596 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d76d45b59-pxqxd"] Sep 19 00:00:50.022052 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:50.022022 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dadd56b-1082-4205-af68-2606397eb577" path="/var/lib/kubelet/pods/3dadd56b-1082-4205-af68-2606397eb577/volumes" Sep 19 00:00:59.078864 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:59.078829 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:00:59.511320 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:00:59.511291 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:08.210849 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.210807 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5645d675db-czzhq"] Sep 19 00:01:08.211366 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.211344 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dadd56b-1082-4205-af68-2606397eb577" containerName="console" Sep 19 00:01:08.211462 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.211369 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dadd56b-1082-4205-af68-2606397eb577" containerName="console" Sep 19 00:01:08.211462 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.211416 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b086dd8-58e6-4da9-abdd-bd1ed42b64da" containerName="registry" Sep 19 00:01:08.211462 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.211445 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b086dd8-58e6-4da9-abdd-bd1ed42b64da" containerName="registry" Sep 19 00:01:08.211608 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.211524 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dadd56b-1082-4205-af68-2606397eb577" containerName="console" Sep 19 00:01:08.211608 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.211536 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b086dd8-58e6-4da9-abdd-bd1ed42b64da" containerName="registry" Sep 19 00:01:08.214570 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.214547 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.217201 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.217174 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 19 00:01:08.217312 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.217236 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 19 00:01:08.217312 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.217237 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jsngw\"" Sep 19 00:01:08.218413 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.218386 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 19 00:01:08.218743 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.218723 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 19 00:01:08.218841 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.218806 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 19 00:01:08.218913 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.218883 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 19 00:01:08.218969 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.218944 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 19 00:01:08.224170 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.224142 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 19 00:01:08.225084 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.225055 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5645d675db-czzhq"] Sep 19 00:01:08.251865 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.251839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-oauth-serving-cert\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.252007 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.251872 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-config\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.252007 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.251930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfv6p\" (UniqueName: \"kubernetes.io/projected/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-kube-api-access-mfv6p\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.252007 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.251972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-trusted-ca-bundle\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.252143 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.252019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-service-ca\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.252143 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.252047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-oauth-config\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.252237 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.252133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-serving-cert\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.255610 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.255571 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:08.352495 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.352458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-oauth-serving-cert\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.352681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.352499 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-config\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.352681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.352541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfv6p\" (UniqueName: \"kubernetes.io/projected/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-kube-api-access-mfv6p\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.352681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.352561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-trusted-ca-bundle\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.352681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.352588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-service-ca\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.352681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.352616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-oauth-config\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.352681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.352657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-serving-cert\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.353400 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.353377 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-oauth-serving-cert\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.353516 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.353388 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-config\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.353741 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.353718 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-service-ca\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.353788 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.353740 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-trusted-ca-bundle\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.355349 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.355326 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-serving-cert\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.355450 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.355328 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-oauth-config\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.355859 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.355838 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:08.360135 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.360118 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfv6p\" (UniqueName: \"kubernetes.io/projected/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-kube-api-access-mfv6p\") pod \"console-5645d675db-czzhq\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.455734 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.455704 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:08.525764 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.525690 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:08.795041 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.795017 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5645d675db-czzhq"] Sep 19 00:01:08.797857 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:01:08.797824 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65543e2_4b78_4f3d_8263_1ede66fe4f0a.slice/crio-6d745a729b8c4398e5e7ce3d2939d642bd081c37405c03f90b038c68ff3410af WatchSource:0}: Error finding container 6d745a729b8c4398e5e7ce3d2939d642bd081c37405c03f90b038c68ff3410af: Status 404 returned error can't find the container with id 6d745a729b8c4398e5e7ce3d2939d642bd081c37405c03f90b038c68ff3410af Sep 19 00:01:08.997164 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.997120 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645d675db-czzhq" event={"ID":"e65543e2-4b78-4f3d-8263-1ede66fe4f0a","Type":"ContainerStarted","Data":"648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1"} Sep 19 00:01:08.997333 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:08.997180 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645d675db-czzhq" event={"ID":"e65543e2-4b78-4f3d-8263-1ede66fe4f0a","Type":"ContainerStarted","Data":"6d745a729b8c4398e5e7ce3d2939d642bd081c37405c03f90b038c68ff3410af"} Sep 19 00:01:09.014826 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:09.014767 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5645d675db-czzhq" podStartSLOduration=1.014751529 podStartE2EDuration="1.014751529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:01:09.013381344 +0000 UTC m=+171.432105752" watchObservedRunningTime="2026-09-19 00:01:09.014751529 +0000 UTC m=+171.433475933" Sep 19 00:01:09.040135 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:09.040108 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:09.140510 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:09.140475 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:18.525856 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:18.525814 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:18.526247 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:18.525906 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:18.530511 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:18.530487 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:19.041573 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:19.041545 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:01:19.172931 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:19.172862 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:19.220480 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:19.220444 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:19.272460 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:19.272422 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:34.058713 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:34.058680 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:40.636926 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:40.636868 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:01:40.738996 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:01:40.738962 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:01.936720 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:01.936682 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:14.297976 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:14.297937 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:15.114298 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:15.114267 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:23.119294 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:23.119260 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:23.174110 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:23.174076 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:23.261613 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:23.261580 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:23.310189 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:23.310160 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:23.874713 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:23.874681 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:23.976215 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:23.976185 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:26.287846 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:26.287811 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:26.335055 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:26.335028 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:31.608795 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:31.608758 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:31.707654 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:31.707625 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:33.464181 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:33.464139 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5645d675db-czzhq"] Sep 19 00:02:33.552375 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:33.552341 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:33.653464 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:33.653419 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:33.713278 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:33.713244 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:02:58.485106 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.485063 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5645d675db-czzhq" podUID="e65543e2-4b78-4f3d-8263-1ede66fe4f0a" containerName="console" containerID="cri-o://648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1" gracePeriod=15 Sep 19 00:02:58.723921 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.723883 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:02:58.855994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.855914 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-serving-cert\") pod \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " Sep 19 00:02:58.855994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.855990 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-config\") pod \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " Sep 19 00:02:58.856212 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856011 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-trusted-ca-bundle\") pod \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " Sep 19 00:02:58.856212 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856041 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-service-ca\") pod \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " Sep 19 00:02:58.856212 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856080 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-oauth-serving-cert\") pod \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " Sep 19 00:02:58.856212 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856116 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfv6p\" (UniqueName: \"kubernetes.io/projected/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-kube-api-access-mfv6p\") pod \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " Sep 19 00:02:58.856212 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856151 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-oauth-config\") pod \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\" (UID: \"e65543e2-4b78-4f3d-8263-1ede66fe4f0a\") " Sep 19 00:02:58.856466 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856423 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-config" (OuterVolumeSpecName: "console-config") pod "e65543e2-4b78-4f3d-8263-1ede66fe4f0a" (UID: "e65543e2-4b78-4f3d-8263-1ede66fe4f0a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:02:58.856521 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856466 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e65543e2-4b78-4f3d-8263-1ede66fe4f0a" (UID: "e65543e2-4b78-4f3d-8263-1ede66fe4f0a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:02:58.856620 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856461 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e65543e2-4b78-4f3d-8263-1ede66fe4f0a" (UID: "e65543e2-4b78-4f3d-8263-1ede66fe4f0a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:02:58.856706 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.856645 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e65543e2-4b78-4f3d-8263-1ede66fe4f0a" (UID: "e65543e2-4b78-4f3d-8263-1ede66fe4f0a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:02:58.858370 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.858350 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e65543e2-4b78-4f3d-8263-1ede66fe4f0a" (UID: "e65543e2-4b78-4f3d-8263-1ede66fe4f0a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:02:58.858607 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.858588 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-kube-api-access-mfv6p" (OuterVolumeSpecName: "kube-api-access-mfv6p") pod "e65543e2-4b78-4f3d-8263-1ede66fe4f0a" (UID: "e65543e2-4b78-4f3d-8263-1ede66fe4f0a"). InnerVolumeSpecName "kube-api-access-mfv6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:02:58.858660 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.858590 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e65543e2-4b78-4f3d-8263-1ede66fe4f0a" (UID: "e65543e2-4b78-4f3d-8263-1ede66fe4f0a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:02:58.957715 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.957668 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-config\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:02:58.957715 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.957708 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-trusted-ca-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:02:58.957715 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.957719 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-service-ca\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:02:58.957715 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.957727 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-oauth-serving-cert\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:02:58.958003 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.957735 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfv6p\" (UniqueName: \"kubernetes.io/projected/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-kube-api-access-mfv6p\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:02:58.958003 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.957746 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-oauth-config\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:02:58.958003 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:58.957754 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e65543e2-4b78-4f3d-8263-1ede66fe4f0a-console-serving-cert\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:02:59.430909 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.430860 2568 generic.go:356] "Generic (PLEG): container finished" podID="e65543e2-4b78-4f3d-8263-1ede66fe4f0a" containerID="648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1" exitCode=0 Sep 19 00:02:59.431072 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.430926 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645d675db-czzhq" Sep 19 00:02:59.431072 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.430950 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645d675db-czzhq" event={"ID":"e65543e2-4b78-4f3d-8263-1ede66fe4f0a","Type":"ContainerDied","Data":"648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1"} Sep 19 00:02:59.431072 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.431001 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645d675db-czzhq" event={"ID":"e65543e2-4b78-4f3d-8263-1ede66fe4f0a","Type":"ContainerDied","Data":"6d745a729b8c4398e5e7ce3d2939d642bd081c37405c03f90b038c68ff3410af"} Sep 19 00:02:59.431072 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.431021 2568 scope.go:117] "RemoveContainer" containerID="648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1" Sep 19 00:02:59.439607 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.439591 2568 scope.go:117] "RemoveContainer" containerID="648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1" Sep 19 00:02:59.439862 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:02:59.439844 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1\": container with ID starting with 648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1 not found: ID does not exist" containerID="648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1" Sep 19 00:02:59.439939 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.439874 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1"} err="failed to get container status \"648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1\": rpc error: code = NotFound desc = could not find container \"648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1\": container with ID starting with 648fa20f259dac854a770e88b5b75e573af14f7ba6de1ea395931f628142abc1 not found: ID does not exist" Sep 19 00:02:59.450996 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.450973 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5645d675db-czzhq"] Sep 19 00:02:59.454197 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:02:59.454177 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5645d675db-czzhq"] Sep 19 00:03:00.020966 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:00.020929 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e65543e2-4b78-4f3d-8263-1ede66fe4f0a" path="/var/lib/kubelet/pods/e65543e2-4b78-4f3d-8263-1ede66fe4f0a/volumes" Sep 19 00:03:17.952166 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:17.952136 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:03:17.957691 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:17.957666 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:03:17.962850 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:17.962831 2568 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 00:03:18.782102 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:18.782066 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:18.882428 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:18.882392 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:19.400542 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.400514 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls"] Sep 19 00:03:19.400929 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.400807 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65543e2-4b78-4f3d-8263-1ede66fe4f0a" containerName="console" Sep 19 00:03:19.400929 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.400818 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65543e2-4b78-4f3d-8263-1ede66fe4f0a" containerName="console" Sep 19 00:03:19.400929 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.400904 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e65543e2-4b78-4f3d-8263-1ede66fe4f0a" containerName="console" Sep 19 00:03:19.403765 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.403748 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.406233 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.406210 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lnsmc\"" Sep 19 00:03:19.406462 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.406446 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 00:03:19.407490 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.407473 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 00:03:19.412684 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.412659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fzwp\" (UniqueName: \"kubernetes.io/projected/1eb0f258-fc92-43db-b7d7-247b0daa5749-kube-api-access-6fzwp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.412802 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.412693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.412928 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.412884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.414702 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.414680 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls"] Sep 19 00:03:19.514094 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.514065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.514263 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.514108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fzwp\" (UniqueName: \"kubernetes.io/projected/1eb0f258-fc92-43db-b7d7-247b0daa5749-kube-api-access-6fzwp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.514263 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.514137 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.514462 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.514443 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.514530 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.514507 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.521783 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.521755 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fzwp\" (UniqueName: \"kubernetes.io/projected/1eb0f258-fc92-43db-b7d7-247b0daa5749-kube-api-access-6fzwp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.713474 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.713398 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:19.981135 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.981071 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls"] Sep 19 00:03:19.983873 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:03:19.983840 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb0f258_fc92_43db_b7d7_247b0daa5749.slice/crio-6979fb9bd94f5624a927566fbbdec416075263fedd1701b198aae8ef25bbb6e6 WatchSource:0}: Error finding container 6979fb9bd94f5624a927566fbbdec416075263fedd1701b198aae8ef25bbb6e6: Status 404 returned error can't find the container with id 6979fb9bd94f5624a927566fbbdec416075263fedd1701b198aae8ef25bbb6e6 Sep 19 00:03:19.985758 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:19.985738 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 00:03:20.521250 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:20.521207 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" event={"ID":"1eb0f258-fc92-43db-b7d7-247b0daa5749","Type":"ContainerStarted","Data":"6979fb9bd94f5624a927566fbbdec416075263fedd1701b198aae8ef25bbb6e6"} Sep 19 00:03:26.549975 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:26.549930 2568 generic.go:356] "Generic (PLEG): container finished" podID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerID="ef02ba15c04e0053f3961443f310197254896d9bd2d7311a5d1839e237fc5c73" exitCode=0 Sep 19 00:03:26.550395 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:26.550019 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" event={"ID":"1eb0f258-fc92-43db-b7d7-247b0daa5749","Type":"ContainerDied","Data":"ef02ba15c04e0053f3961443f310197254896d9bd2d7311a5d1839e237fc5c73"} Sep 19 00:03:29.563884 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:29.563848 2568 generic.go:356] "Generic (PLEG): container finished" podID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerID="4c9884ca93639102601edb92634827aa5da3baf4378ae7b1c459661bc1097073" exitCode=0 Sep 19 00:03:29.564269 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:29.563931 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" event={"ID":"1eb0f258-fc92-43db-b7d7-247b0daa5749","Type":"ContainerDied","Data":"4c9884ca93639102601edb92634827aa5da3baf4378ae7b1c459661bc1097073"} Sep 19 00:03:36.599145 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:36.599104 2568 generic.go:356] "Generic (PLEG): container finished" podID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerID="8f5adcbbc3311d30c4815972d3592ffd028789b3a003479b295ddd7797cbf90e" exitCode=0 Sep 19 00:03:36.599510 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:36.599181 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" event={"ID":"1eb0f258-fc92-43db-b7d7-247b0daa5749","Type":"ContainerDied","Data":"8f5adcbbc3311d30c4815972d3592ffd028789b3a003479b295ddd7797cbf90e"} Sep 19 00:03:37.731606 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.731586 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:37.760122 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.760091 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fzwp\" (UniqueName: \"kubernetes.io/projected/1eb0f258-fc92-43db-b7d7-247b0daa5749-kube-api-access-6fzwp\") pod \"1eb0f258-fc92-43db-b7d7-247b0daa5749\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " Sep 19 00:03:37.760122 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.760125 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-util\") pod \"1eb0f258-fc92-43db-b7d7-247b0daa5749\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " Sep 19 00:03:37.760314 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.760154 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-bundle\") pod \"1eb0f258-fc92-43db-b7d7-247b0daa5749\" (UID: \"1eb0f258-fc92-43db-b7d7-247b0daa5749\") " Sep 19 00:03:37.760761 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.760735 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-bundle" (OuterVolumeSpecName: "bundle") pod "1eb0f258-fc92-43db-b7d7-247b0daa5749" (UID: "1eb0f258-fc92-43db-b7d7-247b0daa5749"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:03:37.762287 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.762264 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb0f258-fc92-43db-b7d7-247b0daa5749-kube-api-access-6fzwp" (OuterVolumeSpecName: "kube-api-access-6fzwp") pod "1eb0f258-fc92-43db-b7d7-247b0daa5749" (UID: "1eb0f258-fc92-43db-b7d7-247b0daa5749"). InnerVolumeSpecName "kube-api-access-6fzwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:03:37.765371 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.765349 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-util" (OuterVolumeSpecName: "util") pod "1eb0f258-fc92-43db-b7d7-247b0daa5749" (UID: "1eb0f258-fc92-43db-b7d7-247b0daa5749"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:03:37.860913 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.860809 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:03:37.860913 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.860844 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fzwp\" (UniqueName: \"kubernetes.io/projected/1eb0f258-fc92-43db-b7d7-247b0daa5749-kube-api-access-6fzwp\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:03:37.860913 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:37.860854 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb0f258-fc92-43db-b7d7-247b0daa5749-util\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:03:38.608652 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:38.608616 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" event={"ID":"1eb0f258-fc92-43db-b7d7-247b0daa5749","Type":"ContainerDied","Data":"6979fb9bd94f5624a927566fbbdec416075263fedd1701b198aae8ef25bbb6e6"} Sep 19 00:03:38.608652 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:38.608651 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409q5ls" Sep 19 00:03:38.608652 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:38.608663 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6979fb9bd94f5624a927566fbbdec416075263fedd1701b198aae8ef25bbb6e6" Sep 19 00:03:40.379651 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:40.379619 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:41.629616 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:41.629581 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:42.267873 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.267837 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4"] Sep 19 00:03:42.268172 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.268160 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerName="util" Sep 19 00:03:42.268217 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.268173 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerName="util" Sep 19 00:03:42.268217 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.268191 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerName="pull" Sep 19 00:03:42.268217 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.268196 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerName="pull" Sep 19 00:03:42.268217 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.268202 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerName="extract" Sep 19 00:03:42.268217 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.268208 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerName="extract" Sep 19 00:03:42.268370 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.268264 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb0f258-fc92-43db-b7d7-247b0daa5749" containerName="extract" Sep 19 00:03:42.270965 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.270948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" Sep 19 00:03:42.273909 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.273865 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hw9bd\"" Sep 19 00:03:42.274036 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.273951 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 19 00:03:42.274036 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.273959 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 19 00:03:42.282904 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.282868 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4"] Sep 19 00:03:42.396161 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.396123 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28ltx\" (UniqueName: \"kubernetes.io/projected/66400069-e93f-4a42-93fb-1157a2d3df9c-kube-api-access-28ltx\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gwm4\" (UID: \"66400069-e93f-4a42-93fb-1157a2d3df9c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" Sep 19 00:03:42.396349 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.396176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66400069-e93f-4a42-93fb-1157a2d3df9c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gwm4\" (UID: \"66400069-e93f-4a42-93fb-1157a2d3df9c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" Sep 19 00:03:42.497578 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.497535 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28ltx\" (UniqueName: \"kubernetes.io/projected/66400069-e93f-4a42-93fb-1157a2d3df9c-kube-api-access-28ltx\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gwm4\" (UID: \"66400069-e93f-4a42-93fb-1157a2d3df9c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" Sep 19 00:03:42.497717 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.497599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66400069-e93f-4a42-93fb-1157a2d3df9c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gwm4\" (UID: \"66400069-e93f-4a42-93fb-1157a2d3df9c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" Sep 19 00:03:42.497946 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.497925 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66400069-e93f-4a42-93fb-1157a2d3df9c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gwm4\" (UID: \"66400069-e93f-4a42-93fb-1157a2d3df9c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" Sep 19 00:03:42.508329 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.508302 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28ltx\" (UniqueName: \"kubernetes.io/projected/66400069-e93f-4a42-93fb-1157a2d3df9c-kube-api-access-28ltx\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gwm4\" (UID: \"66400069-e93f-4a42-93fb-1157a2d3df9c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" Sep 19 00:03:42.580354 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.580291 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" Sep 19 00:03:42.854802 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:42.854774 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4"] Sep 19 00:03:42.857552 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:03:42.857523 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66400069_e93f_4a42_93fb_1157a2d3df9c.slice/crio-08ee2f7258166488e8b48a1d5cc34e47b5535bfe88270e4b2ace064b72f8fb04 WatchSource:0}: Error finding container 08ee2f7258166488e8b48a1d5cc34e47b5535bfe88270e4b2ace064b72f8fb04: Status 404 returned error can't find the container with id 08ee2f7258166488e8b48a1d5cc34e47b5535bfe88270e4b2ace064b72f8fb04 Sep 19 00:03:43.631858 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:43.631823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" event={"ID":"66400069-e93f-4a42-93fb-1157a2d3df9c","Type":"ContainerStarted","Data":"08ee2f7258166488e8b48a1d5cc34e47b5535bfe88270e4b2ace064b72f8fb04"} Sep 19 00:03:43.985861 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:43.985775 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:44.037099 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:44.037068 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:45.643701 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:45.643660 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" event={"ID":"66400069-e93f-4a42-93fb-1157a2d3df9c","Type":"ContainerStarted","Data":"d0eb5a1ac9f9c0c191c4018a45294ec14e393077b4e092a66139eff84b95e9cb"} Sep 19 00:03:45.664241 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:45.664198 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gwm4" podStartSLOduration=1.555838997 podStartE2EDuration="3.664184002s" totalImagesPullingTime="2.108345005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:03:45.662393759 +0000 UTC m=+328.081118168" watchObservedRunningTime="2026-09-19 00:03:45.664184002 +0000 UTC m=+328.082908409" Sep 19 00:03:45.710280 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:45.710250 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:45.810462 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:45.810435 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:45.983191 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:45.983101 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:46.081730 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.081698 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:46.618826 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.618792 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4"] Sep 19 00:03:46.622556 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.622530 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.625175 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.625153 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 00:03:46.626420 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.626402 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lnsmc\"" Sep 19 00:03:46.626526 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.626508 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 00:03:46.631631 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.631608 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4"] Sep 19 00:03:46.733394 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.733361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.733780 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.733410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svqpv\" (UniqueName: \"kubernetes.io/projected/86c0e731-78cd-4758-91de-583d017db2b5-kube-api-access-svqpv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.733780 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.733554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.834341 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.834306 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.834522 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.834376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.834522 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.834404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svqpv\" (UniqueName: \"kubernetes.io/projected/86c0e731-78cd-4758-91de-583d017db2b5-kube-api-access-svqpv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.834785 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.834764 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.834857 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.834774 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.847208 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.847185 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svqpv\" (UniqueName: \"kubernetes.io/projected/86c0e731-78cd-4758-91de-583d017db2b5-kube-api-access-svqpv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:46.932279 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:46.932242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:47.203717 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:47.203628 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4"] Sep 19 00:03:47.207299 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:03:47.207269 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c0e731_78cd_4758_91de_583d017db2b5.slice/crio-b7ea704c743651b856ae62a3f71f78e9cb377f88dec417b38937eb475d0db5de WatchSource:0}: Error finding container b7ea704c743651b856ae62a3f71f78e9cb377f88dec417b38937eb475d0db5de: Status 404 returned error can't find the container with id b7ea704c743651b856ae62a3f71f78e9cb377f88dec417b38937eb475d0db5de Sep 19 00:03:47.653655 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:47.653618 2568 generic.go:356] "Generic (PLEG): container finished" podID="86c0e731-78cd-4758-91de-583d017db2b5" containerID="04503fc9276afec9315d3c513c57f14c6b39013c4102b6b9283fcf1f6e795350" exitCode=0 Sep 19 00:03:47.653817 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:47.653688 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" event={"ID":"86c0e731-78cd-4758-91de-583d017db2b5","Type":"ContainerDied","Data":"04503fc9276afec9315d3c513c57f14c6b39013c4102b6b9283fcf1f6e795350"} Sep 19 00:03:47.653817 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:47.653723 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" event={"ID":"86c0e731-78cd-4758-91de-583d017db2b5","Type":"ContainerStarted","Data":"b7ea704c743651b856ae62a3f71f78e9cb377f88dec417b38937eb475d0db5de"} Sep 19 00:03:47.829703 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:47.829672 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:48.223811 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.223776 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:48.677031 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.676999 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4q62k"] Sep 19 00:03:48.680164 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.680147 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" Sep 19 00:03:48.682754 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.682731 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-46hk8\"" Sep 19 00:03:48.682849 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.682783 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 19 00:03:48.683835 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.683814 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 19 00:03:48.688977 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.688954 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4q62k"] Sep 19 00:03:48.750445 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.750414 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a60ebe93-2b30-495d-9d82-9fa23c886d6c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4q62k\" (UID: \"a60ebe93-2b30-495d-9d82-9fa23c886d6c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" Sep 19 00:03:48.750595 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.750452 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8ggn\" (UniqueName: \"kubernetes.io/projected/a60ebe93-2b30-495d-9d82-9fa23c886d6c-kube-api-access-f8ggn\") pod \"cert-manager-cainjector-559cdd8c87-4q62k\" (UID: \"a60ebe93-2b30-495d-9d82-9fa23c886d6c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" Sep 19 00:03:48.851051 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.851017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a60ebe93-2b30-495d-9d82-9fa23c886d6c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4q62k\" (UID: \"a60ebe93-2b30-495d-9d82-9fa23c886d6c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" Sep 19 00:03:48.851051 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.851055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8ggn\" (UniqueName: \"kubernetes.io/projected/a60ebe93-2b30-495d-9d82-9fa23c886d6c-kube-api-access-f8ggn\") pod \"cert-manager-cainjector-559cdd8c87-4q62k\" (UID: \"a60ebe93-2b30-495d-9d82-9fa23c886d6c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" Sep 19 00:03:48.859301 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.859273 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8ggn\" (UniqueName: \"kubernetes.io/projected/a60ebe93-2b30-495d-9d82-9fa23c886d6c-kube-api-access-f8ggn\") pod \"cert-manager-cainjector-559cdd8c87-4q62k\" (UID: \"a60ebe93-2b30-495d-9d82-9fa23c886d6c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" Sep 19 00:03:48.859400 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.859273 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a60ebe93-2b30-495d-9d82-9fa23c886d6c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4q62k\" (UID: \"a60ebe93-2b30-495d-9d82-9fa23c886d6c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" Sep 19 00:03:48.998251 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:48.998155 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" Sep 19 00:03:49.266141 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:49.266065 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4q62k"] Sep 19 00:03:49.269207 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:03:49.269165 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda60ebe93_2b30_495d_9d82_9fa23c886d6c.slice/crio-e46a634d566613b7a142229ad8075ade8e25619c99d0f56fbb0b514ffde25e77 WatchSource:0}: Error finding container e46a634d566613b7a142229ad8075ade8e25619c99d0f56fbb0b514ffde25e77: Status 404 returned error can't find the container with id e46a634d566613b7a142229ad8075ade8e25619c99d0f56fbb0b514ffde25e77 Sep 19 00:03:49.662570 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:49.662534 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" event={"ID":"a60ebe93-2b30-495d-9d82-9fa23c886d6c","Type":"ContainerStarted","Data":"e46a634d566613b7a142229ad8075ade8e25619c99d0f56fbb0b514ffde25e77"} Sep 19 00:03:50.786139 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:50.786100 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:50.886776 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:50.886736 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:52.686823 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:52.686786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" event={"ID":"a60ebe93-2b30-495d-9d82-9fa23c886d6c","Type":"ContainerStarted","Data":"d812507ccc70c2e475f9710ae9cda5f2278f791bee39ac85bbaaf6906327d845"} Sep 19 00:03:52.702327 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:52.702269 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4q62k" podStartSLOduration=2.036705172 podStartE2EDuration="4.702249559s" totalImagesPullingTime="2.665544387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:03:52.700280782 +0000 UTC m=+335.119005192" watchObservedRunningTime="2026-09-19 00:03:52.702249559 +0000 UTC m=+335.120973969" Sep 19 00:03:54.698447 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:54.698410 2568 generic.go:356] "Generic (PLEG): container finished" podID="86c0e731-78cd-4758-91de-583d017db2b5" containerID="d60841c2184d75b7637c9980d654fe93af23844d0449e46375896f980a513c88" exitCode=0 Sep 19 00:03:54.698831 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:54.698451 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" event={"ID":"86c0e731-78cd-4758-91de-583d017db2b5","Type":"ContainerDied","Data":"d60841c2184d75b7637c9980d654fe93af23844d0449e46375896f980a513c88"} Sep 19 00:03:55.705096 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:55.705055 2568 generic.go:356] "Generic (PLEG): container finished" podID="86c0e731-78cd-4758-91de-583d017db2b5" containerID="9742c93e9ea8f00026e709cd080dbf143d6b0eb38469d9b39fd7a288229cd3a6" exitCode=0 Sep 19 00:03:55.705526 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:55.705139 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" event={"ID":"86c0e731-78cd-4758-91de-583d017db2b5","Type":"ContainerDied","Data":"9742c93e9ea8f00026e709cd080dbf143d6b0eb38469d9b39fd7a288229cd3a6"} Sep 19 00:03:56.434307 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:56.434233 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:56.839786 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:56.839759 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:56.919670 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:56.919643 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svqpv\" (UniqueName: \"kubernetes.io/projected/86c0e731-78cd-4758-91de-583d017db2b5-kube-api-access-svqpv\") pod \"86c0e731-78cd-4758-91de-583d017db2b5\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " Sep 19 00:03:56.919832 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:56.919717 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-bundle\") pod \"86c0e731-78cd-4758-91de-583d017db2b5\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " Sep 19 00:03:56.919832 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:56.919757 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-util\") pod \"86c0e731-78cd-4758-91de-583d017db2b5\" (UID: \"86c0e731-78cd-4758-91de-583d017db2b5\") " Sep 19 00:03:56.920174 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:56.920145 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-bundle" (OuterVolumeSpecName: "bundle") pod "86c0e731-78cd-4758-91de-583d017db2b5" (UID: "86c0e731-78cd-4758-91de-583d017db2b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:03:56.921779 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:56.921751 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c0e731-78cd-4758-91de-583d017db2b5-kube-api-access-svqpv" (OuterVolumeSpecName: "kube-api-access-svqpv") pod "86c0e731-78cd-4758-91de-583d017db2b5" (UID: "86c0e731-78cd-4758-91de-583d017db2b5"). InnerVolumeSpecName "kube-api-access-svqpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:03:56.924095 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:56.924063 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-util" (OuterVolumeSpecName: "util") pod "86c0e731-78cd-4758-91de-583d017db2b5" (UID: "86c0e731-78cd-4758-91de-583d017db2b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:03:57.020469 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:57.020387 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svqpv\" (UniqueName: \"kubernetes.io/projected/86c0e731-78cd-4758-91de-583d017db2b5-kube-api-access-svqpv\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:03:57.020469 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:57.020417 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:03:57.020469 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:57.020428 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c0e731-78cd-4758-91de-583d017db2b5-util\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:03:57.715756 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:57.715730 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" Sep 19 00:03:57.716021 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:57.715729 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftcrs4" event={"ID":"86c0e731-78cd-4758-91de-583d017db2b5","Type":"ContainerDied","Data":"b7ea704c743651b856ae62a3f71f78e9cb377f88dec417b38937eb475d0db5de"} Sep 19 00:03:57.716021 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:57.715847 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7ea704c743651b856ae62a3f71f78e9cb377f88dec417b38937eb475d0db5de" Sep 19 00:03:58.609554 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.609515 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m57jt"] Sep 19 00:03:58.609958 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.609836 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c0e731-78cd-4758-91de-583d017db2b5" containerName="util" Sep 19 00:03:58.609958 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.609848 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c0e731-78cd-4758-91de-583d017db2b5" containerName="util" Sep 19 00:03:58.609958 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.609856 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c0e731-78cd-4758-91de-583d017db2b5" containerName="extract" Sep 19 00:03:58.609958 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.609861 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c0e731-78cd-4758-91de-583d017db2b5" containerName="extract" Sep 19 00:03:58.609958 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.609876 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c0e731-78cd-4758-91de-583d017db2b5" containerName="pull" Sep 19 00:03:58.609958 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.609881 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c0e731-78cd-4758-91de-583d017db2b5" containerName="pull" Sep 19 00:03:58.609958 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.609961 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="86c0e731-78cd-4758-91de-583d017db2b5" containerName="extract" Sep 19 00:03:58.612061 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.612044 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m57jt" Sep 19 00:03:58.614475 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.614449 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bjc9c\"" Sep 19 00:03:58.621805 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.621783 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m57jt"] Sep 19 00:03:58.737306 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.737274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20487d53-27e9-4b0c-8fac-5fb16d804b09-bound-sa-token\") pod \"cert-manager-55b4d954d5-m57jt\" (UID: \"20487d53-27e9-4b0c-8fac-5fb16d804b09\") " pod="cert-manager/cert-manager-55b4d954d5-m57jt" Sep 19 00:03:58.737501 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.737315 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpf5\" (UniqueName: \"kubernetes.io/projected/20487d53-27e9-4b0c-8fac-5fb16d804b09-kube-api-access-2hpf5\") pod \"cert-manager-55b4d954d5-m57jt\" (UID: \"20487d53-27e9-4b0c-8fac-5fb16d804b09\") " pod="cert-manager/cert-manager-55b4d954d5-m57jt" Sep 19 00:03:58.838289 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.838251 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpf5\" (UniqueName: \"kubernetes.io/projected/20487d53-27e9-4b0c-8fac-5fb16d804b09-kube-api-access-2hpf5\") pod \"cert-manager-55b4d954d5-m57jt\" (UID: \"20487d53-27e9-4b0c-8fac-5fb16d804b09\") " pod="cert-manager/cert-manager-55b4d954d5-m57jt" Sep 19 00:03:58.838469 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.838335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20487d53-27e9-4b0c-8fac-5fb16d804b09-bound-sa-token\") pod \"cert-manager-55b4d954d5-m57jt\" (UID: \"20487d53-27e9-4b0c-8fac-5fb16d804b09\") " pod="cert-manager/cert-manager-55b4d954d5-m57jt" Sep 19 00:03:58.845944 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.845921 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20487d53-27e9-4b0c-8fac-5fb16d804b09-bound-sa-token\") pod \"cert-manager-55b4d954d5-m57jt\" (UID: \"20487d53-27e9-4b0c-8fac-5fb16d804b09\") " pod="cert-manager/cert-manager-55b4d954d5-m57jt" Sep 19 00:03:58.845944 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.845936 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpf5\" (UniqueName: \"kubernetes.io/projected/20487d53-27e9-4b0c-8fac-5fb16d804b09-kube-api-access-2hpf5\") pod \"cert-manager-55b4d954d5-m57jt\" (UID: \"20487d53-27e9-4b0c-8fac-5fb16d804b09\") " pod="cert-manager/cert-manager-55b4d954d5-m57jt" Sep 19 00:03:58.921107 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.921078 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m57jt" Sep 19 00:03:58.942884 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:58.942851 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:59.043869 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:59.043817 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:59.195879 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:59.195854 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m57jt"] Sep 19 00:03:59.198404 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:03:59.198380 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20487d53_27e9_4b0c_8fac_5fb16d804b09.slice/crio-3f04c8ed6470d9034d97c2c003551731db08abd4d329642de428c32620b2df87 WatchSource:0}: Error finding container 3f04c8ed6470d9034d97c2c003551731db08abd4d329642de428c32620b2df87: Status 404 returned error can't find the container with id 3f04c8ed6470d9034d97c2c003551731db08abd4d329642de428c32620b2df87 Sep 19 00:03:59.426065 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:59.426029 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:59.527210 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:59.527126 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:03:59.725407 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:59.725374 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m57jt" event={"ID":"20487d53-27e9-4b0c-8fac-5fb16d804b09","Type":"ContainerStarted","Data":"24bb941a72a5137e1c90d38d89f8e21abf081b98554a3dac690b03e36e58fd8d"} Sep 19 00:03:59.725407 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:59.725413 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m57jt" event={"ID":"20487d53-27e9-4b0c-8fac-5fb16d804b09","Type":"ContainerStarted","Data":"3f04c8ed6470d9034d97c2c003551731db08abd4d329642de428c32620b2df87"} Sep 19 00:03:59.742082 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:03:59.742030 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-m57jt" podStartSLOduration=1.742013117 podStartE2EDuration="1.742013117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:03:59.741639046 +0000 UTC m=+342.160363454" watchObservedRunningTime="2026-09-19 00:03:59.742013117 +0000 UTC m=+342.160737526" Sep 19 00:04:05.237394 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:05.237356 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:05.344691 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:05.344656 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:06.800737 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.800702 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l"] Sep 19 00:04:06.808187 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.808170 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:06.810846 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.810825 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 00:04:06.810993 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.810904 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lnsmc\"" Sep 19 00:04:06.811380 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.811355 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l"] Sep 19 00:04:06.811735 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.811719 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 00:04:06.907263 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.907228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:06.907414 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.907292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:06.907414 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:06.907313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmq7\" (UniqueName: \"kubernetes.io/projected/1547f72e-510b-415e-baa0-d4a9c28ae6d0-kube-api-access-pcmq7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:07.008691 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.008656 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:07.008691 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.008691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmq7\" (UniqueName: \"kubernetes.io/projected/1547f72e-510b-415e-baa0-d4a9c28ae6d0-kube-api-access-pcmq7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:07.008919 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.008883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:07.009073 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.009055 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:07.009205 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.009190 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:07.017267 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.017247 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmq7\" (UniqueName: \"kubernetes.io/projected/1547f72e-510b-415e-baa0-d4a9c28ae6d0-kube-api-access-pcmq7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:07.108908 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.108811 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:07.118785 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.118763 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:07.385817 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.385790 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l"] Sep 19 00:04:07.388426 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:04:07.388402 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1547f72e_510b_415e_baa0_d4a9c28ae6d0.slice/crio-d470932ee5912026751b71b90b892f1062690bd0ade2542ccf51ae0637bd9c33 WatchSource:0}: Error finding container d470932ee5912026751b71b90b892f1062690bd0ade2542ccf51ae0637bd9c33: Status 404 returned error can't find the container with id d470932ee5912026751b71b90b892f1062690bd0ade2542ccf51ae0637bd9c33 Sep 19 00:04:07.763177 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.763087 2568 generic.go:356] "Generic (PLEG): container finished" podID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerID="17be23e5713fc26d8b4a13322b647b4bad40f7bbc1823d6151f1ff98a824c11e" exitCode=0 Sep 19 00:04:07.763332 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.763178 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" event={"ID":"1547f72e-510b-415e-baa0-d4a9c28ae6d0","Type":"ContainerDied","Data":"17be23e5713fc26d8b4a13322b647b4bad40f7bbc1823d6151f1ff98a824c11e"} Sep 19 00:04:07.763332 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:07.763235 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" event={"ID":"1547f72e-510b-415e-baa0-d4a9c28ae6d0","Type":"ContainerStarted","Data":"d470932ee5912026751b71b90b892f1062690bd0ade2542ccf51ae0637bd9c33"} Sep 19 00:04:08.770100 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:08.770020 2568 generic.go:356] "Generic (PLEG): container finished" podID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerID="60be64203ed80fcf791a9325181c04e4ae87012f57e88d60d002d42ba98864fa" exitCode=0 Sep 19 00:04:08.770100 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:08.770087 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" event={"ID":"1547f72e-510b-415e-baa0-d4a9c28ae6d0","Type":"ContainerDied","Data":"60be64203ed80fcf791a9325181c04e4ae87012f57e88d60d002d42ba98864fa"} Sep 19 00:04:09.777353 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:09.777319 2568 generic.go:356] "Generic (PLEG): container finished" podID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerID="3a76eb04207b5d38db39c61b6b3d7753ed340da442ce1c6d2d3c7b3afdc760ed" exitCode=0 Sep 19 00:04:09.777725 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:09.777408 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" event={"ID":"1547f72e-510b-415e-baa0-d4a9c28ae6d0","Type":"ContainerDied","Data":"3a76eb04207b5d38db39c61b6b3d7753ed340da442ce1c6d2d3c7b3afdc760ed"} Sep 19 00:04:10.933422 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:10.933396 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:11.042638 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.042556 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcmq7\" (UniqueName: \"kubernetes.io/projected/1547f72e-510b-415e-baa0-d4a9c28ae6d0-kube-api-access-pcmq7\") pod \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " Sep 19 00:04:11.042638 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.042612 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-util\") pod \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " Sep 19 00:04:11.042638 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.042635 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-bundle\") pod \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\" (UID: \"1547f72e-510b-415e-baa0-d4a9c28ae6d0\") " Sep 19 00:04:11.043380 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.043355 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-bundle" (OuterVolumeSpecName: "bundle") pod "1547f72e-510b-415e-baa0-d4a9c28ae6d0" (UID: "1547f72e-510b-415e-baa0-d4a9c28ae6d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:04:11.044659 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.044635 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1547f72e-510b-415e-baa0-d4a9c28ae6d0-kube-api-access-pcmq7" (OuterVolumeSpecName: "kube-api-access-pcmq7") pod "1547f72e-510b-415e-baa0-d4a9c28ae6d0" (UID: "1547f72e-510b-415e-baa0-d4a9c28ae6d0"). InnerVolumeSpecName "kube-api-access-pcmq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:04:11.050440 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.050417 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-util" (OuterVolumeSpecName: "util") pod "1547f72e-510b-415e-baa0-d4a9c28ae6d0" (UID: "1547f72e-510b-415e-baa0-d4a9c28ae6d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:04:11.143681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.143641 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcmq7\" (UniqueName: \"kubernetes.io/projected/1547f72e-510b-415e-baa0-d4a9c28ae6d0-kube-api-access-pcmq7\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:04:11.143681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.143666 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-util\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:04:11.143681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.143674 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1547f72e-510b-415e-baa0-d4a9c28ae6d0-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:04:11.788760 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.788733 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" Sep 19 00:04:11.788760 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.788736 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6wx5l" event={"ID":"1547f72e-510b-415e-baa0-d4a9c28ae6d0","Type":"ContainerDied","Data":"d470932ee5912026751b71b90b892f1062690bd0ade2542ccf51ae0637bd9c33"} Sep 19 00:04:11.788980 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:11.788787 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d470932ee5912026751b71b90b892f1062690bd0ade2542ccf51ae0637bd9c33" Sep 19 00:04:13.959534 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:13.959503 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:22.796474 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:22.796439 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:22.900434 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:22.900393 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:23.414085 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.414049 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:23.591034 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.591005 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:23.693696 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.693620 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:23.733460 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.733425 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s"] Sep 19 00:04:23.733798 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.733783 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerName="util" Sep 19 00:04:23.733849 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.733799 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerName="util" Sep 19 00:04:23.733849 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.733807 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerName="pull" Sep 19 00:04:23.733849 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.733813 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerName="pull" Sep 19 00:04:23.733849 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.733820 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerName="extract" Sep 19 00:04:23.733849 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.733825 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerName="extract" Sep 19 00:04:23.734024 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.733883 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1547f72e-510b-415e-baa0-d4a9c28ae6d0" containerName="extract" Sep 19 00:04:23.765623 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.765594 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s"] Sep 19 00:04:23.765764 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.765704 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.768786 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.768766 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 19 00:04:23.769190 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.769156 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 19 00:04:23.769291 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.768899 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 19 00:04:23.769369 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.768776 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 19 00:04:23.769780 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.769761 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tz5mp\"" Sep 19 00:04:23.841950 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.841919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.842385 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.841962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-tmp\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.842385 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.841984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.842385 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.842006 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5xzx\" (UniqueName: \"kubernetes.io/projected/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-kube-api-access-n5xzx\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.842385 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.842028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-manifests\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.942781 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.942744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.942991 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.942791 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-tmp\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.942991 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.942808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.942991 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.942953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xzx\" (UniqueName: \"kubernetes.io/projected/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-kube-api-access-n5xzx\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.943175 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.943022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-manifests\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.943383 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.943354 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-manifests\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.945241 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.945188 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-tmp\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.945356 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.945341 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.945492 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.945473 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.950876 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.950852 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5xzx\" (UniqueName: \"kubernetes.io/projected/2538df7c-8e64-4a2e-82c8-f1c3a0d481cf-kube-api-access-n5xzx\") pod \"opendatahub-operator-controller-manager-577c99c85d-lfg8s\" (UID: \"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf\") " pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:23.991954 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:23.991919 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:24.010155 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.010120 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl"] Sep 19 00:04:24.037020 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.036980 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.039968 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.039945 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 00:04:24.040113 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.039952 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lnsmc\"" Sep 19 00:04:24.040276 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.040260 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 00:04:24.042984 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.042965 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl"] Sep 19 00:04:24.043531 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.043499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.043615 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.043585 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhkf7\" (UniqueName: \"kubernetes.io/projected/cbebac46-0813-44ac-80ca-6d3ead01a166-kube-api-access-qhkf7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.043670 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.043625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.076822 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.076795 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:24.086761 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.086738 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:24.144141 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.144110 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhkf7\" (UniqueName: \"kubernetes.io/projected/cbebac46-0813-44ac-80ca-6d3ead01a166-kube-api-access-qhkf7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.144288 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.144146 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.144288 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.144199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.144542 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.144524 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.144603 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.144579 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.153264 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.153241 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhkf7\" (UniqueName: \"kubernetes.io/projected/cbebac46-0813-44ac-80ca-6d3ead01a166-kube-api-access-qhkf7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.189605 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.189572 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:24.290831 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.290760 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:24.347326 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.347299 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:24.386947 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.386910 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s"] Sep 19 00:04:24.390174 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:04:24.390148 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2538df7c_8e64_4a2e_82c8_f1c3a0d481cf.slice/crio-939d4cd656d2090217cc0a36150bd59ab4abff0c1960118c34b5b75de2e158db WatchSource:0}: Error finding container 939d4cd656d2090217cc0a36150bd59ab4abff0c1960118c34b5b75de2e158db: Status 404 returned error can't find the container with id 939d4cd656d2090217cc0a36150bd59ab4abff0c1960118c34b5b75de2e158db Sep 19 00:04:24.393927 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.393830 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:24.490350 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.490323 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:24.621917 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.621872 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl"] Sep 19 00:04:24.624159 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:04:24.624133 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbebac46_0813_44ac_80ca_6d3ead01a166.slice/crio-a79a93447744b0152765671e7a74a5b790734e1726804787a8a23775e442ce07 WatchSource:0}: Error finding container a79a93447744b0152765671e7a74a5b790734e1726804787a8a23775e442ce07: Status 404 returned error can't find the container with id a79a93447744b0152765671e7a74a5b790734e1726804787a8a23775e442ce07 Sep 19 00:04:24.848923 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.848870 2568 generic.go:356] "Generic (PLEG): container finished" podID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerID="cd86cafe9ef0b53a81597fbee2e1f3c8620cbd84ce8be432494e7c7a32ff8a62" exitCode=0 Sep 19 00:04:24.849335 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.848962 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" event={"ID":"cbebac46-0813-44ac-80ca-6d3ead01a166","Type":"ContainerDied","Data":"cd86cafe9ef0b53a81597fbee2e1f3c8620cbd84ce8be432494e7c7a32ff8a62"} Sep 19 00:04:24.849335 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.849019 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" event={"ID":"cbebac46-0813-44ac-80ca-6d3ead01a166","Type":"ContainerStarted","Data":"a79a93447744b0152765671e7a74a5b790734e1726804787a8a23775e442ce07"} Sep 19 00:04:24.850446 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:24.850415 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" event={"ID":"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf","Type":"ContainerStarted","Data":"939d4cd656d2090217cc0a36150bd59ab4abff0c1960118c34b5b75de2e158db"} Sep 19 00:04:25.438241 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:25.438188 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:25.537834 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:25.537775 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:25.859689 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:25.859605 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" event={"ID":"cbebac46-0813-44ac-80ca-6d3ead01a166","Type":"ContainerStarted","Data":"c99a9dbf30ff52b8692cac39ddf269ff94204667bf9c4ceda2d1bdd128b4ae66"} Sep 19 00:04:27.872536 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:27.872497 2568 generic.go:356] "Generic (PLEG): container finished" podID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerID="c99a9dbf30ff52b8692cac39ddf269ff94204667bf9c4ceda2d1bdd128b4ae66" exitCode=0 Sep 19 00:04:27.872968 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:27.872563 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" event={"ID":"cbebac46-0813-44ac-80ca-6d3ead01a166","Type":"ContainerDied","Data":"c99a9dbf30ff52b8692cac39ddf269ff94204667bf9c4ceda2d1bdd128b4ae66"} Sep 19 00:04:27.874353 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:27.874327 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" event={"ID":"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf","Type":"ContainerStarted","Data":"05b19ee1fe8cb8e4ba3a58798f6150f72da1dd79294f54d7a995013aefe3d322"} Sep 19 00:04:28.880906 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:28.880857 2568 generic.go:356] "Generic (PLEG): container finished" podID="2538df7c-8e64-4a2e-82c8-f1c3a0d481cf" containerID="05b19ee1fe8cb8e4ba3a58798f6150f72da1dd79294f54d7a995013aefe3d322" exitCode=0 Sep 19 00:04:28.881360 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:28.880916 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" event={"ID":"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf","Type":"ContainerDied","Data":"05b19ee1fe8cb8e4ba3a58798f6150f72da1dd79294f54d7a995013aefe3d322"} Sep 19 00:04:28.883305 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:28.883285 2568 generic.go:356] "Generic (PLEG): container finished" podID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerID="79c598508e353db5b2047fb85b739a6f3b2bd95da2d9f30574295f3be50a0d78" exitCode=0 Sep 19 00:04:28.883375 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:28.883342 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" event={"ID":"cbebac46-0813-44ac-80ca-6d3ead01a166","Type":"ContainerDied","Data":"79c598508e353db5b2047fb85b739a6f3b2bd95da2d9f30574295f3be50a0d78"} Sep 19 00:04:29.890392 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:29.890353 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" event={"ID":"2538df7c-8e64-4a2e-82c8-f1c3a0d481cf","Type":"ContainerStarted","Data":"2f78918dcd34b23a8e40b6bcf8184b69970802fb93263e3e3e54bf4c6f782ab3"} Sep 19 00:04:29.913586 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:29.913519 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" podStartSLOduration=2.5792493629999997 podStartE2EDuration="6.913498469s" totalImagesPullingTime="3.276649058s" totalInitContainerRuntime="1.057600048s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:04:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:04:29.911933911 +0000 UTC m=+372.330658319" watchObservedRunningTime="2026-09-19 00:04:29.913498469 +0000 UTC m=+372.332222880" Sep 19 00:04:30.028530 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.028504 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:30.096724 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.096689 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhkf7\" (UniqueName: \"kubernetes.io/projected/cbebac46-0813-44ac-80ca-6d3ead01a166-kube-api-access-qhkf7\") pod \"cbebac46-0813-44ac-80ca-6d3ead01a166\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " Sep 19 00:04:30.096870 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.096737 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-util\") pod \"cbebac46-0813-44ac-80ca-6d3ead01a166\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " Sep 19 00:04:30.096870 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.096807 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-bundle\") pod \"cbebac46-0813-44ac-80ca-6d3ead01a166\" (UID: \"cbebac46-0813-44ac-80ca-6d3ead01a166\") " Sep 19 00:04:30.097484 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.097458 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-bundle" (OuterVolumeSpecName: "bundle") pod "cbebac46-0813-44ac-80ca-6d3ead01a166" (UID: "cbebac46-0813-44ac-80ca-6d3ead01a166"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:04:30.098852 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.098822 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbebac46-0813-44ac-80ca-6d3ead01a166-kube-api-access-qhkf7" (OuterVolumeSpecName: "kube-api-access-qhkf7") pod "cbebac46-0813-44ac-80ca-6d3ead01a166" (UID: "cbebac46-0813-44ac-80ca-6d3ead01a166"). InnerVolumeSpecName "kube-api-access-qhkf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:04:30.132845 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.132819 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-util" (OuterVolumeSpecName: "util") pod "cbebac46-0813-44ac-80ca-6d3ead01a166" (UID: "cbebac46-0813-44ac-80ca-6d3ead01a166"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:04:30.199914 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.199830 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:04:30.199914 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.199857 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhkf7\" (UniqueName: \"kubernetes.io/projected/cbebac46-0813-44ac-80ca-6d3ead01a166-kube-api-access-qhkf7\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:04:30.199914 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.199866 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cbebac46-0813-44ac-80ca-6d3ead01a166-util\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:04:30.896631 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.896605 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" Sep 19 00:04:30.897024 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.896635 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0r8hwl" event={"ID":"cbebac46-0813-44ac-80ca-6d3ead01a166","Type":"ContainerDied","Data":"a79a93447744b0152765671e7a74a5b790734e1726804787a8a23775e442ce07"} Sep 19 00:04:30.897024 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.896705 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a79a93447744b0152765671e7a74a5b790734e1726804787a8a23775e442ce07" Sep 19 00:04:30.897024 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:30.896935 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:41.904765 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:41.904710 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-577c99c85d-lfg8s" Sep 19 00:04:43.520121 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:43.520068 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:43.627924 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:43.627876 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:48.978080 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:48.978039 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:49.046696 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.046662 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q"] Sep 19 00:04:49.047060 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.047032 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerName="util" Sep 19 00:04:49.047060 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.047048 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerName="util" Sep 19 00:04:49.047060 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.047062 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerName="extract" Sep 19 00:04:49.047196 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.047068 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerName="extract" Sep 19 00:04:49.047196 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.047096 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerName="pull" Sep 19 00:04:49.047196 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.047103 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerName="pull" Sep 19 00:04:49.047196 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.047155 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbebac46-0813-44ac-80ca-6d3ead01a166" containerName="extract" Sep 19 00:04:49.049330 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.049309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.052418 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.052384 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 19 00:04:49.052516 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.052448 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rrz4m\"" Sep 19 00:04:49.053373 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.053354 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 19 00:04:49.061580 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.061559 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q"] Sep 19 00:04:49.132785 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.132751 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbz8m\" (UniqueName: \"kubernetes.io/projected/a1e6c924-ab18-4e2d-b2cf-04019855f989-kube-api-access-tbz8m\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.132785 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.132788 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1e6c924-ab18-4e2d-b2cf-04019855f989-tmp\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.132994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.132806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e6c924-ab18-4e2d-b2cf-04019855f989-tls-certs\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.233280 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.233188 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbz8m\" (UniqueName: \"kubernetes.io/projected/a1e6c924-ab18-4e2d-b2cf-04019855f989-kube-api-access-tbz8m\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.233280 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.233237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1e6c924-ab18-4e2d-b2cf-04019855f989-tmp\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.233280 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.233264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e6c924-ab18-4e2d-b2cf-04019855f989-tls-certs\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.233508 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:04:49.233444 2568 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 19 00:04:49.233545 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:04:49.233519 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1e6c924-ab18-4e2d-b2cf-04019855f989-tls-certs podName:a1e6c924-ab18-4e2d-b2cf-04019855f989 nodeName:}" failed. No retries permitted until 2026-09-19 00:04:49.7334928 +0000 UTC m=+392.152217186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a1e6c924-ab18-4e2d-b2cf-04019855f989-tls-certs") pod "kube-auth-proxy-755c79bd44-d8d7q" (UID: "a1e6c924-ab18-4e2d-b2cf-04019855f989") : secret "kube-auth-proxy-tls" not found Sep 19 00:04:49.235608 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.235577 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1e6c924-ab18-4e2d-b2cf-04019855f989-tmp\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.242369 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.242342 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbz8m\" (UniqueName: \"kubernetes.io/projected/a1e6c924-ab18-4e2d-b2cf-04019855f989-kube-api-access-tbz8m\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.305534 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.305504 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:49.737388 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.737353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e6c924-ab18-4e2d-b2cf-04019855f989-tls-certs\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.739874 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.739841 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1e6c924-ab18-4e2d-b2cf-04019855f989-tls-certs\") pod \"kube-auth-proxy-755c79bd44-d8d7q\" (UID: \"a1e6c924-ab18-4e2d-b2cf-04019855f989\") " pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.958788 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.958756 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" Sep 19 00:04:49.987245 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.987216 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:49.994672 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.994611 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh"] Sep 19 00:04:49.997919 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:49.997345 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.000072 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.000054 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 19 00:04:50.000322 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.000305 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 19 00:04:50.000420 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.000384 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9hhtq\"" Sep 19 00:04:50.000489 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.000356 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 19 00:04:50.000576 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.000357 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 19 00:04:50.010672 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.010603 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh"] Sep 19 00:04:50.040511 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.040483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnzlt\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-kube-api-access-tnzlt\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.040649 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.040531 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.040690 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.040665 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/501a0603-15cf-423c-8bad-ee94b4dd72e5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.040725 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.040697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.040759 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.040726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.040794 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.040765 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.040968 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.040947 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.046400 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.046377 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:50.141330 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.141299 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.141444 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.141339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnzlt\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-kube-api-access-tnzlt\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.141598 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.141586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.141648 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.141626 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/501a0603-15cf-423c-8bad-ee94b4dd72e5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.141684 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.141654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.141726 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.141680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.141726 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.141710 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.142392 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.142367 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.144064 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.144041 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.144146 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.144046 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/501a0603-15cf-423c-8bad-ee94b4dd72e5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.144183 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.144146 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.144221 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.144206 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.148881 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.148857 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.149271 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.149253 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnzlt\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-kube-api-access-tnzlt\") pod \"istiod-openshift-gateway-7b7995d5cd-842vh\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.250698 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.250669 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q"] Sep 19 00:04:50.252340 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:04:50.252314 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e6c924_ab18_4e2d_b2cf_04019855f989.slice/crio-debf7ca9392757d247d1b14c1d3e409b49339038481b8797045bb2f16851de78 WatchSource:0}: Error finding container debf7ca9392757d247d1b14c1d3e409b49339038481b8797045bb2f16851de78: Status 404 returned error can't find the container with id debf7ca9392757d247d1b14c1d3e409b49339038481b8797045bb2f16851de78 Sep 19 00:04:50.307442 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.307407 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:50.581536 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.581509 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh"] Sep 19 00:04:50.583098 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:04:50.583061 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501a0603_15cf_423c_8bad_ee94b4dd72e5.slice/crio-e8af4d11e14c4e965098c1899a59b529b788e4f70b1f58f184b1a15851fbff9b WatchSource:0}: Error finding container e8af4d11e14c4e965098c1899a59b529b788e4f70b1f58f184b1a15851fbff9b: Status 404 returned error can't find the container with id e8af4d11e14c4e965098c1899a59b529b788e4f70b1f58f184b1a15851fbff9b Sep 19 00:04:50.902169 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.902133 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:50.992968 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.992930 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" event={"ID":"a1e6c924-ab18-4e2d-b2cf-04019855f989","Type":"ContainerStarted","Data":"debf7ca9392757d247d1b14c1d3e409b49339038481b8797045bb2f16851de78"} Sep 19 00:04:50.994235 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:50.994210 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" event={"ID":"501a0603-15cf-423c-8bad-ee94b4dd72e5","Type":"ContainerStarted","Data":"e8af4d11e14c4e965098c1899a59b529b788e4f70b1f58f184b1a15851fbff9b"} Sep 19 00:04:54.195286 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:54.195240 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:04:54.195593 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:54.195332 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:04:54.546704 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:54.546630 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:54.646575 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:54.646546 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:54.747435 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:54.747402 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:54.847936 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:54.847834 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:54.948014 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:54.947979 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:55.021381 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.021341 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" event={"ID":"501a0603-15cf-423c-8bad-ee94b4dd72e5","Type":"ContainerStarted","Data":"bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb"} Sep 19 00:04:55.021570 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.021532 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:04:55.023079 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.023037 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-842vh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 19 00:04:55.023182 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.023114 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" podUID="501a0603-15cf-423c-8bad-ee94b4dd72e5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 19 00:04:55.023869 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.023845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" event={"ID":"a1e6c924-ab18-4e2d-b2cf-04019855f989","Type":"ContainerStarted","Data":"a952e4b6dd9897b7c1e014d20ccacae1342680ca3741ac4bbfdade76da74228a"} Sep 19 00:04:55.042780 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.042729 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" podStartSLOduration=2.433063168 podStartE2EDuration="6.042715636s" totalImagesPullingTime="3.609652468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:04:55.041779482 +0000 UTC m=+397.460503891" watchObservedRunningTime="2026-09-19 00:04:55.042715636 +0000 UTC m=+397.461440045" Sep 19 00:04:55.063268 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.063222 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-755c79bd44-d8d7q" podStartSLOduration=2.120839724 podStartE2EDuration="6.063207649s" totalImagesPullingTime="3.942367925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:04:55.061250238 +0000 UTC m=+397.479974650" watchObservedRunningTime="2026-09-19 00:04:55.063207649 +0000 UTC m=+397.481932076" Sep 19 00:04:55.063715 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.063695 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:55.173473 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.173440 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:55.280328 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.280294 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:55.497730 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.497655 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:55.721671 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:55.721635 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:04:56.029218 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:04:56.029192 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:05:01.353650 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.353614 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x"] Sep 19 00:05:01.428512 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.428481 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x"] Sep 19 00:05:01.428672 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.428600 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.550180 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.550145 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlhdt\" (UniqueName: \"kubernetes.io/projected/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-kube-api-access-xlhdt\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.550342 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.550209 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.550342 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.550238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.550342 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.550262 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.550342 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.550298 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.550474 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.550346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.550474 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.550392 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.651485 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.651454 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlhdt\" (UniqueName: \"kubernetes.io/projected/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-kube-api-access-xlhdt\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.651690 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.651516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.651690 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.651537 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.651690 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.651563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.651690 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.651588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.651690 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.651603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.651690 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.651628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.652402 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.652368 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.654181 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.654154 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.654270 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.654193 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.654270 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.654213 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.654270 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.654246 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.659816 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.659790 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.660098 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.660080 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlhdt\" (UniqueName: \"kubernetes.io/projected/3e1d4a7c-efa0-4045-a409-2ae3cbfe5053-kube-api-access-xlhdt\") pod \"istiod-openshift-gateway-5677ccb49b-tx58x\" (UID: \"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:01.739211 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:01.739180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:02.020126 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:05:02.020094 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1d4a7c_efa0_4045_a409_2ae3cbfe5053.slice/crio-28ecc635294ace8f0f71afd3e2a782823c19d9bb8b47403d9f4406c83c5a5992 WatchSource:0}: Error finding container 28ecc635294ace8f0f71afd3e2a782823c19d9bb8b47403d9f4406c83c5a5992: Status 404 returned error can't find the container with id 28ecc635294ace8f0f71afd3e2a782823c19d9bb8b47403d9f4406c83c5a5992 Sep 19 00:05:02.023011 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:02.022989 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x"] Sep 19 00:05:02.023532 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:02.023498 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:05:02.023630 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:02.023587 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:05:02.058877 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:02.058840 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" event={"ID":"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053","Type":"ContainerStarted","Data":"28ecc635294ace8f0f71afd3e2a782823c19d9bb8b47403d9f4406c83c5a5992"} Sep 19 00:05:03.065306 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.065266 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" event={"ID":"3e1d4a7c-efa0-4045-a409-2ae3cbfe5053","Type":"ContainerStarted","Data":"6b5babdc2a837e8583ec3054f55c2a9df89eb7990b777ae7668d51135b5b29d4"} Sep 19 00:05:03.065655 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.065324 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:03.066844 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.066816 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" Sep 19 00:05:03.091695 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.091633 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tx58x" podStartSLOduration=2.091615489 podStartE2EDuration="2.091615489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:05:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:05:03.088480511 +0000 UTC m=+405.507204919" watchObservedRunningTime="2026-09-19 00:05:03.091615489 +0000 UTC m=+405.510339899" Sep 19 00:05:03.156630 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.156588 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh"] Sep 19 00:05:03.156840 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.156806 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" podUID="501a0603-15cf-423c-8bad-ee94b4dd72e5" containerName="discovery" containerID="cri-o://bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb" gracePeriod=30 Sep 19 00:05:03.405782 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.405749 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:05:03.468172 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.468139 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/501a0603-15cf-423c-8bad-ee94b4dd72e5-local-certs\") pod \"501a0603-15cf-423c-8bad-ee94b4dd72e5\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " Sep 19 00:05:03.468363 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.468184 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-kubeconfig\") pod \"501a0603-15cf-423c-8bad-ee94b4dd72e5\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " Sep 19 00:05:03.468363 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.468214 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-ca-configmap\") pod \"501a0603-15cf-423c-8bad-ee94b4dd72e5\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " Sep 19 00:05:03.468363 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.468247 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnzlt\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-kube-api-access-tnzlt\") pod \"501a0603-15cf-423c-8bad-ee94b4dd72e5\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " Sep 19 00:05:03.468363 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.468318 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-dns-cert\") pod \"501a0603-15cf-423c-8bad-ee94b4dd72e5\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " Sep 19 00:05:03.468363 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.468341 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-token\") pod \"501a0603-15cf-423c-8bad-ee94b4dd72e5\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " Sep 19 00:05:03.468617 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.468402 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-cacerts\") pod \"501a0603-15cf-423c-8bad-ee94b4dd72e5\" (UID: \"501a0603-15cf-423c-8bad-ee94b4dd72e5\") " Sep 19 00:05:03.470307 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.470269 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "501a0603-15cf-423c-8bad-ee94b4dd72e5" (UID: "501a0603-15cf-423c-8bad-ee94b4dd72e5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:05:03.472265 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.472222 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/501a0603-15cf-423c-8bad-ee94b4dd72e5-local-certs" (OuterVolumeSpecName: "local-certs") pod "501a0603-15cf-423c-8bad-ee94b4dd72e5" (UID: "501a0603-15cf-423c-8bad-ee94b4dd72e5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:05:03.472265 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.472246 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "501a0603-15cf-423c-8bad-ee94b4dd72e5" (UID: "501a0603-15cf-423c-8bad-ee94b4dd72e5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:05:03.472541 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.472514 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-kube-api-access-tnzlt" (OuterVolumeSpecName: "kube-api-access-tnzlt") pod "501a0603-15cf-423c-8bad-ee94b4dd72e5" (UID: "501a0603-15cf-423c-8bad-ee94b4dd72e5"). InnerVolumeSpecName "kube-api-access-tnzlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:05:03.472541 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.472534 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-cacerts" (OuterVolumeSpecName: "cacerts") pod "501a0603-15cf-423c-8bad-ee94b4dd72e5" (UID: "501a0603-15cf-423c-8bad-ee94b4dd72e5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:05:03.472678 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.472594 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "501a0603-15cf-423c-8bad-ee94b4dd72e5" (UID: "501a0603-15cf-423c-8bad-ee94b4dd72e5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:05:03.472678 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.472597 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "501a0603-15cf-423c-8bad-ee94b4dd72e5" (UID: "501a0603-15cf-423c-8bad-ee94b4dd72e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:05:03.569522 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.569489 2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-cacerts\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:05:03.569522 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.569516 2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/501a0603-15cf-423c-8bad-ee94b4dd72e5-local-certs\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:05:03.569522 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.569526 2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-kubeconfig\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:05:03.569755 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.569535 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-ca-configmap\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:05:03.569755 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.569546 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnzlt\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-kube-api-access-tnzlt\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:05:03.569755 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.569554 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-csr-dns-cert\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:05:03.569755 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.569562 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/501a0603-15cf-423c-8bad-ee94b4dd72e5-istio-token\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:05:03.870600 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.870567 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:03.944763 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.944724 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258"] Sep 19 00:05:03.945125 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.945106 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="501a0603-15cf-423c-8bad-ee94b4dd72e5" containerName="discovery" Sep 19 00:05:03.945174 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.945129 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="501a0603-15cf-423c-8bad-ee94b4dd72e5" containerName="discovery" Sep 19 00:05:03.945209 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.945204 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="501a0603-15cf-423c-8bad-ee94b4dd72e5" containerName="discovery" Sep 19 00:05:03.947854 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.947833 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:03.950532 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.950511 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vd29x\"" Sep 19 00:05:03.950859 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.950557 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 19 00:05:03.960489 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.960372 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:03.961154 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:03.961127 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258"] Sep 19 00:05:04.071956 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.071925 2568 generic.go:356] "Generic (PLEG): container finished" podID="501a0603-15cf-423c-8bad-ee94b4dd72e5" containerID="bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb" exitCode=0 Sep 19 00:05:04.072325 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.071999 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" event={"ID":"501a0603-15cf-423c-8bad-ee94b4dd72e5","Type":"ContainerDied","Data":"bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb"} Sep 19 00:05:04.072325 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.072040 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" Sep 19 00:05:04.072325 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.072063 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh" event={"ID":"501a0603-15cf-423c-8bad-ee94b4dd72e5","Type":"ContainerDied","Data":"e8af4d11e14c4e965098c1899a59b529b788e4f70b1f58f184b1a15851fbff9b"} Sep 19 00:05:04.072325 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.072087 2568 scope.go:117] "RemoveContainer" containerID="bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb" Sep 19 00:05:04.072496 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.072381 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf29c\" (UniqueName: \"kubernetes.io/projected/a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164-kube-api-access-vf29c\") pod \"llmisvc-controller-manager-777c6bd7d5-b4258\" (UID: \"a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:04.072496 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.072444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b4258\" (UID: \"a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:04.081427 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.081398 2568 scope.go:117] "RemoveContainer" containerID="bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb" Sep 19 00:05:04.081684 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:05:04.081665 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb\": container with ID starting with bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb not found: ID does not exist" containerID="bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb" Sep 19 00:05:04.081742 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.081696 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb"} err="failed to get container status \"bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb\": rpc error: code = NotFound desc = could not find container \"bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb\": container with ID starting with bcb8d4e20a4cba915b1f97005bd452bb69b0970f6054390f8546df56fa661dcb not found: ID does not exist" Sep 19 00:05:04.094732 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.094710 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh"] Sep 19 00:05:04.101136 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.101110 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-842vh"] Sep 19 00:05:04.160481 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.160393 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:04.173844 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.173809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf29c\" (UniqueName: \"kubernetes.io/projected/a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164-kube-api-access-vf29c\") pod \"llmisvc-controller-manager-777c6bd7d5-b4258\" (UID: \"a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:04.174013 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.173905 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b4258\" (UID: \"a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:04.183918 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.183862 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b4258\" (UID: \"a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:04.191019 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.190988 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf29c\" (UniqueName: \"kubernetes.io/projected/a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164-kube-api-access-vf29c\") pod \"llmisvc-controller-manager-777c6bd7d5-b4258\" (UID: \"a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:04.261524 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.261482 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:04.272576 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.272547 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:04.539025 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:04.538999 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258"] Sep 19 00:05:04.540796 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:05:04.540764 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda6c5a7e3_206d_4cdc_a8b1_cdc5fdd02164.slice/crio-e58abfb8f626bc38f3ea4fe77db541e14e8efb1e1d6173fdcc51bacf91489864 WatchSource:0}: Error finding container e58abfb8f626bc38f3ea4fe77db541e14e8efb1e1d6173fdcc51bacf91489864: Status 404 returned error can't find the container with id e58abfb8f626bc38f3ea4fe77db541e14e8efb1e1d6173fdcc51bacf91489864 Sep 19 00:05:05.078315 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:05.078279 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" event={"ID":"a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164","Type":"ContainerStarted","Data":"e58abfb8f626bc38f3ea4fe77db541e14e8efb1e1d6173fdcc51bacf91489864"} Sep 19 00:05:05.190811 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:05.190781 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:05.281647 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:05.281617 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:06.023702 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:06.023672 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="501a0603-15cf-423c-8bad-ee94b4dd72e5" path="/var/lib/kubelet/pods/501a0603-15cf-423c-8bad-ee94b4dd72e5/volumes" Sep 19 00:05:08.098316 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.098278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" event={"ID":"a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164","Type":"ContainerStarted","Data":"133ccdaf15d69d6c2ea2cb57bdd6c99a8301420c0cd18457c5208abbeccb49e8"} Sep 19 00:05:08.098683 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.098447 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:08.115802 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.115756 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" podStartSLOduration=2.039161864 podStartE2EDuration="5.115741695s" totalImagesPullingTime="3.076579831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:05:08.113013662 +0000 UTC m=+410.531738069" watchObservedRunningTime="2026-09-19 00:05:08.115741695 +0000 UTC m=+410.534466103" Sep 19 00:05:08.232702 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.232667 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bf744cc95-cgjhc"] Sep 19 00:05:08.236514 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.236490 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.239324 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.239290 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 19 00:05:08.239510 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.239479 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 19 00:05:08.239614 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.239568 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 19 00:05:08.239788 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.239770 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 19 00:05:08.239931 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.239912 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 19 00:05:08.240526 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.240508 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 19 00:05:08.240783 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.240765 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 19 00:05:08.241146 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.241120 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jsngw\"" Sep 19 00:05:08.245026 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.244846 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 19 00:05:08.249266 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.248349 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf744cc95-cgjhc"] Sep 19 00:05:08.301532 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.301497 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:08.313773 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.313744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-config\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.313918 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.313780 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-oauth-serving-cert\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.313918 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.313801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-oauth-config\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.313918 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.313858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-serving-cert\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.313918 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.313874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jspb\" (UniqueName: \"kubernetes.io/projected/fdee2c08-61a7-4809-bd77-992b2b8abf66-kube-api-access-8jspb\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.314171 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.314021 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-service-ca\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.314171 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.314060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-trusted-ca-bundle\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.396373 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.396335 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:08.415421 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.415395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-serving-cert\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.415583 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.415426 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jspb\" (UniqueName: \"kubernetes.io/projected/fdee2c08-61a7-4809-bd77-992b2b8abf66-kube-api-access-8jspb\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.415583 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.415567 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-service-ca\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.415709 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.415599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-trusted-ca-bundle\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.415709 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.415645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-config\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.415709 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.415667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-oauth-serving-cert\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.415709 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.415702 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-oauth-config\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.416360 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.416335 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-service-ca\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.416477 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.416454 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-config\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.416521 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.416454 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-oauth-serving-cert\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.416573 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.416531 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdee2c08-61a7-4809-bd77-992b2b8abf66-trusted-ca-bundle\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.418103 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.418084 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-serving-cert\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.418196 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.418115 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdee2c08-61a7-4809-bd77-992b2b8abf66-console-oauth-config\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.422833 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.422812 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jspb\" (UniqueName: \"kubernetes.io/projected/fdee2c08-61a7-4809-bd77-992b2b8abf66-kube-api-access-8jspb\") pod \"console-5bf744cc95-cgjhc\" (UID: \"fdee2c08-61a7-4809-bd77-992b2b8abf66\") " pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.557788 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.557748 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:08.830021 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:08.829997 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf744cc95-cgjhc"] Sep 19 00:05:08.832269 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:05:08.832235 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdee2c08_61a7_4809_bd77_992b2b8abf66.slice/crio-0e7a70d0524608d46c7e795a78e0a14f39dc0d0f30bbb43b6762cd0f70013e9b WatchSource:0}: Error finding container 0e7a70d0524608d46c7e795a78e0a14f39dc0d0f30bbb43b6762cd0f70013e9b: Status 404 returned error can't find the container with id 0e7a70d0524608d46c7e795a78e0a14f39dc0d0f30bbb43b6762cd0f70013e9b Sep 19 00:05:09.104667 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:09.104569 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf744cc95-cgjhc" event={"ID":"fdee2c08-61a7-4809-bd77-992b2b8abf66","Type":"ContainerStarted","Data":"4c98e71ce0e246a37c0d2e1a32ab54e33d437baccb450b3f35ef17c940556e17"} Sep 19 00:05:09.104667 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:09.104620 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf744cc95-cgjhc" event={"ID":"fdee2c08-61a7-4809-bd77-992b2b8abf66","Type":"ContainerStarted","Data":"0e7a70d0524608d46c7e795a78e0a14f39dc0d0f30bbb43b6762cd0f70013e9b"} Sep 19 00:05:09.121089 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:09.121039 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bf744cc95-cgjhc" podStartSLOduration=1.121022697 podStartE2EDuration="1.121022697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:05:09.120086767 +0000 UTC m=+411.538811174" watchObservedRunningTime="2026-09-19 00:05:09.121022697 +0000 UTC m=+411.539747105" Sep 19 00:05:17.243632 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:17.243599 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:18.557945 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:18.557914 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:18.558353 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:18.557967 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:18.562520 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:18.562494 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:19.157567 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:19.157539 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bf744cc95-cgjhc" Sep 19 00:05:19.300448 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:19.300411 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:19.353678 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:19.353635 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:19.407668 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:19.407548 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:39.107005 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:39.106973 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b4258" Sep 19 00:05:55.640576 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:55.640494 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:55.703271 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:55.703226 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:05:59.048021 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.047979 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps"] Sep 19 00:05:59.050735 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.050711 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.053495 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.053475 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lnsmc\"" Sep 19 00:05:59.053606 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.053481 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 19 00:05:59.054702 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.054683 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 19 00:05:59.061099 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.061070 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps"] Sep 19 00:05:59.142233 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.142198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qk4f\" (UniqueName: \"kubernetes.io/projected/d70c907a-3662-4fb6-9474-8da67891c9bc-kube-api-access-4qk4f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.142433 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.142354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.142433 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.142384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.150093 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.150065 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6"] Sep 19 00:05:59.152605 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.152589 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.162140 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.162110 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6"] Sep 19 00:05:59.242206 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.242172 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv"] Sep 19 00:05:59.243261 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.243239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qk4f\" (UniqueName: \"kubernetes.io/projected/d70c907a-3662-4fb6-9474-8da67891c9bc-kube-api-access-4qk4f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.243367 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.243307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.243367 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.243341 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsx7h\" (UniqueName: \"kubernetes.io/projected/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-kube-api-access-fsx7h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.243462 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.243440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.243506 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.243469 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.243506 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.243485 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.243810 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.243792 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.243877 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.243820 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.244737 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.244723 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.251714 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.251114 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qk4f\" (UniqueName: \"kubernetes.io/projected/d70c907a-3662-4fb6-9474-8da67891c9bc-kube-api-access-4qk4f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.254015 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.253995 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv"] Sep 19 00:05:59.344363 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.344281 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.344525 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.344438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.344525 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.344479 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsx7h\" (UniqueName: \"kubernetes.io/projected/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-kube-api-access-fsx7h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.344650 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.344548 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.344650 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.344591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjsqv\" (UniqueName: \"kubernetes.io/projected/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-kube-api-access-tjsqv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.344754 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.344677 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.344911 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.344869 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.344989 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.344944 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.346587 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.346568 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn"] Sep 19 00:05:59.349241 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.349227 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.352596 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.352571 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsx7h\" (UniqueName: \"kubernetes.io/projected/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-kube-api-access-fsx7h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.358906 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.358869 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn"] Sep 19 00:05:59.360561 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.360536 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:05:59.445272 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.445243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.445428 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.445313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.445428 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.445336 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9bk\" (UniqueName: \"kubernetes.io/projected/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-kube-api-access-nk9bk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.445428 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.445356 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjsqv\" (UniqueName: \"kubernetes.io/projected/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-kube-api-access-tjsqv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.445428 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.445396 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.445428 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.445414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.445733 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.445692 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.445733 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.445701 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.457247 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.457218 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjsqv\" (UniqueName: \"kubernetes.io/projected/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-kube-api-access-tjsqv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.462845 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.462826 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:05:59.546542 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.546513 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.546671 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.546550 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9bk\" (UniqueName: \"kubernetes.io/projected/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-kube-api-access-nk9bk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.546671 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.546612 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.547084 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.547063 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.547084 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.547071 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.554712 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.554692 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9bk\" (UniqueName: \"kubernetes.io/projected/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-kube-api-access-nk9bk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.562472 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.562455 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:05:59.634605 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.634565 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps"] Sep 19 00:05:59.636779 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:05:59.636755 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70c907a_3662_4fb6_9474_8da67891c9bc.slice/crio-17b759b5ae89fa1ec7c384caea581ce2fa86d54afa98cf545981b807f80531be WatchSource:0}: Error finding container 17b759b5ae89fa1ec7c384caea581ce2fa86d54afa98cf545981b807f80531be: Status 404 returned error can't find the container with id 17b759b5ae89fa1ec7c384caea581ce2fa86d54afa98cf545981b807f80531be Sep 19 00:05:59.667098 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.667079 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:05:59.735662 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.735634 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6"] Sep 19 00:05:59.737019 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:05:59.736989 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c74bd8_1fc6_43b0_a83c_9edfb452fd24.slice/crio-159a36253b4fbe5adae1e727bbdb959daf1ad7712f6cb1b9956089009bfd1953 WatchSource:0}: Error finding container 159a36253b4fbe5adae1e727bbdb959daf1ad7712f6cb1b9956089009bfd1953: Status 404 returned error can't find the container with id 159a36253b4fbe5adae1e727bbdb959daf1ad7712f6cb1b9956089009bfd1953 Sep 19 00:05:59.835974 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.835947 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv"] Sep 19 00:05:59.837672 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:05:59.837644 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12503f67_58ae_4ff9_b17a_5a47d0fa06ab.slice/crio-3468478aaba3899e647fc82a06acdcc69ed26f8db46ca5fdb9849e69cc25c267 WatchSource:0}: Error finding container 3468478aaba3899e647fc82a06acdcc69ed26f8db46ca5fdb9849e69cc25c267: Status 404 returned error can't find the container with id 3468478aaba3899e647fc82a06acdcc69ed26f8db46ca5fdb9849e69cc25c267 Sep 19 00:05:59.938506 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:05:59.938484 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn"] Sep 19 00:05:59.940284 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:05:59.940258 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd90d58e_32bd_4f40_8dc9_9fa877d8cb0f.slice/crio-e29f4d3de47fccac5f65b6acc42780ebf2efc544965cbf032312ebddbc406b1c WatchSource:0}: Error finding container e29f4d3de47fccac5f65b6acc42780ebf2efc544965cbf032312ebddbc406b1c: Status 404 returned error can't find the container with id e29f4d3de47fccac5f65b6acc42780ebf2efc544965cbf032312ebddbc406b1c Sep 19 00:06:00.361070 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.360987 2568 generic.go:356] "Generic (PLEG): container finished" podID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerID="6136f7fe0954524fc901f113a6f85599968651d7b1481366dd0ee7bf64342700" exitCode=0 Sep 19 00:06:00.361466 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.361085 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" event={"ID":"03c74bd8-1fc6-43b0-a83c-9edfb452fd24","Type":"ContainerDied","Data":"6136f7fe0954524fc901f113a6f85599968651d7b1481366dd0ee7bf64342700"} Sep 19 00:06:00.361466 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.361153 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" event={"ID":"03c74bd8-1fc6-43b0-a83c-9edfb452fd24","Type":"ContainerStarted","Data":"159a36253b4fbe5adae1e727bbdb959daf1ad7712f6cb1b9956089009bfd1953"} Sep 19 00:06:00.365655 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.364076 2568 generic.go:356] "Generic (PLEG): container finished" podID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerID="22573353e32f8daad3bd56f87182b99dceb53ab1fed24272ef39b5a4542f6a8f" exitCode=0 Sep 19 00:06:00.365655 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.364165 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" event={"ID":"d70c907a-3662-4fb6-9474-8da67891c9bc","Type":"ContainerDied","Data":"22573353e32f8daad3bd56f87182b99dceb53ab1fed24272ef39b5a4542f6a8f"} Sep 19 00:06:00.365655 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.364200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" event={"ID":"d70c907a-3662-4fb6-9474-8da67891c9bc","Type":"ContainerStarted","Data":"17b759b5ae89fa1ec7c384caea581ce2fa86d54afa98cf545981b807f80531be"} Sep 19 00:06:00.367762 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.367740 2568 generic.go:356] "Generic (PLEG): container finished" podID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerID="6e6ca2f74785606d2b3d4d8431e81d25cf5125a1e6cdbc50a6a4a4ba35a08fd0" exitCode=0 Sep 19 00:06:00.367866 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.367808 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" event={"ID":"12503f67-58ae-4ff9-b17a-5a47d0fa06ab","Type":"ContainerDied","Data":"6e6ca2f74785606d2b3d4d8431e81d25cf5125a1e6cdbc50a6a4a4ba35a08fd0"} Sep 19 00:06:00.367866 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.367845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" event={"ID":"12503f67-58ae-4ff9-b17a-5a47d0fa06ab","Type":"ContainerStarted","Data":"3468478aaba3899e647fc82a06acdcc69ed26f8db46ca5fdb9849e69cc25c267"} Sep 19 00:06:00.369727 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.369708 2568 generic.go:356] "Generic (PLEG): container finished" podID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerID="a7205659e3acab2f4f285924ec52f2eddb835893693066b5527786d08b4914ca" exitCode=0 Sep 19 00:06:00.369795 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.369748 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" event={"ID":"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f","Type":"ContainerDied","Data":"a7205659e3acab2f4f285924ec52f2eddb835893693066b5527786d08b4914ca"} Sep 19 00:06:00.369795 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:00.369779 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" event={"ID":"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f","Type":"ContainerStarted","Data":"e29f4d3de47fccac5f65b6acc42780ebf2efc544965cbf032312ebddbc406b1c"} Sep 19 00:06:01.376958 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:01.376925 2568 generic.go:356] "Generic (PLEG): container finished" podID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerID="494a968c9ba336a5866bab7a3ddf3ec84ca91da53abfdacb8672c47309d57b50" exitCode=0 Sep 19 00:06:01.377343 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:01.377015 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" event={"ID":"03c74bd8-1fc6-43b0-a83c-9edfb452fd24","Type":"ContainerDied","Data":"494a968c9ba336a5866bab7a3ddf3ec84ca91da53abfdacb8672c47309d57b50"} Sep 19 00:06:01.379104 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:01.379081 2568 generic.go:356] "Generic (PLEG): container finished" podID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerID="86cd18e316e673e6cee281cdb75f659cfc57c16e5c0eff0a36fbe53a348914ee" exitCode=0 Sep 19 00:06:01.379206 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:01.379168 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" event={"ID":"d70c907a-3662-4fb6-9474-8da67891c9bc","Type":"ContainerDied","Data":"86cd18e316e673e6cee281cdb75f659cfc57c16e5c0eff0a36fbe53a348914ee"} Sep 19 00:06:01.381158 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:01.381132 2568 generic.go:356] "Generic (PLEG): container finished" podID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerID="11b040ab06c08dbe7211ae3e7b5e16b8e8ec0d764c9f23a1a827463f878527e6" exitCode=0 Sep 19 00:06:01.381241 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:01.381180 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" event={"ID":"12503f67-58ae-4ff9-b17a-5a47d0fa06ab","Type":"ContainerDied","Data":"11b040ab06c08dbe7211ae3e7b5e16b8e8ec0d764c9f23a1a827463f878527e6"} Sep 19 00:06:02.388930 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:02.388882 2568 generic.go:356] "Generic (PLEG): container finished" podID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerID="b2ab93d9268778ad9eff0c2274fd33bb3e9a6009ed76d64a4639ba0929a15bed" exitCode=0 Sep 19 00:06:02.389326 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:02.388923 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" event={"ID":"d70c907a-3662-4fb6-9474-8da67891c9bc","Type":"ContainerDied","Data":"b2ab93d9268778ad9eff0c2274fd33bb3e9a6009ed76d64a4639ba0929a15bed"} Sep 19 00:06:02.391064 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:02.391039 2568 generic.go:356] "Generic (PLEG): container finished" podID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerID="5ea2451c461c15bca3db61849dd59c8450c16f8ed4d5302fa2d50517ece98238" exitCode=0 Sep 19 00:06:02.391175 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:02.391115 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" event={"ID":"12503f67-58ae-4ff9-b17a-5a47d0fa06ab","Type":"ContainerDied","Data":"5ea2451c461c15bca3db61849dd59c8450c16f8ed4d5302fa2d50517ece98238"} Sep 19 00:06:02.393000 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:02.392974 2568 generic.go:356] "Generic (PLEG): container finished" podID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerID="0c369ee40a0d66d29ee7dc1d38c0981b6386967907e747f73a2a911dfcdad7b1" exitCode=0 Sep 19 00:06:02.393106 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:02.393057 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" event={"ID":"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f","Type":"ContainerDied","Data":"0c369ee40a0d66d29ee7dc1d38c0981b6386967907e747f73a2a911dfcdad7b1"} Sep 19 00:06:02.395203 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:02.395186 2568 generic.go:356] "Generic (PLEG): container finished" podID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerID="1510dd841358e35f3b594d9adab12b03fb57c4ff9ffebc6ef9c184c7f83eaeba" exitCode=0 Sep 19 00:06:02.395288 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:02.395238 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" event={"ID":"03c74bd8-1fc6-43b0-a83c-9edfb452fd24","Type":"ContainerDied","Data":"1510dd841358e35f3b594d9adab12b03fb57c4ff9ffebc6ef9c184c7f83eaeba"} Sep 19 00:06:03.402617 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.402582 2568 generic.go:356] "Generic (PLEG): container finished" podID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerID="bd84c84861ccdba98a9879c54402fd060f07ba791bd739fc0ea92a12e7ab7adb" exitCode=0 Sep 19 00:06:03.403010 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.402669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" event={"ID":"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f","Type":"ContainerDied","Data":"bd84c84861ccdba98a9879c54402fd060f07ba791bd739fc0ea92a12e7ab7adb"} Sep 19 00:06:03.551099 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.551068 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:06:03.581628 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.581597 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:06:03.584806 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.584786 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:06:03.684767 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.684690 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-bundle\") pod \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " Sep 19 00:06:03.684767 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.684731 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsx7h\" (UniqueName: \"kubernetes.io/projected/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-kube-api-access-fsx7h\") pod \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " Sep 19 00:06:03.684767 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.684751 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qk4f\" (UniqueName: \"kubernetes.io/projected/d70c907a-3662-4fb6-9474-8da67891c9bc-kube-api-access-4qk4f\") pod \"d70c907a-3662-4fb6-9474-8da67891c9bc\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " Sep 19 00:06:03.685058 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.684775 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjsqv\" (UniqueName: \"kubernetes.io/projected/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-kube-api-access-tjsqv\") pod \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " Sep 19 00:06:03.685058 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.684853 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-bundle\") pod \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " Sep 19 00:06:03.685058 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.684990 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-util\") pod \"d70c907a-3662-4fb6-9474-8da67891c9bc\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " Sep 19 00:06:03.685058 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.685024 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-bundle\") pod \"d70c907a-3662-4fb6-9474-8da67891c9bc\" (UID: \"d70c907a-3662-4fb6-9474-8da67891c9bc\") " Sep 19 00:06:03.685058 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.685049 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-util\") pod \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\" (UID: \"03c74bd8-1fc6-43b0-a83c-9edfb452fd24\") " Sep 19 00:06:03.685333 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.685092 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-util\") pod \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\" (UID: \"12503f67-58ae-4ff9-b17a-5a47d0fa06ab\") " Sep 19 00:06:03.685390 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.685372 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-bundle" (OuterVolumeSpecName: "bundle") pod "12503f67-58ae-4ff9-b17a-5a47d0fa06ab" (UID: "12503f67-58ae-4ff9-b17a-5a47d0fa06ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:03.685443 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.685382 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-bundle" (OuterVolumeSpecName: "bundle") pod "03c74bd8-1fc6-43b0-a83c-9edfb452fd24" (UID: "03c74bd8-1fc6-43b0-a83c-9edfb452fd24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:03.685654 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.685600 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:03.685654 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.685625 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:03.686171 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.686142 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-bundle" (OuterVolumeSpecName: "bundle") pod "d70c907a-3662-4fb6-9474-8da67891c9bc" (UID: "d70c907a-3662-4fb6-9474-8da67891c9bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:03.687381 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.687361 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-kube-api-access-fsx7h" (OuterVolumeSpecName: "kube-api-access-fsx7h") pod "03c74bd8-1fc6-43b0-a83c-9edfb452fd24" (UID: "03c74bd8-1fc6-43b0-a83c-9edfb452fd24"). InnerVolumeSpecName "kube-api-access-fsx7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:06:03.687599 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.687577 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-kube-api-access-tjsqv" (OuterVolumeSpecName: "kube-api-access-tjsqv") pod "12503f67-58ae-4ff9-b17a-5a47d0fa06ab" (UID: "12503f67-58ae-4ff9-b17a-5a47d0fa06ab"). InnerVolumeSpecName "kube-api-access-tjsqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:06:03.687738 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.687711 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d70c907a-3662-4fb6-9474-8da67891c9bc-kube-api-access-4qk4f" (OuterVolumeSpecName: "kube-api-access-4qk4f") pod "d70c907a-3662-4fb6-9474-8da67891c9bc" (UID: "d70c907a-3662-4fb6-9474-8da67891c9bc"). InnerVolumeSpecName "kube-api-access-4qk4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:06:03.690989 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.690955 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-util" (OuterVolumeSpecName: "util") pod "12503f67-58ae-4ff9-b17a-5a47d0fa06ab" (UID: "12503f67-58ae-4ff9-b17a-5a47d0fa06ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:03.693178 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.693156 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-util" (OuterVolumeSpecName: "util") pod "d70c907a-3662-4fb6-9474-8da67891c9bc" (UID: "d70c907a-3662-4fb6-9474-8da67891c9bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:03.693901 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.693873 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-util" (OuterVolumeSpecName: "util") pod "03c74bd8-1fc6-43b0-a83c-9edfb452fd24" (UID: "03c74bd8-1fc6-43b0-a83c-9edfb452fd24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:03.786869 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.786838 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-util\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:03.786869 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.786866 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsx7h\" (UniqueName: \"kubernetes.io/projected/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-kube-api-access-fsx7h\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:03.786869 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.786876 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qk4f\" (UniqueName: \"kubernetes.io/projected/d70c907a-3662-4fb6-9474-8da67891c9bc-kube-api-access-4qk4f\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:03.787113 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.786919 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjsqv\" (UniqueName: \"kubernetes.io/projected/12503f67-58ae-4ff9-b17a-5a47d0fa06ab-kube-api-access-tjsqv\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:03.787113 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.786929 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-util\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:03.787113 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.786937 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d70c907a-3662-4fb6-9474-8da67891c9bc-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:03.787113 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:03.786943 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03c74bd8-1fc6-43b0-a83c-9edfb452fd24-util\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:04.410029 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.410002 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" Sep 19 00:06:04.410029 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.410016 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lkng6" event={"ID":"03c74bd8-1fc6-43b0-a83c-9edfb452fd24","Type":"ContainerDied","Data":"159a36253b4fbe5adae1e727bbdb959daf1ad7712f6cb1b9956089009bfd1953"} Sep 19 00:06:04.410494 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.410060 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="159a36253b4fbe5adae1e727bbdb959daf1ad7712f6cb1b9956089009bfd1953" Sep 19 00:06:04.412178 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.412146 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" Sep 19 00:06:04.412299 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.412150 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2wrps" event={"ID":"d70c907a-3662-4fb6-9474-8da67891c9bc","Type":"ContainerDied","Data":"17b759b5ae89fa1ec7c384caea581ce2fa86d54afa98cf545981b807f80531be"} Sep 19 00:06:04.412299 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.412274 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17b759b5ae89fa1ec7c384caea581ce2fa86d54afa98cf545981b807f80531be" Sep 19 00:06:04.414438 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.414416 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" event={"ID":"12503f67-58ae-4ff9-b17a-5a47d0fa06ab","Type":"ContainerDied","Data":"3468478aaba3899e647fc82a06acdcc69ed26f8db46ca5fdb9849e69cc25c267"} Sep 19 00:06:04.414567 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.414450 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3468478aaba3899e647fc82a06acdcc69ed26f8db46ca5fdb9849e69cc25c267" Sep 19 00:06:04.414567 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.414531 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7l7tsv" Sep 19 00:06:04.537799 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.537776 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:06:04.695574 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.695496 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-util\") pod \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " Sep 19 00:06:04.695574 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.695537 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-bundle\") pod \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " Sep 19 00:06:04.695756 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.695582 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk9bk\" (UniqueName: \"kubernetes.io/projected/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-kube-api-access-nk9bk\") pod \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\" (UID: \"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f\") " Sep 19 00:06:04.696162 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.696136 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-bundle" (OuterVolumeSpecName: "bundle") pod "bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" (UID: "bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:04.697738 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.697709 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-kube-api-access-nk9bk" (OuterVolumeSpecName: "kube-api-access-nk9bk") pod "bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" (UID: "bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f"). InnerVolumeSpecName "kube-api-access-nk9bk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:06:04.703347 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.703320 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-util" (OuterVolumeSpecName: "util") pod "bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" (UID: "bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:04.796206 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.796164 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9bk\" (UniqueName: \"kubernetes.io/projected/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-kube-api-access-nk9bk\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:04.796206 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.796197 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-util\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:04.796206 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:04.796206 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f-bundle\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:05.422246 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:05.422219 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" Sep 19 00:06:05.422618 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:05.422249 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c97nsn" event={"ID":"bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f","Type":"ContainerDied","Data":"e29f4d3de47fccac5f65b6acc42780ebf2efc544965cbf032312ebddbc406b1c"} Sep 19 00:06:05.422618 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:05.422294 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e29f4d3de47fccac5f65b6acc42780ebf2efc544965cbf032312ebddbc406b1c" Sep 19 00:06:05.986845 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:05.986806 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:06.051540 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:06.051508 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:09.135475 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:09.135443 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:11.325054 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:11.325020 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:11.526557 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:11.526495 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:11.925676 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:11.925630 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:13.646433 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646400 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-skfgg"] Sep 19 00:06:13.646801 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646750 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerName="util" Sep 19 00:06:13.646801 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646762 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerName="util" Sep 19 00:06:13.646801 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646768 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerName="extract" Sep 19 00:06:13.646801 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646774 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerName="extract" Sep 19 00:06:13.646801 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646784 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerName="pull" Sep 19 00:06:13.646801 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646789 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerName="pull" Sep 19 00:06:13.646801 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646795 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerName="pull" Sep 19 00:06:13.646801 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646800 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerName="pull" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646808 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerName="pull" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646812 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerName="pull" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646822 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerName="util" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646827 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerName="util" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646833 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerName="util" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646837 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerName="util" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646844 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646850 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646858 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerName="pull" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646862 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerName="pull" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646869 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646873 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646880 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646912 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646922 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerName="util" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646928 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerName="util" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646986 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="12503f67-58ae-4ff9-b17a-5a47d0fa06ab" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.646994 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd90d58e-32bd-4f40-8dc9-9fa877d8cb0f" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.647000 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="03c74bd8-1fc6-43b0-a83c-9edfb452fd24" containerName="extract" Sep 19 00:06:13.647134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.647008 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70c907a-3662-4fb6-9474-8da67891c9bc" containerName="extract" Sep 19 00:06:13.649046 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.649030 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" Sep 19 00:06:13.651652 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.651625 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 19 00:06:13.651786 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.651635 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 19 00:06:13.652669 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.652652 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mjzz6\"" Sep 19 00:06:13.658976 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.658958 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-skfgg"] Sep 19 00:06:13.699022 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.698994 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:13.770282 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.770250 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bw96\" (UniqueName: \"kubernetes.io/projected/6727cc4f-437d-4e4d-8720-71f590ecd826-kube-api-access-5bw96\") pod \"authorino-operator-76b478bd78-skfgg\" (UID: \"6727cc4f-437d-4e4d-8720-71f590ecd826\") " pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" Sep 19 00:06:13.805435 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.805404 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:13.871579 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.871544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bw96\" (UniqueName: \"kubernetes.io/projected/6727cc4f-437d-4e4d-8720-71f590ecd826-kube-api-access-5bw96\") pod \"authorino-operator-76b478bd78-skfgg\" (UID: \"6727cc4f-437d-4e4d-8720-71f590ecd826\") " pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" Sep 19 00:06:13.891078 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.891047 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bw96\" (UniqueName: \"kubernetes.io/projected/6727cc4f-437d-4e4d-8720-71f590ecd826-kube-api-access-5bw96\") pod \"authorino-operator-76b478bd78-skfgg\" (UID: \"6727cc4f-437d-4e4d-8720-71f590ecd826\") " pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" Sep 19 00:06:13.959853 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:13.959769 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" Sep 19 00:06:14.235570 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:14.235540 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-skfgg"] Sep 19 00:06:14.238224 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:06:14.238197 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6727cc4f_437d_4e4d_8720_71f590ecd826.slice/crio-d34627cac15afcfa7089cae267730d9014514ee8bf225ee5f82a5aecf64cc599 WatchSource:0}: Error finding container d34627cac15afcfa7089cae267730d9014514ee8bf225ee5f82a5aecf64cc599: Status 404 returned error can't find the container with id d34627cac15afcfa7089cae267730d9014514ee8bf225ee5f82a5aecf64cc599 Sep 19 00:06:14.333952 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:14.333923 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:14.470857 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:14.470820 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" event={"ID":"6727cc4f-437d-4e4d-8720-71f590ecd826","Type":"ContainerStarted","Data":"d34627cac15afcfa7089cae267730d9014514ee8bf225ee5f82a5aecf64cc599"} Sep 19 00:06:14.722288 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:14.722246 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:15.184899 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:15.184854 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:15.597714 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:15.597630 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:16.564698 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:16.564628 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:18.495645 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:18.495604 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" event={"ID":"6727cc4f-437d-4e4d-8720-71f590ecd826","Type":"ContainerStarted","Data":"f6d461a7255e62873237a01a754aeb73b57fbecd366e753bea9944722e7ed409"} Sep 19 00:06:18.496063 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:18.495736 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" Sep 19 00:06:18.532513 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:18.532455 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" podStartSLOduration=2.175839875 podStartE2EDuration="5.532434444s" totalImagesPullingTime="3.356594569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:06:18.532272477 +0000 UTC m=+480.950996900" watchObservedRunningTime="2026-09-19 00:06:18.532434444 +0000 UTC m=+480.951158860" Sep 19 00:06:18.780990 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:18.780884 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:18.882425 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:18.882395 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:20.431190 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.431155 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588"] Sep 19 00:06:20.433657 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.433640 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" Sep 19 00:06:20.436505 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.436480 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qmwrh\"" Sep 19 00:06:20.436658 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.436621 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 19 00:06:20.445268 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.445246 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588"] Sep 19 00:06:20.532029 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.531997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqbqh\" (UniqueName: \"kubernetes.io/projected/90f54817-09b0-4f1b-ac2b-0fab8c9c4c66-kube-api-access-wqbqh\") pod \"dns-operator-controller-manager-7b84cd7c9c-4m588\" (UID: \"90f54817-09b0-4f1b-ac2b-0fab8c9c4c66\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" Sep 19 00:06:20.633390 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.633351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqbqh\" (UniqueName: \"kubernetes.io/projected/90f54817-09b0-4f1b-ac2b-0fab8c9c4c66-kube-api-access-wqbqh\") pod \"dns-operator-controller-manager-7b84cd7c9c-4m588\" (UID: \"90f54817-09b0-4f1b-ac2b-0fab8c9c4c66\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" Sep 19 00:06:20.642314 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.642289 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqbqh\" (UniqueName: \"kubernetes.io/projected/90f54817-09b0-4f1b-ac2b-0fab8c9c4c66-kube-api-access-wqbqh\") pod \"dns-operator-controller-manager-7b84cd7c9c-4m588\" (UID: \"90f54817-09b0-4f1b-ac2b-0fab8c9c4c66\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" Sep 19 00:06:20.745208 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:20.745129 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" Sep 19 00:06:21.015772 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:21.015749 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588"] Sep 19 00:06:21.017320 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:06:21.017287 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f54817_09b0_4f1b_ac2b_0fab8c9c4c66.slice/crio-d7ebf8469cae0546b35af8eed299b8c7c3f26e584233940185ad0fa39a8c6398 WatchSource:0}: Error finding container d7ebf8469cae0546b35af8eed299b8c7c3f26e584233940185ad0fa39a8c6398: Status 404 returned error can't find the container with id d7ebf8469cae0546b35af8eed299b8c7c3f26e584233940185ad0fa39a8c6398 Sep 19 00:06:21.512067 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:21.512028 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" event={"ID":"90f54817-09b0-4f1b-ac2b-0fab8c9c4c66","Type":"ContainerStarted","Data":"d7ebf8469cae0546b35af8eed299b8c7c3f26e584233940185ad0fa39a8c6398"} Sep 19 00:06:21.734814 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:21.734772 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:21.832774 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:21.832691 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:23.525796 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:23.525756 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" event={"ID":"90f54817-09b0-4f1b-ac2b-0fab8c9c4c66","Type":"ContainerStarted","Data":"16a4769f71ff4d931ae2befdf4346747ac98d356ed722c55593afcfe57b2d9dc"} Sep 19 00:06:23.526210 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:23.525881 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" Sep 19 00:06:23.543317 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:23.543263 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" podStartSLOduration=1.919951233 podStartE2EDuration="3.543247706s" totalImagesPullingTime="1.623296473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:06:23.541234398 +0000 UTC m=+485.959958807" watchObservedRunningTime="2026-09-19 00:06:23.543247706 +0000 UTC m=+485.961972114" Sep 19 00:06:25.546983 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:25.546949 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:25.606784 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:25.606757 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:25.726191 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:25.726159 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:25.826507 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:25.826423 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:26.147621 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:26.147592 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:26.326176 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:26.326149 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:29.503050 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:29.503018 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-skfgg" Sep 19 00:06:30.682174 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:30.682142 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:30.781118 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:30.781081 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:34.533525 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:34.533493 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4m588" Sep 19 00:06:36.136471 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.136434 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz"] Sep 19 00:06:36.139827 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.139810 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:36.142508 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.142485 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-94867\"" Sep 19 00:06:36.150654 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.150627 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz"] Sep 19 00:06:36.158918 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.158880 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtmcq\" (UniqueName: \"kubernetes.io/projected/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-kube-api-access-gtmcq\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-mjjgz\" (UID: \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:36.159004 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.158967 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-mjjgz\" (UID: \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:36.259954 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.259917 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtmcq\" (UniqueName: \"kubernetes.io/projected/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-kube-api-access-gtmcq\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-mjjgz\" (UID: \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:36.260158 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.259983 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-mjjgz\" (UID: \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:36.260355 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.260339 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-mjjgz\" (UID: \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:36.270925 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.270879 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtmcq\" (UniqueName: \"kubernetes.io/projected/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-kube-api-access-gtmcq\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-mjjgz\" (UID: \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:36.451244 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.451160 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:36.730556 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:36.730524 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz"] Sep 19 00:06:36.731692 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:06:36.731665 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda9c515_ec8d_4ea4_8862_aa26f98cd14f.slice/crio-30b058f83f09bbbbf575e55217f0797bed3d79941ff19d02efe6e3413cc3ffc7 WatchSource:0}: Error finding container 30b058f83f09bbbbf575e55217f0797bed3d79941ff19d02efe6e3413cc3ffc7: Status 404 returned error can't find the container with id 30b058f83f09bbbbf575e55217f0797bed3d79941ff19d02efe6e3413cc3ffc7 Sep 19 00:06:37.156527 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.156495 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz"] Sep 19 00:06:37.160832 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.160807 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz"] Sep 19 00:06:37.162219 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.162191 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:37.180573 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.180549 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8"] Sep 19 00:06:37.184513 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.184315 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:37.200225 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.200202 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8"] Sep 19 00:06:37.247513 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.247487 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:37.267652 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.267626 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947cb58c-892e-4a83-99df-14de0bc33c7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-n5jf8\" (UID: \"947cb58c-892e-4a83-99df-14de0bc33c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:37.267795 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.267663 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6cc5\" (UniqueName: \"kubernetes.io/projected/947cb58c-892e-4a83-99df-14de0bc33c7b-kube-api-access-k6cc5\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-n5jf8\" (UID: \"947cb58c-892e-4a83-99df-14de0bc33c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:37.368292 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.368253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947cb58c-892e-4a83-99df-14de0bc33c7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-n5jf8\" (UID: \"947cb58c-892e-4a83-99df-14de0bc33c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:37.368292 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.368297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6cc5\" (UniqueName: \"kubernetes.io/projected/947cb58c-892e-4a83-99df-14de0bc33c7b-kube-api-access-k6cc5\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-n5jf8\" (UID: \"947cb58c-892e-4a83-99df-14de0bc33c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:37.368644 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.368625 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947cb58c-892e-4a83-99df-14de0bc33c7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-n5jf8\" (UID: \"947cb58c-892e-4a83-99df-14de0bc33c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:37.380001 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.379970 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6cc5\" (UniqueName: \"kubernetes.io/projected/947cb58c-892e-4a83-99df-14de0bc33c7b-kube-api-access-k6cc5\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-n5jf8\" (UID: \"947cb58c-892e-4a83-99df-14de0bc33c7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:37.497008 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.496931 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:37.802496 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:37.802467 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8"] Sep 19 00:06:37.803164 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:06:37.803136 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947cb58c_892e_4a83_99df_14de0bc33c7b.slice/crio-46130cbc9f35fb2b16e5fa621bbf717877ad7ee3fc0bb943fd99f4259f952984 WatchSource:0}: Error finding container 46130cbc9f35fb2b16e5fa621bbf717877ad7ee3fc0bb943fd99f4259f952984: Status 404 returned error can't find the container with id 46130cbc9f35fb2b16e5fa621bbf717877ad7ee3fc0bb943fd99f4259f952984 Sep 19 00:06:38.616600 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:38.616562 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" event={"ID":"947cb58c-892e-4a83-99df-14de0bc33c7b","Type":"ContainerStarted","Data":"46130cbc9f35fb2b16e5fa621bbf717877ad7ee3fc0bb943fd99f4259f952984"} Sep 19 00:06:41.509099 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:41.509052 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:41.610121 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:41.610087 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:42.645501 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:42.645459 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" podUID="bda9c515-ec8d-4ea4-8862-aa26f98cd14f" containerName="manager" containerID="cri-o://4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211" gracePeriod=2 Sep 19 00:06:42.647299 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:42.647275 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" event={"ID":"947cb58c-892e-4a83-99df-14de0bc33c7b","Type":"ContainerStarted","Data":"e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c"} Sep 19 00:06:42.647400 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:42.647333 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:42.670650 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:42.670591 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" podStartSLOduration=0.943987582 podStartE2EDuration="5.670571523s" totalImagesPullingTime="4.726583941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:06:42.669031586 +0000 UTC m=+505.087755995" watchObservedRunningTime="2026-09-19 00:06:42.670571523 +0000 UTC m=+505.089295935" Sep 19 00:06:44.828281 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:44.828256 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:44.936998 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:44.936916 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-extensions-socket-volume\") pod \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\" (UID: \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\") " Sep 19 00:06:44.936998 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:44.936951 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtmcq\" (UniqueName: \"kubernetes.io/projected/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-kube-api-access-gtmcq\") pod \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\" (UID: \"bda9c515-ec8d-4ea4-8862-aa26f98cd14f\") " Sep 19 00:06:44.937194 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:44.937172 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bda9c515-ec8d-4ea4-8862-aa26f98cd14f" (UID: "bda9c515-ec8d-4ea4-8862-aa26f98cd14f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:06:44.939139 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:44.939111 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-kube-api-access-gtmcq" (OuterVolumeSpecName: "kube-api-access-gtmcq") pod "bda9c515-ec8d-4ea4-8862-aa26f98cd14f" (UID: "bda9c515-ec8d-4ea4-8862-aa26f98cd14f"). InnerVolumeSpecName "kube-api-access-gtmcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:06:45.037572 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:45.037540 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-extensions-socket-volume\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:45.037572 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:45.037566 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtmcq\" (UniqueName: \"kubernetes.io/projected/bda9c515-ec8d-4ea4-8862-aa26f98cd14f-kube-api-access-gtmcq\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:06:45.666374 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:45.666339 2568 generic.go:356] "Generic (PLEG): container finished" podID="bda9c515-ec8d-4ea4-8862-aa26f98cd14f" containerID="4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211" exitCode=137 Sep 19 00:06:45.666528 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:45.666381 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:45.666528 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:45.666431 2568 scope.go:117] "RemoveContainer" containerID="4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211" Sep 19 00:06:45.669002 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:06:45.668878 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-mjjgz\" is forbidden: User \"system:node:ip-10-0-141-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-42.ec2.internal' and this object" podUID="bda9c515-ec8d-4ea4-8862-aa26f98cd14f" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:45.676229 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:45.676213 2568 scope.go:117] "RemoveContainer" containerID="4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211" Sep 19 00:06:45.676490 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:06:45.676472 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211\": container with ID starting with 4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211 not found: ID does not exist" containerID="4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211" Sep 19 00:06:45.676546 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:45.676499 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211"} err="failed to get container status \"4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211\": rpc error: code = NotFound desc = could not find container \"4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211\": container with ID starting with 4e55cfd26616087a26d4b2fe91112812138f21d32d45b8fbcc2ded6c772f9211 not found: ID does not exist" Sep 19 00:06:45.677637 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:06:45.677616 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-mjjgz\" is forbidden: User \"system:node:ip-10-0-141-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-42.ec2.internal' and this object" podUID="bda9c515-ec8d-4ea4-8862-aa26f98cd14f" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-mjjgz" Sep 19 00:06:46.022380 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:46.022305 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda9c515-ec8d-4ea4-8862-aa26f98cd14f" path="/var/lib/kubelet/pods/bda9c515-ec8d-4ea4-8862-aa26f98cd14f/volumes" Sep 19 00:06:46.900120 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:46.900086 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:46.949656 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:46.949626 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:47.341709 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:47.341632 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:47.421538 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:47.421509 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:51.485145 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:51.485108 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:51.584902 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:51.584862 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:51.685387 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:51.685351 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:52.751925 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:52.751877 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:52.808003 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:52.807962 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:53.656311 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:53.656286 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:06:57.970866 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:57.970831 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:06:58.026759 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:06:58.026725 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:06.340382 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.340338 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8"] Sep 19 00:07:06.340858 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.340579 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" podUID="947cb58c-892e-4a83-99df-14de0bc33c7b" containerName="manager" containerID="cri-o://e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c" gracePeriod=10 Sep 19 00:07:06.591072 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.591008 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:07:06.724134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.724099 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947cb58c-892e-4a83-99df-14de0bc33c7b-extensions-socket-volume\") pod \"947cb58c-892e-4a83-99df-14de0bc33c7b\" (UID: \"947cb58c-892e-4a83-99df-14de0bc33c7b\") " Sep 19 00:07:06.724320 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.724167 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6cc5\" (UniqueName: \"kubernetes.io/projected/947cb58c-892e-4a83-99df-14de0bc33c7b-kube-api-access-k6cc5\") pod \"947cb58c-892e-4a83-99df-14de0bc33c7b\" (UID: \"947cb58c-892e-4a83-99df-14de0bc33c7b\") " Sep 19 00:07:06.724601 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.724570 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947cb58c-892e-4a83-99df-14de0bc33c7b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "947cb58c-892e-4a83-99df-14de0bc33c7b" (UID: "947cb58c-892e-4a83-99df-14de0bc33c7b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 00:07:06.726314 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.726289 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947cb58c-892e-4a83-99df-14de0bc33c7b-kube-api-access-k6cc5" (OuterVolumeSpecName: "kube-api-access-k6cc5") pod "947cb58c-892e-4a83-99df-14de0bc33c7b" (UID: "947cb58c-892e-4a83-99df-14de0bc33c7b"). InnerVolumeSpecName "kube-api-access-k6cc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:07:06.787966 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.787914 2568 generic.go:356] "Generic (PLEG): container finished" podID="947cb58c-892e-4a83-99df-14de0bc33c7b" containerID="e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c" exitCode=0 Sep 19 00:07:06.787966 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.787953 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" event={"ID":"947cb58c-892e-4a83-99df-14de0bc33c7b","Type":"ContainerDied","Data":"e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c"} Sep 19 00:07:06.787966 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.787974 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" Sep 19 00:07:06.788231 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.788054 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8" event={"ID":"947cb58c-892e-4a83-99df-14de0bc33c7b","Type":"ContainerDied","Data":"46130cbc9f35fb2b16e5fa621bbf717877ad7ee3fc0bb943fd99f4259f952984"} Sep 19 00:07:06.788231 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.788085 2568 scope.go:117] "RemoveContainer" containerID="e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c" Sep 19 00:07:06.796962 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.796943 2568 scope.go:117] "RemoveContainer" containerID="e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c" Sep 19 00:07:06.797224 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:07:06.797206 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c\": container with ID starting with e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c not found: ID does not exist" containerID="e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c" Sep 19 00:07:06.797273 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.797232 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c"} err="failed to get container status \"e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c\": rpc error: code = NotFound desc = could not find container \"e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c\": container with ID starting with e54fd9f3318087496f2d9c73e2f6e68e158afbb07658c8f6166bad245861ea5c not found: ID does not exist" Sep 19 00:07:06.810270 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.810246 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8"] Sep 19 00:07:06.813407 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.813386 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-n5jf8"] Sep 19 00:07:06.824818 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.824799 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947cb58c-892e-4a83-99df-14de0bc33c7b-extensions-socket-volume\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:07:06.824818 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:06.824816 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6cc5\" (UniqueName: \"kubernetes.io/projected/947cb58c-892e-4a83-99df-14de0bc33c7b-kube-api-access-k6cc5\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:07:08.023563 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:08.023529 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947cb58c-892e-4a83-99df-14de0bc33c7b" path="/var/lib/kubelet/pods/947cb58c-892e-4a83-99df-14de0bc33c7b/volumes" Sep 19 00:07:09.987311 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.987280 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw"] Sep 19 00:07:09.987703 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.987681 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947cb58c-892e-4a83-99df-14de0bc33c7b" containerName="manager" Sep 19 00:07:09.987703 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.987702 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="947cb58c-892e-4a83-99df-14de0bc33c7b" containerName="manager" Sep 19 00:07:09.987914 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.987736 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda9c515-ec8d-4ea4-8862-aa26f98cd14f" containerName="manager" Sep 19 00:07:09.987914 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.987746 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda9c515-ec8d-4ea4-8862-aa26f98cd14f" containerName="manager" Sep 19 00:07:09.987914 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.987843 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="947cb58c-892e-4a83-99df-14de0bc33c7b" containerName="manager" Sep 19 00:07:09.987914 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.987854 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda9c515-ec8d-4ea4-8862-aa26f98cd14f" containerName="manager" Sep 19 00:07:09.991982 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.991966 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:09.994657 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:09.994633 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4pw2p\"" Sep 19 00:07:10.002117 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.002093 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw"] Sep 19 00:07:10.029095 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.029056 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:10.049978 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.049949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.050132 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.049982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.050132 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.050018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.050132 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.050064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.050132 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.050118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.050309 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.050150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.050309 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.050226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mbx7\" (UniqueName: \"kubernetes.io/projected/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-kube-api-access-9mbx7\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.050309 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.050261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.050309 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.050288 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151107 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151107 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151350 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151350 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151350 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151341 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151507 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151507 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151385 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151507 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151406 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151507 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151487 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151710 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151573 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151710 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151675 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151806 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151778 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mbx7\" (UniqueName: \"kubernetes.io/projected/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-kube-api-access-9mbx7\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.151863 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.151814 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.152084 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.152064 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.153820 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.153796 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.153951 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.153933 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.159084 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.159058 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.159264 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.159250 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mbx7\" (UniqueName: \"kubernetes.io/projected/ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1-kube-api-access-9mbx7\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pc8lw\" (UID: \"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.302772 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.302681 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:10.578512 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.578487 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw"] Sep 19 00:07:10.580025 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:07:10.580000 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4ef9b3_ead0_44fc_b1cc_c01d9b8bd6a1.slice/crio-c0d35d5b5d15cdf2c73f9cfd6ece54d377908badf99f60bd79d31b4ed4907fb4 WatchSource:0}: Error finding container c0d35d5b5d15cdf2c73f9cfd6ece54d377908badf99f60bd79d31b4ed4907fb4: Status 404 returned error can't find the container with id c0d35d5b5d15cdf2c73f9cfd6ece54d377908badf99f60bd79d31b4ed4907fb4 Sep 19 00:07:10.811727 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:10.811641 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" event={"ID":"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1","Type":"ContainerStarted","Data":"c0d35d5b5d15cdf2c73f9cfd6ece54d377908badf99f60bd79d31b4ed4907fb4"} Sep 19 00:07:11.163587 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:11.163548 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:14.253146 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:14.253108 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:07:14.253432 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:14.253183 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:07:14.253432 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:14.253214 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:07:14.837270 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:14.837229 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" event={"ID":"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1","Type":"ContainerStarted","Data":"91e332b33b64585c107d276bb4dc544644655bc072d5bb37c11e0498830a164e"} Sep 19 00:07:14.858021 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:14.857970 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" podStartSLOduration=2.187149685 podStartE2EDuration="5.857954779s" totalImagesPullingTime="3.670805094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:07:14.855109446 +0000 UTC m=+537.273833867" watchObservedRunningTime="2026-09-19 00:07:14.857954779 +0000 UTC m=+537.276679187" Sep 19 00:07:15.303388 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:15.303350 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:15.308184 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:15.308163 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:15.843193 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:15.843166 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:15.843985 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:15.843964 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:07:21.942530 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:21.942492 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:24.205177 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.205145 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-p8wjb"] Sep 19 00:07:24.208541 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.208522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:24.210903 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.210869 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rfshb\"" Sep 19 00:07:24.211130 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.211116 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 19 00:07:24.216208 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.215815 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:24.217597 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.217576 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-p8wjb"] Sep 19 00:07:24.288423 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.288390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vgcq\" (UniqueName: \"kubernetes.io/projected/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-kube-api-access-8vgcq\") pod \"limitador-limitador-8588749977-p8wjb\" (UID: \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\") " pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:24.288584 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.288448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-config-file\") pod \"limitador-limitador-8588749977-p8wjb\" (UID: \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\") " pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:24.314367 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.314336 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-p8wjb"] Sep 19 00:07:24.315351 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.315318 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:24.388903 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.388866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-config-file\") pod \"limitador-limitador-8588749977-p8wjb\" (UID: \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\") " pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:24.389061 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.388974 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vgcq\" (UniqueName: \"kubernetes.io/projected/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-kube-api-access-8vgcq\") pod \"limitador-limitador-8588749977-p8wjb\" (UID: \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\") " pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:24.389509 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.389491 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-config-file\") pod \"limitador-limitador-8588749977-p8wjb\" (UID: \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\") " pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:24.396854 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.396815 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vgcq\" (UniqueName: \"kubernetes.io/projected/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-kube-api-access-8vgcq\") pod \"limitador-limitador-8588749977-p8wjb\" (UID: \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\") " pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:24.418248 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.418215 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:24.520103 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.520025 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:24.790795 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.790771 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-p8wjb"] Sep 19 00:07:24.793082 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:07:24.793045 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d1dfc3_5121_4a04_b22b_0c6ddbd8aa45.slice/crio-34d39f965feeece7ce83afe93d805c0f76fcda4ce3c527f02b8622892c47428b WatchSource:0}: Error finding container 34d39f965feeece7ce83afe93d805c0f76fcda4ce3c527f02b8622892c47428b: Status 404 returned error can't find the container with id 34d39f965feeece7ce83afe93d805c0f76fcda4ce3c527f02b8622892c47428b Sep 19 00:07:24.895118 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:24.895083 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" event={"ID":"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45","Type":"ContainerStarted","Data":"34d39f965feeece7ce83afe93d805c0f76fcda4ce3c527f02b8622892c47428b"} Sep 19 00:07:25.045545 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:25.045472 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:25.147935 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:25.147873 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:28.918868 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:28.918787 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" event={"ID":"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45","Type":"ContainerStarted","Data":"48624e22686d758708c2942d1cf822d56a0ec61d536fd1700ef2fa3457169263"} Sep 19 00:07:28.919354 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:28.918873 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:28.933994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:28.933946 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" podStartSLOduration=1.272992015 podStartE2EDuration="4.933931438s" totalImagesPullingTime="3.660939423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:07:28.933555916 +0000 UTC m=+551.352280328" watchObservedRunningTime="2026-09-19 00:07:28.933931438 +0000 UTC m=+551.352655845" Sep 19 00:07:37.481326 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:37.481291 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-p8wjb"] Sep 19 00:07:37.481729 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:37.481466 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" podUID="26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45" containerName="limitador" containerID="cri-o://48624e22686d758708c2942d1cf822d56a0ec61d536fd1700ef2fa3457169263" gracePeriod=30 Sep 19 00:07:37.482180 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:37.482159 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:37.970006 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:37.969974 2568 generic.go:356] "Generic (PLEG): container finished" podID="26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45" containerID="48624e22686d758708c2942d1cf822d56a0ec61d536fd1700ef2fa3457169263" exitCode=0 Sep 19 00:07:37.970163 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:37.970060 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" event={"ID":"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45","Type":"ContainerDied","Data":"48624e22686d758708c2942d1cf822d56a0ec61d536fd1700ef2fa3457169263"} Sep 19 00:07:38.029988 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.029967 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:38.120150 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.120120 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-config-file\") pod \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\" (UID: \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\") " Sep 19 00:07:38.120330 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.120215 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vgcq\" (UniqueName: \"kubernetes.io/projected/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-kube-api-access-8vgcq\") pod \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\" (UID: \"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45\") " Sep 19 00:07:38.120540 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.120511 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-config-file" (OuterVolumeSpecName: "config-file") pod "26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45" (UID: "26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:07:38.122316 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.122292 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-kube-api-access-8vgcq" (OuterVolumeSpecName: "kube-api-access-8vgcq") pod "26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45" (UID: "26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45"). InnerVolumeSpecName "kube-api-access-8vgcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:07:38.221667 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.221632 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-config-file\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:07:38.221667 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.221661 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vgcq\" (UniqueName: \"kubernetes.io/projected/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45-kube-api-access-8vgcq\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:07:38.976395 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.976365 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" Sep 19 00:07:38.976873 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.976408 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-p8wjb" event={"ID":"26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45","Type":"ContainerDied","Data":"34d39f965feeece7ce83afe93d805c0f76fcda4ce3c527f02b8622892c47428b"} Sep 19 00:07:38.976873 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.976464 2568 scope.go:117] "RemoveContainer" containerID="48624e22686d758708c2942d1cf822d56a0ec61d536fd1700ef2fa3457169263" Sep 19 00:07:38.997975 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:38.997945 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-p8wjb"] Sep 19 00:07:39.001119 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:39.001095 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-p8wjb"] Sep 19 00:07:40.022807 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:40.022772 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45" path="/var/lib/kubelet/pods/26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45/volumes" Sep 19 00:07:42.178684 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.178653 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:42.324833 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.324795 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:42.577290 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.577205 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc"] Sep 19 00:07:42.577615 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.577601 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45" containerName="limitador" Sep 19 00:07:42.577687 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.577616 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45" containerName="limitador" Sep 19 00:07:42.577746 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.577697 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d1dfc3-5121-4a04-b22b-0c6ddbd8aa45" containerName="limitador" Sep 19 00:07:42.580568 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.580549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:42.583165 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.583136 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 19 00:07:42.583292 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.583215 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 19 00:07:42.583388 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.583372 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 19 00:07:42.584261 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.584242 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wdvrh\"" Sep 19 00:07:42.588233 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.588210 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc"] Sep 19 00:07:42.604429 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.604407 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:42.659189 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.659165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a01d0538-ff57-496d-85f4-5509f81b4966-data\") pod \"postgres-69fb4594cf-rzwlc\" (UID: \"a01d0538-ff57-496d-85f4-5509f81b4966\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:42.659308 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.659202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd9tx\" (UniqueName: \"kubernetes.io/projected/a01d0538-ff57-496d-85f4-5509f81b4966-kube-api-access-kd9tx\") pod \"postgres-69fb4594cf-rzwlc\" (UID: \"a01d0538-ff57-496d-85f4-5509f81b4966\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:42.759762 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.759733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a01d0538-ff57-496d-85f4-5509f81b4966-data\") pod \"postgres-69fb4594cf-rzwlc\" (UID: \"a01d0538-ff57-496d-85f4-5509f81b4966\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:42.759935 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.759776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd9tx\" (UniqueName: \"kubernetes.io/projected/a01d0538-ff57-496d-85f4-5509f81b4966-kube-api-access-kd9tx\") pod \"postgres-69fb4594cf-rzwlc\" (UID: \"a01d0538-ff57-496d-85f4-5509f81b4966\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:42.760208 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.760188 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a01d0538-ff57-496d-85f4-5509f81b4966-data\") pod \"postgres-69fb4594cf-rzwlc\" (UID: \"a01d0538-ff57-496d-85f4-5509f81b4966\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:42.767691 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.767669 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd9tx\" (UniqueName: \"kubernetes.io/projected/a01d0538-ff57-496d-85f4-5509f81b4966-kube-api-access-kd9tx\") pod \"postgres-69fb4594cf-rzwlc\" (UID: \"a01d0538-ff57-496d-85f4-5509f81b4966\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:42.893277 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:42.893242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:43.167621 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:43.167593 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc"] Sep 19 00:07:43.169205 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:07:43.169177 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01d0538_ff57_496d_85f4_5509f81b4966.slice/crio-330aaca8401ff27f607f811793e54ac298604cbdef2a65e0e02922c903cdf22c WatchSource:0}: Error finding container 330aaca8401ff27f607f811793e54ac298604cbdef2a65e0e02922c903cdf22c: Status 404 returned error can't find the container with id 330aaca8401ff27f607f811793e54ac298604cbdef2a65e0e02922c903cdf22c Sep 19 00:07:44.009553 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:44.009515 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" event={"ID":"a01d0538-ff57-496d-85f4-5509f81b4966","Type":"ContainerStarted","Data":"330aaca8401ff27f607f811793e54ac298604cbdef2a65e0e02922c903cdf22c"} Sep 19 00:07:49.045291 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:49.045256 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" event={"ID":"a01d0538-ff57-496d-85f4-5509f81b4966","Type":"ContainerStarted","Data":"8803d8452a547a988eff929a0d67d9331f89fcec1f6b77729e1952d1e59eecd5"} Sep 19 00:07:49.045681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:49.045403 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:49.064326 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:49.064261 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" podStartSLOduration=2.172815507 podStartE2EDuration="7.064238726s" totalImagesPullingTime="4.891423219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:07:49.060856987 +0000 UTC m=+571.479581395" watchObservedRunningTime="2026-09-19 00:07:49.064238726 +0000 UTC m=+571.482963135" Sep 19 00:07:55.078989 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:55.078960 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rzwlc" Sep 19 00:07:55.384609 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:55.384576 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:07:55.887641 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:07:55.887612 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:00.158549 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:00.158513 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:02.572047 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.572009 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:02.592690 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.592637 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-98gbq"] Sep 19 00:08:02.598802 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.598779 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:02.602323 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.602290 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 19 00:08:02.602323 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.602315 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 19 00:08:02.602536 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.602357 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 19 00:08:02.602536 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.602303 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hrszm\"" Sep 19 00:08:02.604813 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.604790 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-98gbq"] Sep 19 00:08:02.641005 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.640961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:02.641178 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.641046 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:02.641178 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.641136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5l6d\" (UniqueName: \"kubernetes.io/projected/5c772872-d882-408d-a7e1-93bca528ddb7-kube-api-access-f5l6d\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:02.668519 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.668475 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:02.727725 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.727689 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:02.741999 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.741966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5l6d\" (UniqueName: \"kubernetes.io/projected/5c772872-d882-408d-a7e1-93bca528ddb7-kube-api-access-f5l6d\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:02.742170 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.742013 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:02.742170 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.742048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:02.742286 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:02.742177 2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 19 00:08:02.742286 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:02.742195 2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 19 00:08:02.742286 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:02.742242 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert podName:5c772872-d882-408d-a7e1-93bca528ddb7 nodeName:}" failed. No retries permitted until 2026-09-19 00:08:03.242227321 +0000 UTC m=+585.660951711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert") pod "maas-controller-75dc6cbdf-98gbq" (UID: "5c772872-d882-408d-a7e1-93bca528ddb7") : secret "maas-controller-webhook-cert" not found Sep 19 00:08:02.742286 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:02.742256 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs podName:5c772872-d882-408d-a7e1-93bca528ddb7 nodeName:}" failed. No retries permitted until 2026-09-19 00:08:03.242249988 +0000 UTC m=+585.660974373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs") pod "maas-controller-75dc6cbdf-98gbq" (UID: "5c772872-d882-408d-a7e1-93bca528ddb7") : secret "maas-controller-metrics-tls" not found Sep 19 00:08:02.751185 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.751154 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5l6d\" (UniqueName: \"kubernetes.io/projected/5c772872-d882-408d-a7e1-93bca528ddb7-kube-api-access-f5l6d\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:02.758450 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.758425 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d7f879b4f-r2wr8"] Sep 19 00:08:02.762751 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.762732 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.768950 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.768926 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d7f879b4f-r2wr8"] Sep 19 00:08:02.813143 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.813113 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:02.843184 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.843112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae90df08-81ff-4b22-875f-7537aefa72a4-webhook-cert\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.843184 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.843158 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae90df08-81ff-4b22-875f-7537aefa72a4-metrics-certs\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.843350 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.843254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx8vv\" (UniqueName: \"kubernetes.io/projected/ae90df08-81ff-4b22-875f-7537aefa72a4-kube-api-access-xx8vv\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.869572 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.869542 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:02.944252 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.944214 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae90df08-81ff-4b22-875f-7537aefa72a4-webhook-cert\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.944425 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.944275 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae90df08-81ff-4b22-875f-7537aefa72a4-metrics-certs\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.944425 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.944380 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx8vv\" (UniqueName: \"kubernetes.io/projected/ae90df08-81ff-4b22-875f-7537aefa72a4-kube-api-access-xx8vv\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.946706 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.946679 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae90df08-81ff-4b22-875f-7537aefa72a4-metrics-certs\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.946812 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.946725 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae90df08-81ff-4b22-875f-7537aefa72a4-webhook-cert\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:02.951743 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:02.951721 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx8vv\" (UniqueName: \"kubernetes.io/projected/ae90df08-81ff-4b22-875f-7537aefa72a4-kube-api-access-xx8vv\") pod \"maas-controller-6d7f879b4f-r2wr8\" (UID: \"ae90df08-81ff-4b22-875f-7537aefa72a4\") " pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:03.075692 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:03.075659 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:03.247036 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:03.246997 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:03.247247 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:03.247094 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:03.249680 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:03.249655 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:03.249790 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:03.249724 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert\") pod \"maas-controller-75dc6cbdf-98gbq\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:03.349253 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:03.349223 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d7f879b4f-r2wr8"] Sep 19 00:08:03.350545 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:08:03.350516 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae90df08_81ff_4b22_875f_7537aefa72a4.slice/crio-7fb974585623b8e792618cb61811463f37333b344dd7116e9f1f174baf850973 WatchSource:0}: Error finding container 7fb974585623b8e792618cb61811463f37333b344dd7116e9f1f174baf850973: Status 404 returned error can't find the container with id 7fb974585623b8e792618cb61811463f37333b344dd7116e9f1f174baf850973 Sep 19 00:08:03.511455 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:03.511368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:03.784654 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:03.784622 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-98gbq"] Sep 19 00:08:03.786304 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:08:03.786273 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c772872_d882_408d_a7e1_93bca528ddb7.slice/crio-3940b0030f90c8d14d5f0eeb8512947f6c1d6fea3ecce04fc61585c05494f5c7 WatchSource:0}: Error finding container 3940b0030f90c8d14d5f0eeb8512947f6c1d6fea3ecce04fc61585c05494f5c7: Status 404 returned error can't find the container with id 3940b0030f90c8d14d5f0eeb8512947f6c1d6fea3ecce04fc61585c05494f5c7 Sep 19 00:08:04.130962 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:04.130923 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" event={"ID":"ae90df08-81ff-4b22-875f-7537aefa72a4","Type":"ContainerStarted","Data":"7fb974585623b8e792618cb61811463f37333b344dd7116e9f1f174baf850973"} Sep 19 00:08:04.132529 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:04.132500 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" event={"ID":"5c772872-d882-408d-a7e1-93bca528ddb7","Type":"ContainerStarted","Data":"3940b0030f90c8d14d5f0eeb8512947f6c1d6fea3ecce04fc61585c05494f5c7"} Sep 19 00:08:05.949737 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:05.949681 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:06.049098 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:06.049021 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:06.146171 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:06.146130 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" event={"ID":"ae90df08-81ff-4b22-875f-7537aefa72a4","Type":"ContainerStarted","Data":"21b566c0a2efeb3ea850d2707f5618e7b3ccf1f2855caf258e1edd51c09c2d24"} Sep 19 00:08:06.146357 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:06.146195 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:06.147792 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:06.147767 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" event={"ID":"5c772872-d882-408d-a7e1-93bca528ddb7","Type":"ContainerStarted","Data":"6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf"} Sep 19 00:08:06.147965 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:06.147862 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:06.164518 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:06.164472 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" podStartSLOduration=1.731431065 podStartE2EDuration="4.164457102s" totalImagesPullingTime="2.433026037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:08:06.162088742 +0000 UTC m=+588.580813164" watchObservedRunningTime="2026-09-19 00:08:06.164457102 +0000 UTC m=+588.583181532" Sep 19 00:08:06.179196 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:06.179157 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" podStartSLOduration=2.171225157 podStartE2EDuration="4.179143062s" totalImagesPullingTime="2.007917905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:08:06.178668388 +0000 UTC m=+588.597392797" watchObservedRunningTime="2026-09-19 00:08:06.179143062 +0000 UTC m=+588.597867468" Sep 19 00:08:07.204689 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:07.204651 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:07.313903 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:07.313864 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:07.446915 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:07.446857 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:17.157367 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.157339 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:17.157735 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.157495 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d7f879b4f-r2wr8" Sep 19 00:08:17.217171 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.217138 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-98gbq"] Sep 19 00:08:17.217392 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.217367 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" podUID="5c772872-d882-408d-a7e1-93bca528ddb7" containerName="manager" containerID="cri-o://6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf" gracePeriod=30 Sep 19 00:08:17.468442 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.468417 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:17.584570 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.584535 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5l6d\" (UniqueName: \"kubernetes.io/projected/5c772872-d882-408d-a7e1-93bca528ddb7-kube-api-access-f5l6d\") pod \"5c772872-d882-408d-a7e1-93bca528ddb7\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " Sep 19 00:08:17.584771 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.584598 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert\") pod \"5c772872-d882-408d-a7e1-93bca528ddb7\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " Sep 19 00:08:17.584771 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.584617 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs\") pod \"5c772872-d882-408d-a7e1-93bca528ddb7\" (UID: \"5c772872-d882-408d-a7e1-93bca528ddb7\") " Sep 19 00:08:17.586919 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.586873 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c772872-d882-408d-a7e1-93bca528ddb7-kube-api-access-f5l6d" (OuterVolumeSpecName: "kube-api-access-f5l6d") pod "5c772872-d882-408d-a7e1-93bca528ddb7" (UID: "5c772872-d882-408d-a7e1-93bca528ddb7"). InnerVolumeSpecName "kube-api-access-f5l6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:08:17.586919 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.586908 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5c772872-d882-408d-a7e1-93bca528ddb7" (UID: "5c772872-d882-408d-a7e1-93bca528ddb7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:08:17.587076 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.586924 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5c772872-d882-408d-a7e1-93bca528ddb7" (UID: "5c772872-d882-408d-a7e1-93bca528ddb7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 00:08:17.686191 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.686153 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-webhook-cert\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:08:17.686191 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.686183 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c772872-d882-408d-a7e1-93bca528ddb7-metrics-certs\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:08:17.686191 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.686194 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5l6d\" (UniqueName: \"kubernetes.io/projected/5c772872-d882-408d-a7e1-93bca528ddb7-kube-api-access-f5l6d\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:08:17.993935 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.993909 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:08:17.995614 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:17.995595 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:08:18.218751 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.218720 2568 generic.go:356] "Generic (PLEG): container finished" podID="5c772872-d882-408d-a7e1-93bca528ddb7" containerID="6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf" exitCode=0 Sep 19 00:08:18.219210 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.218759 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" Sep 19 00:08:18.219210 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.218808 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" event={"ID":"5c772872-d882-408d-a7e1-93bca528ddb7","Type":"ContainerDied","Data":"6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf"} Sep 19 00:08:18.219210 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.218859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-98gbq" event={"ID":"5c772872-d882-408d-a7e1-93bca528ddb7","Type":"ContainerDied","Data":"3940b0030f90c8d14d5f0eeb8512947f6c1d6fea3ecce04fc61585c05494f5c7"} Sep 19 00:08:18.219210 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.218881 2568 scope.go:117] "RemoveContainer" containerID="6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf" Sep 19 00:08:18.233977 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.233659 2568 scope.go:117] "RemoveContainer" containerID="6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf" Sep 19 00:08:18.234090 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:18.234035 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf\": container with ID starting with 6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf not found: ID does not exist" containerID="6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf" Sep 19 00:08:18.234090 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.234061 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf"} err="failed to get container status \"6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf\": rpc error: code = NotFound desc = could not find container \"6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf\": container with ID starting with 6c703f563e6cc0c25ad8bcf67f454e3f922ba9814433af0521da2f3dc83af4cf not found: ID does not exist" Sep 19 00:08:18.236656 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.236634 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-98gbq"] Sep 19 00:08:18.240057 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:18.240039 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-98gbq"] Sep 19 00:08:20.022681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:20.022641 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c772872-d882-408d-a7e1-93bca528ddb7" path="/var/lib/kubelet/pods/5c772872-d882-408d-a7e1-93bca528ddb7/volumes" Sep 19 00:08:37.452357 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:37.452318 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:37.546750 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:37.546718 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:39.003359 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.003319 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:39.080427 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.080384 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:39.082444 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.082419 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd"] Sep 19 00:08:39.082882 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.082866 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c772872-d882-408d-a7e1-93bca528ddb7" containerName="manager" Sep 19 00:08:39.083004 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.082901 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c772872-d882-408d-a7e1-93bca528ddb7" containerName="manager" Sep 19 00:08:39.083004 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.082997 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c772872-d882-408d-a7e1-93bca528ddb7" containerName="manager" Sep 19 00:08:39.100379 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.100355 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd"] Sep 19 00:08:39.100547 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.100464 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.103277 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.103252 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-q5rdd\"" Sep 19 00:08:39.103416 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.103295 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 19 00:08:39.103416 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.103248 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 19 00:08:39.281871 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.281768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d90dbf5-63f9-485e-9d8f-e59855181980-openshift-service-ca\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.281871 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.281813 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q6f4\" (UniqueName: \"kubernetes.io/projected/4d90dbf5-63f9-485e-9d8f-e59855181980-kube-api-access-2q6f4\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.281871 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.281851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-metrics-certs\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.282134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.281911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.378332 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.378302 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:39.382664 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.382625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d90dbf5-63f9-485e-9d8f-e59855181980-openshift-service-ca\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.382780 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.382673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q6f4\" (UniqueName: \"kubernetes.io/projected/4d90dbf5-63f9-485e-9d8f-e59855181980-kube-api-access-2q6f4\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.382780 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.382708 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-metrics-certs\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.382780 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.382751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.382933 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:39.382916 2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Sep 19 00:08:39.383004 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:39.382993 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls podName:4d90dbf5-63f9-485e-9d8f-e59855181980 nodeName:}" failed. No retries permitted until 2026-09-19 00:08:39.88297458 +0000 UTC m=+622.301698966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls") pod "maas-api-59f6566bbc-x47dd" (UID: "4d90dbf5-63f9-485e-9d8f-e59855181980") : secret "maas-api-serving-cert" not found Sep 19 00:08:39.383359 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.383343 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d90dbf5-63f9-485e-9d8f-e59855181980-openshift-service-ca\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.385146 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.385124 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-metrics-certs\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.390819 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.390795 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q6f4\" (UniqueName: \"kubernetes.io/projected/4d90dbf5-63f9-485e-9d8f-e59855181980-kube-api-access-2q6f4\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.483280 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.483245 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:39.568102 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.568015 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:39.569817 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.569789 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5"] Sep 19 00:08:39.573659 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.573641 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:39.576338 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.576309 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b8f9j\"" Sep 19 00:08:39.576483 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.576465 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 19 00:08:39.581344 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.581322 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5"] Sep 19 00:08:39.686066 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.686034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8h8b5\" (UID: \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:39.686225 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.686074 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdknd\" (UniqueName: \"kubernetes.io/projected/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-kube-api-access-bdknd\") pod \"payload-pre-processing-59fbc47bf8-8h8b5\" (UID: \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:39.786643 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.786608 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8h8b5\" (UID: \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:39.786822 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.786654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdknd\" (UniqueName: \"kubernetes.io/projected/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-kube-api-access-bdknd\") pod \"payload-pre-processing-59fbc47bf8-8h8b5\" (UID: \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:39.787325 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.787303 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8h8b5\" (UID: \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:39.794631 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.794604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdknd\" (UniqueName: \"kubernetes.io/projected/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-kube-api-access-bdknd\") pod \"payload-pre-processing-59fbc47bf8-8h8b5\" (UID: \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:39.887120 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.887087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:39.887425 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:39.887401 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:39.887560 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:39.887541 2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Sep 19 00:08:39.887620 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:08:39.887610 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls podName:4d90dbf5-63f9-485e-9d8f-e59855181980 nodeName:}" failed. No retries permitted until 2026-09-19 00:08:40.8875953 +0000 UTC m=+623.306319686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls") pod "maas-api-59f6566bbc-x47dd" (UID: "4d90dbf5-63f9-485e-9d8f-e59855181980") : secret "maas-api-serving-cert" not found Sep 19 00:08:40.120045 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:40.120011 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:40.163686 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:40.163652 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5"] Sep 19 00:08:40.163829 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:08:40.163775 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd993e0c_f3f0_48a5_a2f9_fd3ff908333c.slice/crio-c9833e84d071f7721ef0fac1ba09a3e1f75ee9abb5f838b0a38c8ed602501d9b WatchSource:0}: Error finding container c9833e84d071f7721ef0fac1ba09a3e1f75ee9abb5f838b0a38c8ed602501d9b: Status 404 returned error can't find the container with id c9833e84d071f7721ef0fac1ba09a3e1f75ee9abb5f838b0a38c8ed602501d9b Sep 19 00:08:40.165830 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:40.165810 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 00:08:40.346582 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:40.346547 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" event={"ID":"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c","Type":"ContainerStarted","Data":"c9833e84d071f7721ef0fac1ba09a3e1f75ee9abb5f838b0a38c8ed602501d9b"} Sep 19 00:08:40.895551 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:40.895454 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:40.898252 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:40.898229 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d90dbf5-63f9-485e-9d8f-e59855181980-maas-api-tls\") pod \"maas-api-59f6566bbc-x47dd\" (UID: \"4d90dbf5-63f9-485e-9d8f-e59855181980\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:40.912141 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:40.912114 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:41.224494 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:41.224464 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd"] Sep 19 00:08:41.225925 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:08:41.225872 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d90dbf5_63f9_485e_9d8f_e59855181980.slice/crio-8eae8a2006cc5613cd9393ec267f3760a9c2804638ec7eef89fd85fe0e6d3b4a WatchSource:0}: Error finding container 8eae8a2006cc5613cd9393ec267f3760a9c2804638ec7eef89fd85fe0e6d3b4a: Status 404 returned error can't find the container with id 8eae8a2006cc5613cd9393ec267f3760a9c2804638ec7eef89fd85fe0e6d3b4a Sep 19 00:08:41.383656 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:41.383615 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" event={"ID":"4d90dbf5-63f9-485e-9d8f-e59855181980","Type":"ContainerStarted","Data":"8eae8a2006cc5613cd9393ec267f3760a9c2804638ec7eef89fd85fe0e6d3b4a"} Sep 19 00:08:42.392945 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:42.392907 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" event={"ID":"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c","Type":"ContainerStarted","Data":"4d19d84b9518b8001a97909abd502bb209a2ed8bc67d27d436da944ff021b32f"} Sep 19 00:08:42.393394 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:42.393008 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:42.409020 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:42.408961 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" podStartSLOduration=1.8624510490000001 podStartE2EDuration="3.408942756s" totalImagesPullingTime="1.546491707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:08:42.408004767 +0000 UTC m=+624.826729175" watchObservedRunningTime="2026-09-19 00:08:42.408942756 +0000 UTC m=+624.827667166" Sep 19 00:08:43.400739 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:43.400665 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" event={"ID":"4d90dbf5-63f9-485e-9d8f-e59855181980","Type":"ContainerStarted","Data":"feed99752f585eb52535a3b4aaca6ca983a8b068ed10dfae427841228311bcc8"} Sep 19 00:08:43.401140 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:43.400907 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:43.417310 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:43.417266 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" podStartSLOduration=2.517757236 podStartE2EDuration="4.417251704s" totalImagesPullingTime="1.899494468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:08:43.416096094 +0000 UTC m=+625.834820503" watchObservedRunningTime="2026-09-19 00:08:43.417251704 +0000 UTC m=+625.835976113" Sep 19 00:08:46.885110 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:46.885068 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pc8lw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 19 00:08:46.885491 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:46.885136 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" podUID="ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 19 00:08:49.411879 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:49.411851 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-x47dd" Sep 19 00:08:49.441337 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:49.441307 2568 generic.go:356] "Generic (PLEG): container finished" podID="ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1" containerID="91e332b33b64585c107d276bb4dc544644655bc072d5bb37c11e0498830a164e" exitCode=0 Sep 19 00:08:49.441519 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:49.441386 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" event={"ID":"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1","Type":"ContainerDied","Data":"91e332b33b64585c107d276bb4dc544644655bc072d5bb37c11e0498830a164e"} Sep 19 00:08:49.441817 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:49.441794 2568 scope.go:117] "RemoveContainer" containerID="91e332b33b64585c107d276bb4dc544644655bc072d5bb37c11e0498830a164e" Sep 19 00:08:49.443118 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:49.443082 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:08:49.443220 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:49.443172 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:08:49.443259 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:49.443246 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 19 00:08:50.392220 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:50.392188 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:50.448729 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:50.448695 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" event={"ID":"ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1","Type":"ContainerStarted","Data":"c2aa2b88c6be42872fa2273e293f587ad91f3cf8abcb7dcad6ad3942795a48dd"} Sep 19 00:08:51.303147 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:51.303109 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:08:51.303357 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:51.303329 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pc8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Sep 19 00:08:51.303439 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:51.303409 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" podUID="ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Sep 19 00:08:52.085796 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:52.085755 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:08:52.303226 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:52.303191 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pc8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Sep 19 00:08:52.303396 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:52.303255 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" podUID="ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Sep 19 00:08:53.303264 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:53.303224 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pc8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Sep 19 00:08:53.303668 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:53.303290 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" podUID="ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Sep 19 00:08:53.403721 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:53.403694 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:08:54.303076 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:54.303041 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pc8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Sep 19 00:08:54.303262 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:54.303095 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" podUID="ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Sep 19 00:08:55.304074 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:55.304041 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pc8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Sep 19 00:08:55.304540 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:55.304109 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" podUID="ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Sep 19 00:08:56.307037 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:56.307007 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:08:56.307521 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:56.307503 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:08:56.308129 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:08:56.308108 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pc8lw" Sep 19 00:09:03.603692 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.603656 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q"] Sep 19 00:09:03.606695 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.606674 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.610274 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.610250 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 19 00:09:03.610391 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.610254 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 19 00:09:03.610391 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.610260 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 19 00:09:03.610522 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.610429 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-shsj8\"" Sep 19 00:09:03.617102 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.617077 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q"] Sep 19 00:09:03.628522 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.628498 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:03.678219 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.678185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.678371 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.678242 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.678371 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.678267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9tpg\" (UniqueName: \"kubernetes.io/projected/64d62ac9-c934-4f0e-92fa-8c3e10098455-kube-api-access-b9tpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.678371 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.678337 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64d62ac9-c934-4f0e-92fa-8c3e10098455-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.678371 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.678356 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.678596 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.678379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.779451 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.779415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.779451 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.779455 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.779649 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.779579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.779649 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.779615 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9tpg\" (UniqueName: \"kubernetes.io/projected/64d62ac9-c934-4f0e-92fa-8c3e10098455-kube-api-access-b9tpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.779746 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.779729 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64d62ac9-c934-4f0e-92fa-8c3e10098455-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.779794 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.779762 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.779850 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.779829 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.779998 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.779970 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.780187 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.780140 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.781973 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.781950 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64d62ac9-c934-4f0e-92fa-8c3e10098455-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.782220 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.782203 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64d62ac9-c934-4f0e-92fa-8c3e10098455-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.787165 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.787146 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9tpg\" (UniqueName: \"kubernetes.io/projected/64d62ac9-c934-4f0e-92fa-8c3e10098455-kube-api-access-b9tpg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q\" (UID: \"64d62ac9-c934-4f0e-92fa-8c3e10098455\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:03.918345 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:03.918297 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:04.196282 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:04.196251 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q"] Sep 19 00:09:04.197516 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:09:04.197493 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d62ac9_c934_4f0e_92fa_8c3e10098455.slice/crio-cf519b65d1ad92e9ef60403f065c4ac954dc1790c18646890a5a22da9ea71ef4 WatchSource:0}: Error finding container cf519b65d1ad92e9ef60403f065c4ac954dc1790c18646890a5a22da9ea71ef4: Status 404 returned error can't find the container with id cf519b65d1ad92e9ef60403f065c4ac954dc1790c18646890a5a22da9ea71ef4 Sep 19 00:09:04.543862 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:04.543782 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" event={"ID":"64d62ac9-c934-4f0e-92fa-8c3e10098455","Type":"ContainerStarted","Data":"cf519b65d1ad92e9ef60403f065c4ac954dc1790c18646890a5a22da9ea71ef4"} Sep 19 00:09:05.551464 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:05.551428 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" event={"ID":"64d62ac9-c934-4f0e-92fa-8c3e10098455","Type":"ContainerStarted","Data":"04547e8d67d6f064631d45184c7f0e787c0c402f846d843583a64ce3a4b61b2d"} Sep 19 00:09:05.569830 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:05.569732 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" podStartSLOduration=1.460671015 podStartE2EDuration="2.569713836s" totalImagesPullingTime="1.109042821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:09:05.568557317 +0000 UTC m=+647.987281727" watchObservedRunningTime="2026-09-19 00:09:05.569713836 +0000 UTC m=+647.988438244" Sep 19 00:09:11.805414 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:11.805376 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:11.853567 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:11.853533 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:13.919134 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:13.919103 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:13.919585 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:13.919445 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:13.932528 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:13.932501 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:13.939191 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:13.939161 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:14.613545 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:14.613514 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6r76q" Sep 19 00:09:16.772615 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:16.772579 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:19.620362 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.620331 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h"] Sep 19 00:09:19.627212 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.627186 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.630720 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.630683 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 19 00:09:19.633003 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.632977 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h"] Sep 19 00:09:19.640069 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.640039 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:19.727938 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.727869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.728135 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.727946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.728135 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.727985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.728135 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.728005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5c2d71-dcde-40a8-b372-1980ff869341-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.728135 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.728027 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.728135 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.728058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54h9m\" (UniqueName: \"kubernetes.io/projected/1f5c2d71-dcde-40a8-b372-1980ff869341-kube-api-access-54h9m\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.828804 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.828758 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.829050 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.828817 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.829050 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.828859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.829050 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.828879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5c2d71-dcde-40a8-b372-1980ff869341-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.829050 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.828940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.829050 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.828975 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54h9m\" (UniqueName: \"kubernetes.io/projected/1f5c2d71-dcde-40a8-b372-1980ff869341-kube-api-access-54h9m\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.829327 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.829277 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.829380 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.829326 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.829415 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.829392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.831259 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.831234 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5c2d71-dcde-40a8-b372-1980ff869341-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.831475 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.831455 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5c2d71-dcde-40a8-b372-1980ff869341-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.838222 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.838201 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54h9m\" (UniqueName: \"kubernetes.io/projected/1f5c2d71-dcde-40a8-b372-1980ff869341-kube-api-access-54h9m\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h\" (UID: \"1f5c2d71-dcde-40a8-b372-1980ff869341\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:19.939397 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:19.939304 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:20.215455 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:20.215427 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h"] Sep 19 00:09:20.217050 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:09:20.217012 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5c2d71_dcde_40a8_b372_1980ff869341.slice/crio-a7cdfd966878a36d0ae615cf61957b6f0efee706a00eb28e29d6c6a48d253c0f WatchSource:0}: Error finding container a7cdfd966878a36d0ae615cf61957b6f0efee706a00eb28e29d6c6a48d253c0f: Status 404 returned error can't find the container with id a7cdfd966878a36d0ae615cf61957b6f0efee706a00eb28e29d6c6a48d253c0f Sep 19 00:09:20.639284 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:20.639247 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" event={"ID":"1f5c2d71-dcde-40a8-b372-1980ff869341","Type":"ContainerStarted","Data":"52a75d5e43e330228541cb5d9d5777040fdf2d419eac0c2b943e1727ce026114"} Sep 19 00:09:20.639767 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:20.639316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" event={"ID":"1f5c2d71-dcde-40a8-b372-1980ff869341","Type":"ContainerStarted","Data":"a7cdfd966878a36d0ae615cf61957b6f0efee706a00eb28e29d6c6a48d253c0f"} Sep 19 00:09:20.660125 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:20.660069 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" podStartSLOduration=1.46437413 podStartE2EDuration="1.660051044s" totalImagesPullingTime="195.676914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:09:20.658523285 +0000 UTC m=+663.077247695" watchObservedRunningTime="2026-09-19 00:09:20.660051044 +0000 UTC m=+663.078775451" Sep 19 00:09:22.710283 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:22.710243 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:27.577484 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:27.577453 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:29.939504 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:29.939464 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:29.939910 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:29.939577 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:29.951918 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:29.951873 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:30.712997 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:30.712959 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-bp85h" Sep 19 00:09:35.102054 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.102023 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p"] Sep 19 00:09:35.105901 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.105867 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.108724 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.108706 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 19 00:09:35.116222 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.116195 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p"] Sep 19 00:09:35.129751 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.129729 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:35.274583 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.274551 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.274583 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.274591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.274799 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.274657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2cd165b-41ae-4ccb-ab28-cb81a979850f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.274799 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.274691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.274799 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.274756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfmk6\" (UniqueName: \"kubernetes.io/projected/c2cd165b-41ae-4ccb-ab28-cb81a979850f-kube-api-access-bfmk6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.274917 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.274803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.375731 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.375700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.375883 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.375740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.375883 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.375865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2cd165b-41ae-4ccb-ab28-cb81a979850f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.375994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.375933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.375994 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.375988 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfmk6\" (UniqueName: \"kubernetes.io/projected/c2cd165b-41ae-4ccb-ab28-cb81a979850f-kube-api-access-bfmk6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.376154 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.376128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.376236 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.376176 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.376236 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.376217 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.376457 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.376432 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.378244 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.378221 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2cd165b-41ae-4ccb-ab28-cb81a979850f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.378363 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.378346 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2cd165b-41ae-4ccb-ab28-cb81a979850f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.383305 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.383284 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfmk6\" (UniqueName: \"kubernetes.io/projected/c2cd165b-41ae-4ccb-ab28-cb81a979850f-kube-api-access-bfmk6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p\" (UID: \"c2cd165b-41ae-4ccb-ab28-cb81a979850f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.420543 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.420514 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:35.699653 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.699618 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p"] Sep 19 00:09:35.700929 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:09:35.700901 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2cd165b_41ae_4ccb_ab28_cb81a979850f.slice/crio-c01f834372edaf00bccfe20c85d3a5d8d245a86515bb98a340ff2d589c360a0a WatchSource:0}: Error finding container c01f834372edaf00bccfe20c85d3a5d8d245a86515bb98a340ff2d589c360a0a: Status 404 returned error can't find the container with id c01f834372edaf00bccfe20c85d3a5d8d245a86515bb98a340ff2d589c360a0a Sep 19 00:09:35.733168 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:35.733141 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" event={"ID":"c2cd165b-41ae-4ccb-ab28-cb81a979850f","Type":"ContainerStarted","Data":"c01f834372edaf00bccfe20c85d3a5d8d245a86515bb98a340ff2d589c360a0a"} Sep 19 00:09:36.740333 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:36.740299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" event={"ID":"c2cd165b-41ae-4ccb-ab28-cb81a979850f","Type":"ContainerStarted","Data":"dfc751366b362d8f398a5a03e91cbecd0eda30841e26fe6b4dc787c269f7715a"} Sep 19 00:09:36.757491 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:36.757429 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" podStartSLOduration=1.573236095 podStartE2EDuration="1.757409101s" totalImagesPullingTime="184.173006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:09:36.75699053 +0000 UTC m=+679.175714938" watchObservedRunningTime="2026-09-19 00:09:36.757409101 +0000 UTC m=+679.176133510" Sep 19 00:09:38.101449 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:38.101421 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:43.422916 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:43.422867 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:09:45.421417 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:45.421380 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:45.421797 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:45.421483 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:45.433490 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:45.433459 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:09:45.803797 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:09:45.803703 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff9k6p" Sep 19 00:11:04.989688 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:04.989643 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-7764d67567-sbc7n"] Sep 19 00:11:04.993473 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:04.993449 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:04.996255 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:04.996233 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 19 00:11:04.996413 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:04.996385 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-4hppn\"" Sep 19 00:11:05.001834 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:05.001586 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7764d67567-sbc7n"] Sep 19 00:11:05.028298 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:05.028270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4gcw\" (UniqueName: \"kubernetes.io/projected/e1974964-dd2f-450a-90ec-1634d3c1bcb9-kube-api-access-z4gcw\") pod \"ai-gateway-controller-7764d67567-sbc7n\" (UID: \"e1974964-dd2f-450a-90ec-1634d3c1bcb9\") " pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:05.129770 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:05.129728 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4gcw\" (UniqueName: \"kubernetes.io/projected/e1974964-dd2f-450a-90ec-1634d3c1bcb9-kube-api-access-z4gcw\") pod \"ai-gateway-controller-7764d67567-sbc7n\" (UID: \"e1974964-dd2f-450a-90ec-1634d3c1bcb9\") " pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:05.138137 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:05.138107 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4gcw\" (UniqueName: \"kubernetes.io/projected/e1974964-dd2f-450a-90ec-1634d3c1bcb9-kube-api-access-z4gcw\") pod \"ai-gateway-controller-7764d67567-sbc7n\" (UID: \"e1974964-dd2f-450a-90ec-1634d3c1bcb9\") " pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:05.305477 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:05.305402 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:05.575951 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:05.575922 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7764d67567-sbc7n"] Sep 19 00:11:05.577365 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:11:05.577318 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1974964_dd2f_450a_90ec_1634d3c1bcb9.slice/crio-17d18bf12897c3ad3fe577e3f3babd13ec7a796492a534814ba06afdcb50ec68 WatchSource:0}: Error finding container 17d18bf12897c3ad3fe577e3f3babd13ec7a796492a534814ba06afdcb50ec68: Status 404 returned error can't find the container with id 17d18bf12897c3ad3fe577e3f3babd13ec7a796492a534814ba06afdcb50ec68 Sep 19 00:11:06.274699 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:06.274665 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" event={"ID":"e1974964-dd2f-450a-90ec-1634d3c1bcb9","Type":"ContainerStarted","Data":"17d18bf12897c3ad3fe577e3f3babd13ec7a796492a534814ba06afdcb50ec68"} Sep 19 00:11:08.290953 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:08.290907 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" event={"ID":"e1974964-dd2f-450a-90ec-1634d3c1bcb9","Type":"ContainerStarted","Data":"8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33"} Sep 19 00:11:08.291436 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:08.290990 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:08.306910 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:08.306812 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" podStartSLOduration=2.653258405 podStartE2EDuration="4.306791426s" totalImagesPullingTime="1.653533021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 00:11:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:11:08.306626527 +0000 UTC m=+770.725350936" watchObservedRunningTime="2026-09-19 00:11:08.306791426 +0000 UTC m=+770.725515835" Sep 19 00:11:19.299299 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:19.299265 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:33.527320 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:33.527282 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7764d67567-sbc7n"] Sep 19 00:11:33.527776 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:33.527525 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" podUID="e1974964-dd2f-450a-90ec-1634d3c1bcb9" containerName="manager" containerID="cri-o://8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33" gracePeriod=30 Sep 19 00:11:33.772178 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:33.772148 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:33.902806 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:33.902772 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4gcw\" (UniqueName: \"kubernetes.io/projected/e1974964-dd2f-450a-90ec-1634d3c1bcb9-kube-api-access-z4gcw\") pod \"e1974964-dd2f-450a-90ec-1634d3c1bcb9\" (UID: \"e1974964-dd2f-450a-90ec-1634d3c1bcb9\") " Sep 19 00:11:33.904880 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:33.904852 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1974964-dd2f-450a-90ec-1634d3c1bcb9-kube-api-access-z4gcw" (OuterVolumeSpecName: "kube-api-access-z4gcw") pod "e1974964-dd2f-450a-90ec-1634d3c1bcb9" (UID: "e1974964-dd2f-450a-90ec-1634d3c1bcb9"). InnerVolumeSpecName "kube-api-access-z4gcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:11:34.003961 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.003921 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4gcw\" (UniqueName: \"kubernetes.io/projected/e1974964-dd2f-450a-90ec-1634d3c1bcb9-kube-api-access-z4gcw\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:11:34.215032 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.214948 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5"] Sep 19 00:11:34.215218 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.215161 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" podUID="fd993e0c-f3f0-48a5-a2f9-fd3ff908333c" containerName="payload-pre-processing" containerID="cri-o://4d19d84b9518b8001a97909abd502bb209a2ed8bc67d27d436da944ff021b32f" gracePeriod=30 Sep 19 00:11:34.272700 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.272567 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:11:34.362676 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.362636 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:11:34.442592 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.442558 2568 generic.go:356] "Generic (PLEG): container finished" podID="fd993e0c-f3f0-48a5-a2f9-fd3ff908333c" containerID="4d19d84b9518b8001a97909abd502bb209a2ed8bc67d27d436da944ff021b32f" exitCode=0 Sep 19 00:11:34.442787 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.442656 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" event={"ID":"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c","Type":"ContainerDied","Data":"4d19d84b9518b8001a97909abd502bb209a2ed8bc67d27d436da944ff021b32f"} Sep 19 00:11:34.444188 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.444163 2568 generic.go:356] "Generic (PLEG): container finished" podID="e1974964-dd2f-450a-90ec-1634d3c1bcb9" containerID="8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33" exitCode=0 Sep 19 00:11:34.444308 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.444213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" event={"ID":"e1974964-dd2f-450a-90ec-1634d3c1bcb9","Type":"ContainerDied","Data":"8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33"} Sep 19 00:11:34.444308 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.444262 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" event={"ID":"e1974964-dd2f-450a-90ec-1634d3c1bcb9","Type":"ContainerDied","Data":"17d18bf12897c3ad3fe577e3f3babd13ec7a796492a534814ba06afdcb50ec68"} Sep 19 00:11:34.444308 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.444219 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7764d67567-sbc7n" Sep 19 00:11:34.444455 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.444287 2568 scope.go:117] "RemoveContainer" containerID="8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33" Sep 19 00:11:34.454937 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.454917 2568 scope.go:117] "RemoveContainer" containerID="8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33" Sep 19 00:11:34.455199 ip-10-0-141-42 kubenswrapper[2568]: E0919 00:11:34.455182 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33\": container with ID starting with 8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33 not found: ID does not exist" containerID="8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33" Sep 19 00:11:34.455335 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.455206 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33"} err="failed to get container status \"8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33\": rpc error: code = NotFound desc = could not find container \"8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33\": container with ID starting with 8455efb3c440207fece59942e1f7c127a82a574a562a6a4d5625aa09c4eb6a33 not found: ID does not exist" Sep 19 00:11:34.463921 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.463872 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7764d67567-sbc7n"] Sep 19 00:11:34.468681 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.468612 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-7764d67567-sbc7n"] Sep 19 00:11:34.474464 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.474437 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:11:34.609526 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.609496 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdknd\" (UniqueName: \"kubernetes.io/projected/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-kube-api-access-bdknd\") pod \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\" (UID: \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\") " Sep 19 00:11:34.610008 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.609623 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-plugins-config-volume\") pod \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\" (UID: \"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c\") " Sep 19 00:11:34.610088 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.610062 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd993e0c-f3f0-48a5-a2f9-fd3ff908333c" (UID: "fd993e0c-f3f0-48a5-a2f9-fd3ff908333c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 00:11:34.611580 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.611555 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-kube-api-access-bdknd" (OuterVolumeSpecName: "kube-api-access-bdknd") pod "fd993e0c-f3f0-48a5-a2f9-fd3ff908333c" (UID: "fd993e0c-f3f0-48a5-a2f9-fd3ff908333c"). InnerVolumeSpecName "kube-api-access-bdknd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 00:11:34.659505 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.659473 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:11:34.710713 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.710675 2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-plugins-config-volume\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:11:34.710713 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.710704 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdknd\" (UniqueName: \"kubernetes.io/projected/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c-kube-api-access-bdknd\") on node \"ip-10-0-141-42.ec2.internal\" DevicePath \"\"" Sep 19 00:11:34.760993 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:34.760903 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:11:35.452015 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:35.451984 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" Sep 19 00:11:35.452015 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:35.452004 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5" event={"ID":"fd993e0c-f3f0-48a5-a2f9-fd3ff908333c","Type":"ContainerDied","Data":"c9833e84d071f7721ef0fac1ba09a3e1f75ee9abb5f838b0a38c8ed602501d9b"} Sep 19 00:11:35.452279 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:35.452063 2568 scope.go:117] "RemoveContainer" containerID="4d19d84b9518b8001a97909abd502bb209a2ed8bc67d27d436da944ff021b32f" Sep 19 00:11:35.475285 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:35.475259 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5"] Sep 19 00:11:35.477754 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:35.477735 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8h8b5"] Sep 19 00:11:36.023666 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:36.023632 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1974964-dd2f-450a-90ec-1634d3c1bcb9" path="/var/lib/kubelet/pods/e1974964-dd2f-450a-90ec-1634d3c1bcb9/volumes" Sep 19 00:11:36.024243 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:11:36.024221 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd993e0c-f3f0-48a5-a2f9-fd3ff908333c" path="/var/lib/kubelet/pods/fd993e0c-f3f0-48a5-a2f9-fd3ff908333c/volumes" Sep 19 00:12:36.247285 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:12:36.247251 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:13:18.036511 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:13:18.036439 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:13:18.037342 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:13:18.037320 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:14:38.371727 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:14:38.371691 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:18:18.085168 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:18.085139 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:18:18.085949 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:18.085920 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:18:36.795705 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:36.795668 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:18:36.865188 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:36.865154 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" limit=1024 Sep 19 00:18:39.726577 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:39.726548 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hdpmx_842a810a-8527-41e6-9d16-b6abb2cb9fbb/global-pull-secret-syncer/0.log" Sep 19 00:18:39.767835 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:39.767794 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h9wwn_6fd4c1e6-84c6-41de-a1f8-b2fb1c489624/konnectivity-agent/0.log" Sep 19 00:18:39.885687 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:39.885658 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-42.ec2.internal_e2c137e820cf81485eca551db40735ae/haproxy/0.log" Sep 19 00:18:43.944766 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:43.944736 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-skfgg_6727cc4f-437d-4e4d-8720-71f590ecd826/manager/0.log" Sep 19 00:18:43.973170 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:43.973142 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-4m588_90f54817-09b0-4f1b-ac2b-0fab8c9c4c66/manager/0.log" Sep 19 00:18:45.981081 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:45.981054 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-bqz6h_eff01b5f-b50c-486f-a499-0c17ff65babf/cluster-monitoring-operator/0.log" Sep 19 00:18:46.075864 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.075824 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6759d9fdf6-mrrd6_2b8199f2-f45d-4dbb-8bd3-515dd4cbca4c/metrics-server/0.log" Sep 19 00:18:46.101330 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.101307 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-w5fn8_61d81069-e95b-4226-a4f4-e1f2f5e91a6d/monitoring-plugin/0.log" Sep 19 00:18:46.208189 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.208165 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qbprl_95331bf5-3ba5-4f22-898f-18d5ce809037/node-exporter/0.log" Sep 19 00:18:46.227545 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.227521 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qbprl_95331bf5-3ba5-4f22-898f-18d5ce809037/kube-rbac-proxy/0.log" Sep 19 00:18:46.249506 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.249449 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qbprl_95331bf5-3ba5-4f22-898f-18d5ce809037/init-textfile/0.log" Sep 19 00:18:46.348078 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.348051 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5k66m_21b5a120-7c58-4125-826e-603b98e9b2bd/kube-rbac-proxy-main/0.log" Sep 19 00:18:46.368249 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.368230 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5k66m_21b5a120-7c58-4125-826e-603b98e9b2bd/kube-rbac-proxy-self/0.log" Sep 19 00:18:46.387132 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.387112 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-5k66m_21b5a120-7c58-4125-826e-603b98e9b2bd/openshift-state-metrics/0.log" Sep 19 00:18:46.631282 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.631260 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-rq7wh_a20550a4-f032-4ccc-905c-8e161e586f3a/prometheus-operator-admission-webhook/0.log" Sep 19 00:18:46.740544 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.740520 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f554b7cd8-zjxvg_ed536d74-1b8b-49cd-a7be-1115ca705a26/thanos-query/0.log" Sep 19 00:18:46.761394 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.761376 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f554b7cd8-zjxvg_ed536d74-1b8b-49cd-a7be-1115ca705a26/kube-rbac-proxy-web/0.log" Sep 19 00:18:46.781624 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.781607 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f554b7cd8-zjxvg_ed536d74-1b8b-49cd-a7be-1115ca705a26/kube-rbac-proxy/0.log" Sep 19 00:18:46.804528 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.804507 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f554b7cd8-zjxvg_ed536d74-1b8b-49cd-a7be-1115ca705a26/prom-label-proxy/0.log" Sep 19 00:18:46.824650 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.824630 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f554b7cd8-zjxvg_ed536d74-1b8b-49cd-a7be-1115ca705a26/kube-rbac-proxy-rules/0.log" Sep 19 00:18:46.849785 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:46.849766 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f554b7cd8-zjxvg_ed536d74-1b8b-49cd-a7be-1115ca705a26/kube-rbac-proxy-metrics/0.log" Sep 19 00:18:48.645166 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:48.645128 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-jvm6m_6b1f30b8-b607-494a-9894-c7cc4817b64d/networking-console-plugin/0.log" Sep 19 00:18:49.280484 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:49.280454 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/2.log" Sep 19 00:18:49.284558 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:49.284532 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-qgd4d_082a8d06-c6bc-495e-b0d8-c026a33cbddb/console-operator/3.log" Sep 19 00:18:49.813288 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:49.813258 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bf744cc95-cgjhc_fdee2c08-61a7-4809-bd77-992b2b8abf66/console/0.log" Sep 19 00:18:50.197311 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.197273 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9"] Sep 19 00:18:50.197962 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.197942 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd993e0c-f3f0-48a5-a2f9-fd3ff908333c" containerName="payload-pre-processing" Sep 19 00:18:50.197962 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.197961 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd993e0c-f3f0-48a5-a2f9-fd3ff908333c" containerName="payload-pre-processing" Sep 19 00:18:50.198144 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.197971 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1974964-dd2f-450a-90ec-1634d3c1bcb9" containerName="manager" Sep 19 00:18:50.198144 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.197977 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1974964-dd2f-450a-90ec-1634d3c1bcb9" containerName="manager" Sep 19 00:18:50.198144 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.198053 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1974964-dd2f-450a-90ec-1634d3c1bcb9" containerName="manager" Sep 19 00:18:50.198144 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.198063 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd993e0c-f3f0-48a5-a2f9-fd3ff908333c" containerName="payload-pre-processing" Sep 19 00:18:50.201198 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.201182 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.203695 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.203674 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kf4c\"/\"kube-root-ca.crt\"" Sep 19 00:18:50.203805 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.203699 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kf4c\"/\"openshift-service-ca.crt\"" Sep 19 00:18:50.204974 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.204953 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9kf4c\"/\"default-dockercfg-hdlp4\"" Sep 19 00:18:50.213771 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.213748 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9"] Sep 19 00:18:50.298517 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.298484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f679\" (UniqueName: \"kubernetes.io/projected/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-kube-api-access-5f679\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.298691 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.298525 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-lib-modules\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.298691 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.298591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-proc\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.298691 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.298677 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-podres\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.298800 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.298707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-sys\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399535 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399498 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-podres\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399698 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399543 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-sys\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399698 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399618 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-sys\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399698 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f679\" (UniqueName: \"kubernetes.io/projected/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-kube-api-access-5f679\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399806 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399720 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-lib-modules\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399806 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-proc\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399874 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399812 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-proc\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399874 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399673 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-podres\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.399967 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.399879 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-lib-modules\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.407067 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.407048 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f679\" (UniqueName: \"kubernetes.io/projected/95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c-kube-api-access-5f679\") pod \"perf-node-gather-daemonset-6txg9\" (UID: \"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c\") " pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.510914 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.510812 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.547021 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.546991 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-k9fkq_f1cfe40f-de5e-4935-8c53-aa6c931dc940/volume-data-source-validator/0.log" Sep 19 00:18:50.782311 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.782285 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9"] Sep 19 00:18:50.783930 ip-10-0-141-42 kubenswrapper[2568]: W0919 00:18:50.783877 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95bb2fcd_2af2_456d_b6bb_5d9d5f397a4c.slice/crio-d63bd3413f2b48258e9641fd2d23938f013faaad587f68b43ae6496cdad0a406 WatchSource:0}: Error finding container d63bd3413f2b48258e9641fd2d23938f013faaad587f68b43ae6496cdad0a406: Status 404 returned error can't find the container with id d63bd3413f2b48258e9641fd2d23938f013faaad587f68b43ae6496cdad0a406 Sep 19 00:18:50.966442 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.966402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" event={"ID":"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c","Type":"ContainerStarted","Data":"9c8a02b311b8b9281d52584c5e83f1f9e065431b80827fa90a5ca86c9c6c5902"} Sep 19 00:18:50.966930 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.966459 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" event={"ID":"95bb2fcd-2af2-456d-b6bb-5d9d5f397a4c","Type":"ContainerStarted","Data":"d63bd3413f2b48258e9641fd2d23938f013faaad587f68b43ae6496cdad0a406"} Sep 19 00:18:50.966930 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.966493 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:50.982800 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:50.982752 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" podStartSLOduration=0.982738952 podStartE2EDuration="982.738952ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 00:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 00:18:50.979799533 +0000 UTC m=+1233.398523964" watchObservedRunningTime="2026-09-19 00:18:50.982738952 +0000 UTC m=+1233.401463412" Sep 19 00:18:51.645253 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:51.645221 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bvxsk_244cbdac-c648-406b-aa72-775b79b10756/dns/0.log" Sep 19 00:18:51.667753 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:51.667725 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bvxsk_244cbdac-c648-406b-aa72-775b79b10756/kube-rbac-proxy/0.log" Sep 19 00:18:51.825499 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:51.825468 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rfjg9_57eafa90-ad4e-4321-97d8-fa435df69596/dns-node-resolver/0.log" Sep 19 00:18:52.383379 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:52.383350 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b6w24_63a5cc39-c810-4bde-9a3a-5cd26e38b83e/node-ca/0.log" Sep 19 00:18:53.350807 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:53.350776 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tx58x_3e1d4a7c-efa0-4045-a409-2ae3cbfe5053/discovery/0.log" Sep 19 00:18:53.367701 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:53.367674 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-755c79bd44-d8d7q_a1e6c924-ab18-4e2d-b2cf-04019855f989/kube-auth-proxy/0.log" Sep 19 00:18:53.415350 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:53.415321 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pc8lw_ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1/istio-proxy/1.log" Sep 19 00:18:53.415877 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:53.415859 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pc8lw_ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1/istio-proxy/0.log" Sep 19 00:18:53.485013 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:53.484982 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69bdf69d78-p2kl4_53e9c2c3-7159-405c-9078-11e083b84d16/router/0.log" Sep 19 00:18:54.085824 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:54.085792 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc99k_0ea81138-5709-41f2-819c-bc743cd7b9d7/serve-healthcheck-canary/0.log" Sep 19 00:18:54.569165 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:54.569137 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-t2l6g_63e3b0fa-d932-4e4e-901d-f0cdf089c5d3/insights-operator/0.log" Sep 19 00:18:54.569740 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:54.569721 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-t2l6g_63e3b0fa-d932-4e4e-901d-f0cdf089c5d3/insights-operator/1.log" Sep 19 00:18:54.652503 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:54.652476 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggr6r_1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3/kube-rbac-proxy/0.log" Sep 19 00:18:54.672176 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:54.672153 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggr6r_1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3/exporter/0.log" Sep 19 00:18:54.693330 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:54.693310 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggr6r_1e26e64b-fefc-4d0d-bcaf-290a1b9a50e3/extractor/0.log" Sep 19 00:18:56.853235 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:56.853205 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-b4258_a6c5a7e3-206d-4cdc-a8b1-cdc5fdd02164/manager/0.log" Sep 19 00:18:56.880738 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:56.880712 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d7f879b4f-r2wr8_ae90df08-81ff-4b22-875f-7537aefa72a4/manager/0.log" Sep 19 00:18:56.982531 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:56.982504 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9kf4c/perf-node-gather-daemonset-6txg9" Sep 19 00:18:57.035816 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:57.035790 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-577c99c85d-lfg8s_2538df7c-8e64-4a2e-82c8-f1c3a0d481cf/manager/0.log" Sep 19 00:18:57.058805 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:18:57.058776 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-577c99c85d-lfg8s_2538df7c-8e64-4a2e-82c8-f1c3a0d481cf/copy-manifests/0.log" Sep 19 00:19:00.300031 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:00.300000 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tx58x_3e1d4a7c-efa0-4045-a409-2ae3cbfe5053/discovery/0.log" Sep 19 00:19:00.310785 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:00.310756 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-755c79bd44-d8d7q_a1e6c924-ab18-4e2d-b2cf-04019855f989/kube-auth-proxy/0.log" Sep 19 00:19:00.342204 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:00.342172 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pc8lw_ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1/istio-proxy/1.log" Sep 19 00:19:00.342684 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:00.342671 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pc8lw_ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1/istio-proxy/0.log" Sep 19 00:19:00.389836 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:00.389801 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69bdf69d78-p2kl4_53e9c2c3-7159-405c-9078-11e083b84d16/router/0.log" Sep 19 00:19:01.517369 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:01.517331 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tx58x_3e1d4a7c-efa0-4045-a409-2ae3cbfe5053/discovery/0.log" Sep 19 00:19:01.530001 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:01.529979 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-755c79bd44-d8d7q_a1e6c924-ab18-4e2d-b2cf-04019855f989/kube-auth-proxy/0.log" Sep 19 00:19:01.571059 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:01.571032 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pc8lw_ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1/istio-proxy/1.log" Sep 19 00:19:01.571355 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:01.571326 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pc8lw_ae4ef9b3-ead0-44fc-b1cc-c01d9b8bd6a1/istio-proxy/0.log" Sep 19 00:19:01.624451 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:01.624422 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69bdf69d78-p2kl4_53e9c2c3-7159-405c-9078-11e083b84d16/router/0.log" Sep 19 00:19:03.878742 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:03.878711 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-t5hrv_a1f6cb64-a53b-40f4-a470-bac55725c938/kube-storage-version-migrator-operator/1.log" Sep 19 00:19:03.879749 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:03.879719 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-t5hrv_a1f6cb64-a53b-40f4-a470-bac55725c938/kube-storage-version-migrator-operator/0.log" Sep 19 00:19:05.231903 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.231868 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcgk5_45509027-2edb-48a5-aa49-5f53a3bd55b6/kube-multus-additional-cni-plugins/0.log" Sep 19 00:19:05.265126 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.265092 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcgk5_45509027-2edb-48a5-aa49-5f53a3bd55b6/egress-router-binary-copy/0.log" Sep 19 00:19:05.283980 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.283957 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcgk5_45509027-2edb-48a5-aa49-5f53a3bd55b6/cni-plugins/0.log" Sep 19 00:19:05.303597 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.303574 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcgk5_45509027-2edb-48a5-aa49-5f53a3bd55b6/bond-cni-plugin/0.log" Sep 19 00:19:05.323055 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.323035 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcgk5_45509027-2edb-48a5-aa49-5f53a3bd55b6/routeoverride-cni/0.log" Sep 19 00:19:05.342073 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.342056 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcgk5_45509027-2edb-48a5-aa49-5f53a3bd55b6/whereabouts-cni-bincopy/0.log" Sep 19 00:19:05.361834 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.361817 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcgk5_45509027-2edb-48a5-aa49-5f53a3bd55b6/whereabouts-cni/0.log" Sep 19 00:19:05.463412 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.463385 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zqnnn_4b4a64ff-90af-40db-9b12-27b5e90fdd10/kube-multus/0.log" Sep 19 00:19:05.524647 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.524544 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hsq9l_7666a16c-bef5-4d6f-9984-768b7d1a0a9d/network-metrics-daemon/0.log" Sep 19 00:19:05.542309 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:05.542283 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hsq9l_7666a16c-bef5-4d6f-9984-768b7d1a0a9d/kube-rbac-proxy/0.log" Sep 19 00:19:06.768220 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:06.768189 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svtxw_0c116a60-f35f-42b6-a83b-76b66b7b7ae4/ovn-controller/0.log" Sep 19 00:19:06.784634 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:06.784609 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svtxw_0c116a60-f35f-42b6-a83b-76b66b7b7ae4/ovn-acl-logging/0.log" Sep 19 00:19:06.806002 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:06.805972 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svtxw_0c116a60-f35f-42b6-a83b-76b66b7b7ae4/kube-rbac-proxy-node/0.log" Sep 19 00:19:06.827540 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:06.827523 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svtxw_0c116a60-f35f-42b6-a83b-76b66b7b7ae4/kube-rbac-proxy-ovn-metrics/0.log" Sep 19 00:19:06.846174 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:06.846154 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svtxw_0c116a60-f35f-42b6-a83b-76b66b7b7ae4/northd/0.log" Sep 19 00:19:06.865177 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:06.865156 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svtxw_0c116a60-f35f-42b6-a83b-76b66b7b7ae4/nbdb/0.log" Sep 19 00:19:06.883558 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:06.883541 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svtxw_0c116a60-f35f-42b6-a83b-76b66b7b7ae4/sbdb/0.log" Sep 19 00:19:06.923651 ip-10-0-141-42 kubenswrapper[2568]: I0919 00:19:06.923631 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svtxw_0c116a60-f35f-42b6-a83b-76b66b7b7ae4/ovnkube-controller/0.log"