Sep 17 03:12:40.001791 ip-10-0-141-44 systemd[1]: Starting Kubernetes Kubelet... Sep 17 03:12:40.354253 ip-10-0-141-44 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:40.354253 ip-10-0-141-44 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 03:12:40.354253 ip-10-0-141-44 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:40.354253 ip-10-0-141-44 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 03:12:40.354253 ip-10-0-141-44 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:40.356057 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.355967 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 03:12:40.361274 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361249 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:40.361274 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361268 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:40.361274 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361271 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:40.361274 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361275 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:40.361274 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361278 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:40.361274 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361281 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361284 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361287 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361291 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361294 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361296 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361299 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361302 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361304 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361307 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361310 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361313 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361316 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361318 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361321 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361324 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361327 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361332 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361336 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:40.361494 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361339 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361343 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361345 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361348 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361351 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361354 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361357 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361360 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361362 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361365 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361367 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361370 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361373 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361375 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361378 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361383 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361385 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361388 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361391 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361396 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:40.362052 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361400 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361403 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361406 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361409 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361413 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361416 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361419 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361422 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361425 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361427 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361430 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361433 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361435 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361438 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361440 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361443 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361445 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361448 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361451 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:40.362573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361453 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361456 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361459 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361461 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361464 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361467 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361469 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361472 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361475 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361478 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361481 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361483 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361486 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361489 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361491 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361494 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361496 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361499 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361502 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361505 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:40.363036 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361508 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361511 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361513 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361516 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361519 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361536 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361539 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361542 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361544 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361547 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361550 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361553 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361556 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361558 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361561 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.361565 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362273 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362280 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362283 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362286 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:40.363584 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362289 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362292 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362295 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362298 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362302 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362305 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362308 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362310 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362313 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362316 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362319 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362322 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362325 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362329 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362331 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362334 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362337 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362339 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362342 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362345 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:40.364096 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362347 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362350 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362352 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362355 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362358 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362361 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362363 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362366 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362369 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362372 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362374 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362377 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362380 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362382 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362385 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362387 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362390 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362392 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362395 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362398 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:40.364656 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362400 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362403 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362405 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362408 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362411 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362413 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362416 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362419 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362422 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362424 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362427 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362432 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362435 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362438 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362441 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362443 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362449 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362452 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362454 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362457 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:40.365167 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362460 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362463 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362466 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362469 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362473 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362476 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362479 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362482 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362485 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362489 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362492 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362495 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362498 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362500 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362503 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362505 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362508 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362510 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362513 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:40.365665 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362518 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362535 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362538 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362540 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362543 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362546 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362548 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362551 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362554 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362558 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362561 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362564 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362567 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362569 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362572 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362575 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362939 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362944 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362946 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362949 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:40.366162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362952 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362954 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362957 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362960 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362963 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362966 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362969 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362972 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362975 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362977 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362981 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362983 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362986 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362989 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362992 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362995 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.362997 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363000 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363002 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363005 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363007 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:40.366668 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363011 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363015 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363018 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363022 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363025 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363028 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363030 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363033 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363037 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363040 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363044 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363053 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363056 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363059 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363062 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363065 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363068 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363070 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363073 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:40.367185 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363076 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363079 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363081 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363084 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363087 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363090 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363093 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363095 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363098 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363100 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363103 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363105 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363108 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363110 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363112 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363115 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363118 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363121 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363123 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363126 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:40.367685 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363129 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363131 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363134 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363137 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363139 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363142 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363144 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363147 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363149 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363152 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363156 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363159 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363161 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363164 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363166 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363169 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363171 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363174 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363177 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363180 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:40.368177 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363183 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363185 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363188 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363191 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363193 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363195 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363198 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363200 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363204 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363206 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363209 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363211 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363215 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363219 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363222 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363294 2562 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363326 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363333 2562 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363338 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363342 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 03:12:40.368742 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363345 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363349 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363356 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363359 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363362 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363365 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363369 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363372 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363375 2562 flags.go:64] FLAG: --cgroup-root="" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363378 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363381 2562 flags.go:64] FLAG: --client-ca-file="" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363384 2562 flags.go:64] FLAG: --cloud-provider="external" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363387 2562 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363391 2562 flags.go:64] FLAG: --cluster-domain="" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363394 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363397 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363400 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363403 2562 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363407 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363411 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363414 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363418 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363421 2562 flags.go:64] FLAG: --contention-profiling="false" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363424 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 03:12:40.369243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363427 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363430 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363433 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363437 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363440 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363443 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363446 2562 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363449 2562 flags.go:64] FLAG: --enable-server="true" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363452 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363456 2562 flags.go:64] FLAG: --event-burst="100" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363459 2562 flags.go:64] FLAG: --event-qps="50" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363463 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363465 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363468 2562 flags.go:64] FLAG: --eviction-hard="" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363472 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363475 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363480 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363483 2562 flags.go:64] FLAG: --eviction-soft="" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363486 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363489 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363492 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363495 2562 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363498 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363501 2562 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363504 2562 flags.go:64] FLAG: --feature-gates="" Sep 17 03:12:40.369837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363508 2562 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363511 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363514 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363533 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363537 2562 flags.go:64] FLAG: --healthz-port="10248" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363540 2562 flags.go:64] FLAG: --help="false" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363543 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363546 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363549 2562 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363552 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363556 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363559 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363562 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363565 2562 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363568 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363571 2562 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363574 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363577 2562 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363580 2562 flags.go:64] FLAG: --kube-reserved="" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363583 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363585 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363588 2562 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363591 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363596 2562 flags.go:64] FLAG: --lock-file="" Sep 17 03:12:40.370493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363599 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363602 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363605 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363611 2562 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363614 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363617 2562 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363620 2562 flags.go:64] FLAG: --logging-format="text" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363623 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363626 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363629 2562 flags.go:64] FLAG: --manifest-url="" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363632 2562 flags.go:64] FLAG: --manifest-url-header="" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363637 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363640 2562 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363644 2562 flags.go:64] FLAG: --max-pods="110" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363647 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363650 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363653 2562 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363656 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363659 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363662 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363665 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363672 2562 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363675 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363678 2562 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 03:12:40.371115 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363681 2562 flags.go:64] FLAG: --pod-cidr="" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363684 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363689 2562 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363691 2562 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363695 2562 flags.go:64] FLAG: --pods-per-core="0" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363698 2562 flags.go:64] FLAG: --port="10250" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363701 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363705 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a66139f9c0ac223" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363708 2562 flags.go:64] FLAG: --qos-reserved="" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363711 2562 flags.go:64] FLAG: --read-only-port="10255" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363714 2562 flags.go:64] FLAG: --register-node="true" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363717 2562 flags.go:64] FLAG: --register-with-taints="" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363721 2562 flags.go:64] FLAG: --registry-burst="10" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363724 2562 flags.go:64] FLAG: --registry-qps="5" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363727 2562 flags.go:64] FLAG: --reserved-cpus="" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363730 2562 flags.go:64] FLAG: --reserved-memory="" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363734 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363737 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363740 2562 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363743 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363747 2562 flags.go:64] FLAG: --runonce="false" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363750 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363753 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363756 2562 flags.go:64] FLAG: --seccomp-default="false" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363759 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 03:12:40.371731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363762 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363765 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363768 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363771 2562 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363774 2562 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363777 2562 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363779 2562 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363782 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363786 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363789 2562 flags.go:64] FLAG: --system-cgroups="" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363792 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363797 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363800 2562 flags.go:64] FLAG: --tls-cert-file="" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363802 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363807 2562 flags.go:64] FLAG: --tls-min-version="" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363810 2562 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363813 2562 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363816 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363819 2562 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363822 2562 flags.go:64] FLAG: --v="2" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363826 2562 flags.go:64] FLAG: --version="false" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363831 2562 flags.go:64] FLAG: --vmodule="" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363834 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.363838 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363947 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:40.372360 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363952 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363956 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363961 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363964 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363967 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363970 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363974 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363978 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363980 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363983 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363986 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363989 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363991 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363994 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.363997 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364000 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364002 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364005 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364007 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:40.373005 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364011 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364013 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364018 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364020 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364023 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364026 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364028 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364031 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364033 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364036 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364039 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364042 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364045 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364047 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364050 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364054 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364057 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364061 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364065 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364069 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:40.373480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364073 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364076 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364079 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364081 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364084 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364087 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364090 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364092 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364095 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364098 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364100 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364103 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364106 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364108 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364112 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364115 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364118 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364120 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364123 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364126 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:40.373986 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364129 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364131 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364134 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364137 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364140 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364143 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364145 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364149 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364152 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364154 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364157 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364160 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364163 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364165 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364168 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364170 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364173 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364175 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364178 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364181 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:40.374482 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364183 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364186 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364189 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364191 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364194 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364196 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364200 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364203 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364206 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364208 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364211 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364213 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364216 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364218 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364221 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364224 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364228 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364232 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:40.375002 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.364237 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.364900 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.372342 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.372358 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.373115 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.373123 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373187 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373192 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373195 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373198 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373201 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373204 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373207 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373210 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373212 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:40.375457 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373215 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373218 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373221 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373224 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373227 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373229 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373232 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373235 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373239 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373243 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373246 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373250 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373254 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373257 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373260 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373263 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373265 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373268 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373270 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:40.375861 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373273 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373282 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373285 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373288 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373291 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373293 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373296 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373299 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373302 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373305 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373308 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373311 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373313 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373316 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373318 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373321 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373325 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373328 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373331 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:40.376334 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373333 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373336 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373338 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373341 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373343 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373346 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373349 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373351 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373354 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373356 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373359 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373362 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373364 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373367 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373370 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373379 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373382 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373384 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373387 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373390 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:40.376830 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373392 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373395 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373397 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373400 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373403 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373406 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373408 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373411 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373413 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373416 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373419 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373421 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373424 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373426 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373429 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373432 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373434 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373437 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373439 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373443 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:40.377318 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373445 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373449 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373451 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373454 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373457 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373459 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373462 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373464 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373472 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373475 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373477 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373480 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.373485 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373646 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373652 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:40.377835 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373655 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373658 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373660 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373663 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373666 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373668 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373671 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373673 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373676 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373679 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373681 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373685 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373689 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373693 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373696 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373700 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373704 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373706 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373709 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:40.378205 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373712 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373715 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373718 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373720 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373723 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373725 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373728 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373738 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373742 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373745 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373748 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373751 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373754 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373756 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373759 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373762 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373764 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373767 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373769 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373772 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:40.378703 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373774 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373777 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373780 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373782 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373785 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373787 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373790 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373793 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373795 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373798 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373801 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373804 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373806 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373809 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373811 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373813 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373816 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373818 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373821 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373823 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:40.379197 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373831 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373834 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373837 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373839 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373842 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373845 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373847 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373850 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373852 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373854 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373858 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373860 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373863 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373866 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373868 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373871 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373873 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373876 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373879 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:40.379852 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373881 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373884 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373887 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373889 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373892 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373894 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373897 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373899 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373902 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373905 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373908 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373912 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373914 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373917 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373927 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373929 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373932 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373934 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:40.380353 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:40.373937 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:40.380826 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.373942 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:40.380826 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.374066 2562 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 03:12:40.380826 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.376471 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 03:12:40.380826 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.377331 2562 server.go:1019] "Starting client certificate rotation" Sep 17 03:12:40.380826 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.377430 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:12:40.380826 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.377466 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:12:40.380826 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.380208 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:12:40.381704 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.381679 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:12:40.392166 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.392148 2562 log.go:25] "Validated CRI v1 runtime API" Sep 17 03:12:40.395093 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.395078 2562 log.go:25] "Validated CRI v1 image API" Sep 17 03:12:40.395992 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.395977 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 03:12:40.398273 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.398255 2562 fs.go:135] Filesystem UUIDs: map[2bd3c98f-9190-4d48-8c18-f2b4afff71d7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 afea47a1-84fd-4c40-b32f-14975ebb625c:/dev/nvme0n1p3] Sep 17 03:12:40.398335 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.398272 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 03:12:40.404184 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.404072 2562 manager.go:216] Machine: {Timestamp:2026-09-17 03:12:40.402686493 +0000 UTC m=+0.297055295 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098900 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f77ee82155c1676390298c656d254 SystemUUID:ec2f77ee-8215-5c16-7639-0298c656d254 BootID:e944fafb-c7dd-409b-9590-f7fbeb7c0204 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d9:8a:a3:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d9:8a:a3:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:84:70:da:a1:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 03:12:40.404184 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.404179 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 03:12:40.404293 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.404259 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 03:12:40.407294 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.407265 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 03:12:40.407473 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.407297 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-44.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 03:12:40.407974 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.407956 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:12:40.408616 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.408604 2562 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 03:12:40.408694 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.408619 2562 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 03:12:40.408694 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.408628 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:12:40.409346 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.409335 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:12:40.410340 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.410329 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 03:12:40.414317 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.414306 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:12:40.414449 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.414440 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 03:12:40.414478 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.414472 2562 kubelet.go:486] "Attempting to sync node with API server" Sep 17 03:12:40.414512 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.414500 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 03:12:40.414559 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.414550 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 03:12:40.414588 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.414569 2562 kubelet.go:398] "Adding apiserver pod source" Sep 17 03:12:40.414588 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.414583 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 03:12:40.415098 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.415084 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:12:40.415152 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.415110 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:12:40.417155 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.417137 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 03:12:40.419832 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.419818 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 03:12:40.419888 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.419847 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 03:12:40.422313 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422298 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 03:12:40.422357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422321 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 03:12:40.422357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422328 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 03:12:40.422357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422342 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 03:12:40.422357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422351 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 03:12:40.422357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422357 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 03:12:40.422501 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422370 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 03:12:40.422501 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422376 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 03:12:40.422501 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422382 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 03:12:40.422501 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422388 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 03:12:40.422501 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422401 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 03:12:40.422501 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.422407 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 03:12:40.423162 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.423152 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 03:12:40.423162 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.423162 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 03:12:40.425779 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.425758 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 03:12:40.425779 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.425766 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 03:12:40.427130 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.427119 2562 server.go:1268] "Started kubelet" Sep 17 03:12:40.427214 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.427197 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 03:12:40.427324 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.427283 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 03:12:40.427418 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.427340 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 03:12:40.431900 ip-10-0-141-44 systemd[1]: Started Kubernetes Kubelet. Sep 17 03:12:40.432900 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.432657 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 03:12:40.433317 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.433115 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 03:12:40.434145 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.433566 2562 server.go:310] "Adding debug handlers to kubelet server" Sep 17 03:12:40.434199 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.434162 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j756n" Sep 17 03:12:40.437969 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.437924 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 03:12:40.438370 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.438353 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-44.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 03:12:40.438481 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.438467 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 03:12:40.438571 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.438556 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:40.439204 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439184 2562 factory.go:55] Registering systemd factory Sep 17 03:12:40.439289 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439208 2562 factory.go:223] Registration of the systemd container factory successfully Sep 17 03:12:40.439289 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439206 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 03:12:40.439289 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439241 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 03:12:40.439289 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.438390 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-44.ec2.internal.18d5fd24900d7925 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-44.ec2.internal,UID:ip-10-0-141-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-44.ec2.internal,},FirstTimestamp:2026-09-17 03:12:40.427092261 +0000 UTC m=+0.321461059,LastTimestamp:2026-09-17 03:12:40.427092261 +0000 UTC m=+0.321461059,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-44.ec2.internal,}" Sep 17 03:12:40.439486 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439298 2562 reconstruct.go:97] "Volume reconstruction finished" Sep 17 03:12:40.439486 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439307 2562 reconciler.go:29] "Reconciler: start to sync state" Sep 17 03:12:40.439486 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439299 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 03:12:40.439486 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439407 2562 factory.go:153] Registering CRI-O factory Sep 17 03:12:40.439486 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439420 2562 factory.go:223] Registration of the crio container factory successfully Sep 17 03:12:40.439486 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439462 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 03:12:40.439486 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439478 2562 factory.go:103] Registering Raw factory Sep 17 03:12:40.439812 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439494 2562 manager.go:1196] Started watching for new ooms in manager Sep 17 03:12:40.439886 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.439868 2562 manager.go:349] Starting recovery of all containers Sep 17 03:12:40.440785 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.440763 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j756n" Sep 17 03:12:40.442021 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.441998 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 03:12:40.442305 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.442280 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 03:12:40.450069 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.449905 2562 manager.go:354] Recovery completed Sep 17 03:12:40.454855 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.454839 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:40.457580 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.457560 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:40.457662 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.457600 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:40.457662 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.457612 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:40.458229 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.458216 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 03:12:40.458229 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.458227 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:40.458360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.458226 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 03:12:40.458360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.458261 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:12:40.459107 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.459089 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:40.459170 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.459119 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:40.459170 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.459130 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:40.460326 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.460311 2562 policy_none.go:49] "None policy: Start" Sep 17 03:12:40.460326 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.460327 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 03:12:40.460430 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.460338 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 03:12:40.462373 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.462354 2562 policy_none.go:47] "Start" Sep 17 03:12:40.493148 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.493133 2562 manager.go:337] "Starting Device Plugin manager" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.493176 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.493189 2562 server.go:87] "Starting device plugin registration server" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.493577 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.493592 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.493683 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.493767 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.493776 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.494337 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 03:12:40.512019 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.494386 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:40.569056 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.569024 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 03:12:40.570266 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.570249 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 03:12:40.570324 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.570296 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 03:12:40.570368 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.570324 2562 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 03:12:40.570426 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.570411 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 03:12:40.573171 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.573150 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:40.593979 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.593960 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:40.594834 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.594813 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:40.594927 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.594847 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:40.594927 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.594861 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:40.594927 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.594890 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.603776 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.603761 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.603845 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.603788 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-44.ec2.internal\": node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:40.626274 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.626208 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:40.671289 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.671266 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal"] Sep 17 03:12:40.671394 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.671331 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:40.672873 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.672855 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:40.672954 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.672888 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:40.672954 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.672898 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:40.675179 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675168 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:40.675297 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675273 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.675386 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675302 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:40.675881 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675865 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:40.675946 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675893 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:40.675946 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675867 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:40.675946 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675926 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:40.675946 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675936 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:40.676067 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.675905 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:40.678191 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.678176 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.678240 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.678216 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:40.678938 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.678923 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:40.679010 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.678952 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:40.679010 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.678968 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:40.708146 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.708127 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-44.ec2.internal\" not found" node="ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.712430 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.712416 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-44.ec2.internal\" not found" node="ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.727223 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.727202 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:40.741221 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.741196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6a0ddb2d746c4b2daf268b391c6bd11-config\") pod \"kube-apiserver-proxy-ip-10-0-141-44.ec2.internal\" (UID: \"c6a0ddb2d746c4b2daf268b391c6bd11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.741221 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.741223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fbdb2946952c0407983c912e3ae8e84-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal\" (UID: \"9fbdb2946952c0407983c912e3ae8e84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.741380 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.741252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fbdb2946952c0407983c912e3ae8e84-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal\" (UID: \"9fbdb2946952c0407983c912e3ae8e84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.828164 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.828138 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:40.841469 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.841442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fbdb2946952c0407983c912e3ae8e84-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal\" (UID: \"9fbdb2946952c0407983c912e3ae8e84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.841469 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.841471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fbdb2946952c0407983c912e3ae8e84-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal\" (UID: \"9fbdb2946952c0407983c912e3ae8e84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.841639 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.841488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6a0ddb2d746c4b2daf268b391c6bd11-config\") pod \"kube-apiserver-proxy-ip-10-0-141-44.ec2.internal\" (UID: \"c6a0ddb2d746c4b2daf268b391c6bd11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.841639 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.841577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fbdb2946952c0407983c912e3ae8e84-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal\" (UID: \"9fbdb2946952c0407983c912e3ae8e84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.841639 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.841582 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6a0ddb2d746c4b2daf268b391c6bd11-config\") pod \"kube-apiserver-proxy-ip-10-0-141-44.ec2.internal\" (UID: \"c6a0ddb2d746c4b2daf268b391c6bd11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.841639 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:40.841577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9fbdb2946952c0407983c912e3ae8e84-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal\" (UID: \"9fbdb2946952c0407983c912e3ae8e84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:40.928954 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:40.928871 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:41.011418 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:41.011378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:41.015276 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:41.015253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" Sep 17 03:12:41.029657 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:41.029637 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:41.130160 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:41.130121 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:42.261841 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:42.261772 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:42.350282 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.350255 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:42.362545 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:42.362524 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:42.408999 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.408977 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 03:12:42.409409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.409094 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 03:12:42.409409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.409126 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 03:12:42.463019 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:42.462991 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-44.ec2.internal\" not found" Sep 17 03:12:42.464066 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.464050 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:42.476873 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.476840 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 03:07:41 +0000 UTC" deadline="2028-02-29 20:26:56.14265678 +0000 UTC" Sep 17 03:12:42.476873 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.476869 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12737h14m13.665790995s" Sep 17 03:12:42.562626 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.562594 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:42.570438 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.570418 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" Sep 17 03:12:42.580399 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.580380 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:12:42.581280 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.581268 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" Sep 17 03:12:42.598863 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.598837 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:12:42.696259 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:42.696226 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbdb2946952c0407983c912e3ae8e84.slice/crio-9d4e6cc234267b6e7759d09dc9ce853a62fae1eef539a8760c371b49ee274153 WatchSource:0}: Error finding container 9d4e6cc234267b6e7759d09dc9ce853a62fae1eef539a8760c371b49ee274153: Status 404 returned error can't find the container with id 9d4e6cc234267b6e7759d09dc9ce853a62fae1eef539a8760c371b49ee274153 Sep 17 03:12:42.696536 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:42.696518 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a0ddb2d746c4b2daf268b391c6bd11.slice/crio-e7661927b867ca2c5770bd04cfd3f2be279ee8ad1860cbc38b2d036b74b05a7a WatchSource:0}: Error finding container e7661927b867ca2c5770bd04cfd3f2be279ee8ad1860cbc38b2d036b74b05a7a: Status 404 returned error can't find the container with id e7661927b867ca2c5770bd04cfd3f2be279ee8ad1860cbc38b2d036b74b05a7a Sep 17 03:12:42.700867 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:42.700850 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:12:43.266246 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.266055 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:43.446391 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.446364 2562 apiserver.go:52] "Watching apiserver" Sep 17 03:12:43.455803 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.455766 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 03:12:43.457727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.457617 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-ccc4b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal","openshift-multus/multus-m9lkk","openshift-multus/network-metrics-daemon-fc2sm","openshift-network-operator/iptables-alerter-plvzf","kube-system/konnectivity-agent-s6k82","kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh","openshift-cluster-node-tuning-operator/tuned-4brbb","openshift-dns/node-resolver-l8xw5","openshift-multus/multus-additional-cni-plugins-sh6t2","openshift-network-diagnostics/network-check-target-xp5z7","openshift-ovn-kubernetes/ovnkube-node-b9p46","kube-system/global-pull-secret-syncer-7f78c"] Sep 17 03:12:43.460248 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.460211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.462537 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.462515 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.463847 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.463460 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dv9bk\"" Sep 17 03:12:43.463847 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.463527 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 03:12:43.463847 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.463687 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 03:12:43.465738 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.464812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.465738 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.465338 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 03:12:43.465738 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.465568 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 03:12:43.465738 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.465587 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 03:12:43.465738 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.465611 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 03:12:43.467368 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.467346 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 03:12:43.467467 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.467434 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 03:12:43.467571 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.467556 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 03:12:43.467703 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.467686 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tvd6h\"" Sep 17 03:12:43.468465 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.468442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:43.468574 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.468551 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:12:43.469025 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.469007 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 03:12:43.469396 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.469193 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 03:12:43.469895 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.469396 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 03:12:43.469895 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.469686 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n6j98\"" Sep 17 03:12:43.469999 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.469989 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 03:12:43.471739 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.471585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.472963 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.472725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:12:43.473998 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.473984 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 03:12:43.474289 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.474272 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 03:12:43.474399 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.474371 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:12:43.474512 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.474495 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jcvgx\"" Sep 17 03:12:43.475372 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.475353 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 03:12:43.475821 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.475723 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ktv5m\"" Sep 17 03:12:43.476978 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.476191 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 03:12:43.476978 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.476476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.480169 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.480125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.480308 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.480280 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:43.480391 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.480374 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 03:12:43.480450 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.480395 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:12:43.480508 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.480479 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qtz4w\"" Sep 17 03:12:43.482255 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.481971 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:12:43.482987 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.482970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.483280 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483256 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-kubelet\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.483370 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-systemd-units\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.483370 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-systemd\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.483370 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-env-overrides\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.483370 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-conf-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.483370 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-daemon-config\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.483370 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-multus-certs\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.483698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-ovn\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.483698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-socket-dir-parent\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.483698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26576713-2e08-4aee-982c-0204f319cedb-iptables-alerter-script\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.483698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/910e82f1-c23b-4aac-bcc9-d5c6c2fc931f-agent-certs\") pod \"konnectivity-agent-s6k82\" (UID: \"910e82f1-c23b-4aac-bcc9-d5c6c2fc931f\") " pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:12:43.483698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0532d583-5a56-4b5c-84d6-41813e578c36-tmp-dir\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.483698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnn2b\" (UniqueName: \"kubernetes.io/projected/0532d583-5a56-4b5c-84d6-41813e578c36-kube-api-access-vnn2b\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.483698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-log-socket\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.483698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-cni-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-cni-multus\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-hostroot\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8csjz\" (UniqueName: \"kubernetes.io/projected/e543faf0-188b-4617-91a4-2c86fc7a2f29-kube-api-access-8csjz\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-cni-netd\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-system-cni-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-cnibin\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0532d583-5a56-4b5c-84d6-41813e578c36-hosts-file\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.483996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-etc-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-netns\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-var-lib-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovnkube-config\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484159 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovn-node-metrics-cert\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovnkube-script-lib\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwcbm\" (UniqueName: \"kubernetes.io/projected/b8c931ac-1fa1-402f-a2ab-805cc98932e9-kube-api-access-rwcbm\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-kubelet\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6klp\" (UniqueName: \"kubernetes.io/projected/7650d0ed-b945-4f0e-9388-02dd48fdca9b-kube-api-access-s6klp\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-slash\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-run-netns\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-node-log\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-cni-bin\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-etc-kubernetes\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26576713-2e08-4aee-982c-0204f319cedb-host-slash\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7650d0ed-b945-4f0e-9388-02dd48fdca9b-cni-binary-copy\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484535 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-k8s-cni-cncf-io\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-cni-bin\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.484934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5dqp\" (UniqueName: \"kubernetes.io/projected/26576713-2e08-4aee-982c-0204f319cedb-kube-api-access-r5dqp\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.485914 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.484684 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/910e82f1-c23b-4aac-bcc9-d5c6c2fc931f-konnectivity-ca\") pod \"konnectivity-agent-s6k82\" (UID: \"910e82f1-c23b-4aac-bcc9-d5c6c2fc931f\") " pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:12:43.485914 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.485374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.485914 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.485445 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5v6l5\"" Sep 17 03:12:43.486123 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.485933 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 03:12:43.486123 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.486003 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 03:12:43.486288 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.486219 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 03:12:43.487892 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.487869 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 03:12:43.488015 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.487876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.488294 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.488273 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 03:12:43.488372 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.488281 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m7ndm\"" Sep 17 03:12:43.488466 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.488446 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 03:12:43.490266 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.490246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:43.490355 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.490306 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:43.490536 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.490516 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 03:12:43.490732 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.490715 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 03:12:43.490943 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.490919 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mx645\"" Sep 17 03:12:43.502626 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.502606 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ds9s" Sep 17 03:12:43.510268 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.510251 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ds9s" Sep 17 03:12:43.572409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.572388 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 03:12:43.585549 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-conf-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.585549 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-daemon-config\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.585759 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26576713-2e08-4aee-982c-0204f319cedb-iptables-alerter-script\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.585759 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585608 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-conf-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.585759 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/910e82f1-c23b-4aac-bcc9-d5c6c2fc931f-agent-certs\") pod \"konnectivity-agent-s6k82\" (UID: \"910e82f1-c23b-4aac-bcc9-d5c6c2fc931f\") " pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:12:43.585866 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysctl-d\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.585866 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-log-socket\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.585866 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-cni-multus\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.585966 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585876 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-hostroot\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.585966 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.585966 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb6b281c-57cb-4f14-bd80-5bb14259031b-host\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.585966 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-cni-netd\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586101 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-cnibin\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586101 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.585996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.586101 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysctl-conf\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.586101 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-etc-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586101 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-netns\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586101 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-system-cni-dir\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-systemd\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586153 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-daemon-config\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586188 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26576713-2e08-4aee-982c-0204f319cedb-iptables-alerter-script\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-var-lib-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovnkube-config\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586257 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-cni-netd\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-var-lib-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586271 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-etc-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovn-node-metrics-cert\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586335 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-cnibin\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwcbm\" (UniqueName: \"kubernetes.io/projected/b8c931ac-1fa1-402f-a2ab-805cc98932e9-kube-api-access-rwcbm\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-kubelet\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-tmp\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586431 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-log-socket\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-node-log\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586432 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-cni-multus\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-etc-kubernetes\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586483 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-etc-kubernetes\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-sys\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586518 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-kubelet\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-hostroot\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-k8s-cni-cncf-io\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586583 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-netns\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586583 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-node-log\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-dbus\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586619 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-k8s-cni-cncf-io\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.586982 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdw6s\" (UniqueName: \"kubernetes.io/projected/eb6b281c-57cb-4f14-bd80-5bb14259031b-kube-api-access-tdw6s\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-kubelet\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-systemd-units\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586754 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-kubelet\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586755 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586766 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-systemd-units\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-systemd\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-env-overrides\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586807 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-systemd\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovnkube-config\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.586928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-multus-certs\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-run-multus-certs\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0532d583-5a56-4b5c-84d6-41813e578c36-tmp-dir\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnn2b\" (UniqueName: \"kubernetes.io/projected/0532d583-5a56-4b5c-84d6-41813e578c36-kube-api-access-vnn2b\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-sys-fs\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-ovn\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-socket-dir-parent\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587676 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-env-overrides\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.587727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-registration-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-device-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb6b281c-57cb-4f14-bd80-5bb14259031b-serviceca\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587828 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0532d583-5a56-4b5c-84d6-41813e578c36-tmp-dir\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587841 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-ovn\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.587900 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-socket-dir-parent\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cnibin\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-kubernetes\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-lib-modules\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-cni-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8csjz\" (UniqueName: \"kubernetes.io/projected/e543faf0-188b-4617-91a4-2c86fc7a2f29-kube-api-access-8csjz\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cni-binary-copy\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-var-lib-kubelet\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.588514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-system-cni-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0532d583-5a56-4b5c-84d6-41813e578c36-hosts-file\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-socket-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hrt4\" (UniqueName: \"kubernetes.io/projected/21afd526-ac70-4470-8e49-d80e44eb06e7-kube-api-access-6hrt4\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-run\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovnkube-script-lib\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6klp\" (UniqueName: \"kubernetes.io/projected/7650d0ed-b945-4f0e-9388-02dd48fdca9b-kube-api-access-s6klp\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysconfig\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.588957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-host\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-tuned\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsjd\" (UniqueName: \"kubernetes.io/projected/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-kube-api-access-svsjd\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.589071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-slash\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-run-netns\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-cni-bin\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26576713-2e08-4aee-982c-0204f319cedb-host-slash\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5dqp\" (UniqueName: \"kubernetes.io/projected/26576713-2e08-4aee-982c-0204f319cedb-kube-api-access-r5dqp\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7650d0ed-b945-4f0e-9388-02dd48fdca9b-cni-binary-copy\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-cni-bin\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/910e82f1-c23b-4aac-bcc9-d5c6c2fc931f-konnectivity-ca\") pod \"konnectivity-agent-s6k82\" (UID: \"910e82f1-c23b-4aac-bcc9-d5c6c2fc931f\") " pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589549 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-kubelet-config\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gcr2\" (UniqueName: \"kubernetes.io/projected/c5ef68f6-bc19-4935-a47f-32cf61ecb480-kube-api-access-8gcr2\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.589668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.589654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-modprobe-d\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.590228 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.590018 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-multus-cni-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.590505 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.590485 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.590610 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.590596 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-system-cni-dir\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.590691 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.590677 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0532d583-5a56-4b5c-84d6-41813e578c36-hosts-file\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.590809 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.590795 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:43.591522 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.590975 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-run-netns\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.591522 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591082 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-run-openvswitch\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.591522 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591125 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-slash\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.591746 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591599 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.591746 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591728 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/910e82f1-c23b-4aac-bcc9-d5c6c2fc931f-agent-certs\") pod \"konnectivity-agent-s6k82\" (UID: \"910e82f1-c23b-4aac-bcc9-d5c6c2fc931f\") " pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:12:43.591861 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591731 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/910e82f1-c23b-4aac-bcc9-d5c6c2fc931f-konnectivity-ca\") pod \"konnectivity-agent-s6k82\" (UID: \"910e82f1-c23b-4aac-bcc9-d5c6c2fc931f\") " pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:12:43.591861 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591806 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7650d0ed-b945-4f0e-9388-02dd48fdca9b-host-var-lib-cni-bin\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.591861 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591802 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8c931ac-1fa1-402f-a2ab-805cc98932e9-host-cni-bin\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.591861 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591843 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovnkube-script-lib\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.591999 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.591866 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26576713-2e08-4aee-982c-0204f319cedb-host-slash\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.592264 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.592157 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7650d0ed-b945-4f0e-9388-02dd48fdca9b-cni-binary-copy\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.594056 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.593148 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:44.093092859 +0000 UTC m=+2.956354005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:43.594056 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.593713 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8c931ac-1fa1-402f-a2ab-805cc98932e9-ovn-node-metrics-cert\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.596357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.596298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwcbm\" (UniqueName: \"kubernetes.io/projected/b8c931ac-1fa1-402f-a2ab-805cc98932e9-kube-api-access-rwcbm\") pod \"ovnkube-node-b9p46\" (UID: \"b8c931ac-1fa1-402f-a2ab-805cc98932e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.596624 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.596607 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnn2b\" (UniqueName: \"kubernetes.io/projected/0532d583-5a56-4b5c-84d6-41813e578c36-kube-api-access-vnn2b\") pod \"node-resolver-l8xw5\" (UID: \"0532d583-5a56-4b5c-84d6-41813e578c36\") " pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.601223 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.601200 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8csjz\" (UniqueName: \"kubernetes.io/projected/e543faf0-188b-4617-91a4-2c86fc7a2f29-kube-api-access-8csjz\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:43.603623 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.603600 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5dqp\" (UniqueName: \"kubernetes.io/projected/26576713-2e08-4aee-982c-0204f319cedb-kube-api-access-r5dqp\") pod \"iptables-alerter-plvzf\" (UID: \"26576713-2e08-4aee-982c-0204f319cedb\") " pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.604304 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.604233 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6klp\" (UniqueName: \"kubernetes.io/projected/7650d0ed-b945-4f0e-9388-02dd48fdca9b-kube-api-access-s6klp\") pod \"multus-m9lkk\" (UID: \"7650d0ed-b945-4f0e-9388-02dd48fdca9b\") " pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.606576 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.606533 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" event={"ID":"9fbdb2946952c0407983c912e3ae8e84","Type":"ContainerStarted","Data":"9d4e6cc234267b6e7759d09dc9ce853a62fae1eef539a8760c371b49ee274153"} Sep 17 03:12:43.608011 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.607990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" event={"ID":"c6a0ddb2d746c4b2daf268b391c6bd11","Type":"ContainerStarted","Data":"e7661927b867ca2c5770bd04cfd3f2be279ee8ad1860cbc38b2d036b74b05a7a"} Sep 17 03:12:43.689941 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.689884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.689941 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.689928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-tmp\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.689953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-sys\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.689977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-dbus\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw6s\" (UniqueName: \"kubernetes.io/projected/eb6b281c-57cb-4f14-bd80-5bb14259031b-kube-api-access-tdw6s\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-sys-fs\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-registration-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-device-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb6b281c-57cb-4f14-bd80-5bb14259031b-serviceca\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cnibin\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-kubernetes\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-lib-modules\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cni-binary-copy\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-var-lib-kubelet\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-socket-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:43.690235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hrt4\" (UniqueName: \"kubernetes.io/projected/21afd526-ac70-4470-8e49-d80e44eb06e7-kube-api-access-6hrt4\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-run\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysconfig\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-host\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-tuned\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svsjd\" (UniqueName: \"kubernetes.io/projected/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-kube-api-access-svsjd\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-kubelet-config\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gcr2\" (UniqueName: \"kubernetes.io/projected/c5ef68f6-bc19-4935-a47f-32cf61ecb480-kube-api-access-8gcr2\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-modprobe-d\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690498 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysctl-d\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690579 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb6b281c-57cb-4f14-bd80-5bb14259031b-host\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysctl-conf\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.691922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-system-cni-dir\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-systemd\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690810 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-systemd\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690862 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-var-lib-kubelet\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690939 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cni-binary-copy\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.690965 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-socket-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691179 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-run\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysconfig\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691243 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-registration-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691286 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-sys\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691325 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-dbus\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.691370 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691405 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cnibin\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691481 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-host\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691525 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-kubernetes\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-kubelet-config\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.691543 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret podName:9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc nodeName:}" failed. No retries permitted until 2026-09-17 03:12:44.191524141 +0000 UTC m=+3.054785234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret") pod "global-pull-secret-syncer-7f78c" (UID: "9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:43.692761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691563 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-sys-fs\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-modprobe-d\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691644 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-lib-modules\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691757 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysctl-conf\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691760 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-sysctl-d\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691805 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691827 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-device-dir\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691852 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-system-cni-dir\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691913 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/21afd526-ac70-4470-8e49-d80e44eb06e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.691960 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb6b281c-57cb-4f14-bd80-5bb14259031b-host\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.692022 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5ef68f6-bc19-4935-a47f-32cf61ecb480-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.692081 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5ef68f6-bc19-4935-a47f-32cf61ecb480-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.693528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.692260 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb6b281c-57cb-4f14-bd80-5bb14259031b-serviceca\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.694096 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.693962 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-etc-tuned\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.694096 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.694004 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-tmp\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.697887 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.697863 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:43.697996 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.697893 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:43.697996 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.697907 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cbmb8 for pod openshift-network-diagnostics/network-check-target-xp5z7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:43.697996 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:43.697964 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8 podName:c699a707-ec90-468b-bb43-f7fee8be33b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:44.197947904 +0000 UTC m=+3.061208995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cbmb8" (UniqueName: "kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8") pod "network-check-target-xp5z7" (UID: "c699a707-ec90-468b-bb43-f7fee8be33b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:43.700366 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.700339 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdw6s\" (UniqueName: \"kubernetes.io/projected/eb6b281c-57cb-4f14-bd80-5bb14259031b-kube-api-access-tdw6s\") pod \"node-ca-ccc4b\" (UID: \"eb6b281c-57cb-4f14-bd80-5bb14259031b\") " pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.702110 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.702083 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gcr2\" (UniqueName: \"kubernetes.io/projected/c5ef68f6-bc19-4935-a47f-32cf61ecb480-kube-api-access-8gcr2\") pod \"multus-additional-cni-plugins-sh6t2\" (UID: \"c5ef68f6-bc19-4935-a47f-32cf61ecb480\") " pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:43.702332 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.702310 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hrt4\" (UniqueName: \"kubernetes.io/projected/21afd526-ac70-4470-8e49-d80e44eb06e7-kube-api-access-6hrt4\") pod \"aws-ebs-csi-driver-node-n64wh\" (UID: \"21afd526-ac70-4470-8e49-d80e44eb06e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.704241 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.704210 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsjd\" (UniqueName: \"kubernetes.io/projected/c898e1e8-f2c0-4a0a-a34e-747bfeb4d500-kube-api-access-svsjd\") pod \"tuned-4brbb\" (UID: \"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500\") " pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.775238 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.775155 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8xw5" Sep 17 03:12:43.786621 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.786598 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:12:43.797526 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.797505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9lkk" Sep 17 03:12:43.803283 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.803258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-plvzf" Sep 17 03:12:43.811904 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.811875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:12:43.821528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.821505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4brbb" Sep 17 03:12:43.828252 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.828232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" Sep 17 03:12:43.835874 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.835852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ccc4b" Sep 17 03:12:43.842447 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:43.842424 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" Sep 17 03:12:44.093806 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:44.093730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:44.093961 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.093846 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:44.093961 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.093908 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:45.093889617 +0000 UTC m=+3.957150718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:44.194161 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:44.194124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:44.194338 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.194261 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:44.194338 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.194324 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret podName:9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc nodeName:}" failed. No retries permitted until 2026-09-17 03:12:45.194306994 +0000 UTC m=+4.057568071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret") pod "global-pull-secret-syncer-7f78c" (UID: "9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:44.294627 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:44.294556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:44.294812 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.294747 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:44.294812 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.294767 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:44.294812 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.294777 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cbmb8 for pod openshift-network-diagnostics/network-check-target-xp5z7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:44.294972 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.294829 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8 podName:c699a707-ec90-468b-bb43-f7fee8be33b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:45.294814914 +0000 UTC m=+4.158076016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbmb8" (UniqueName: "kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8") pod "network-check-target-xp5z7" (UID: "c699a707-ec90-468b-bb43-f7fee8be33b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:44.513836 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:44.513753 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:07:43 +0000 UTC" deadline="2028-04-24 00:45:05.267097584 +0000 UTC" Sep 17 03:12:44.513836 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:44.513782 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14037h32m20.753318539s" Sep 17 03:12:44.602618 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:44.602590 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:44.602802 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:44.602717 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:44.632939 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:44.632912 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:44.712484 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:44.712276 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6b281c_57cb_4f14_bd80_5bb14259031b.slice/crio-e8df9f3ecfdf6e9fea984d39c1a0174f769da93ed5b902e17a45328db98b4ce8 WatchSource:0}: Error finding container e8df9f3ecfdf6e9fea984d39c1a0174f769da93ed5b902e17a45328db98b4ce8: Status 404 returned error can't find the container with id e8df9f3ecfdf6e9fea984d39c1a0174f769da93ed5b902e17a45328db98b4ce8 Sep 17 03:12:44.713359 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:44.713331 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910e82f1_c23b_4aac_bcc9_d5c6c2fc931f.slice/crio-0f6d0684735b187964daf7734ff190c39de2f2b330bc3519f70bb65d7db3102e WatchSource:0}: Error finding container 0f6d0684735b187964daf7734ff190c39de2f2b330bc3519f70bb65d7db3102e: Status 404 returned error can't find the container with id 0f6d0684735b187964daf7734ff190c39de2f2b330bc3519f70bb65d7db3102e Sep 17 03:12:44.715651 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:44.715498 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c931ac_1fa1_402f_a2ab_805cc98932e9.slice/crio-ec1337f4a9c0e736cab4eeb19d765377c523935ed1d05f1d245d3fedab3b02c1 WatchSource:0}: Error finding container ec1337f4a9c0e736cab4eeb19d765377c523935ed1d05f1d245d3fedab3b02c1: Status 404 returned error can't find the container with id ec1337f4a9c0e736cab4eeb19d765377c523935ed1d05f1d245d3fedab3b02c1 Sep 17 03:12:44.717548 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:44.717521 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26576713_2e08_4aee_982c_0204f319cedb.slice/crio-2a03c5dddade6703e07a476b42a5cda022e7501a8fc38b1b9ca30ba33f6af1c9 WatchSource:0}: Error finding container 2a03c5dddade6703e07a476b42a5cda022e7501a8fc38b1b9ca30ba33f6af1c9: Status 404 returned error can't find the container with id 2a03c5dddade6703e07a476b42a5cda022e7501a8fc38b1b9ca30ba33f6af1c9 Sep 17 03:12:44.718459 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:44.718437 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc898e1e8_f2c0_4a0a_a34e_747bfeb4d500.slice/crio-329e1d7768486b2811eb70a9997580433b436a1aefc47f4ad1b58948b9ce9329 WatchSource:0}: Error finding container 329e1d7768486b2811eb70a9997580433b436a1aefc47f4ad1b58948b9ce9329: Status 404 returned error can't find the container with id 329e1d7768486b2811eb70a9997580433b436a1aefc47f4ad1b58948b9ce9329 Sep 17 03:12:44.719468 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:44.719444 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21afd526_ac70_4470_8e49_d80e44eb06e7.slice/crio-2fe5f0b45a0980dc5eb545fc3042f5ced2fbdd3d80235595a2aef2c763b6e596 WatchSource:0}: Error finding container 2fe5f0b45a0980dc5eb545fc3042f5ced2fbdd3d80235595a2aef2c763b6e596: Status 404 returned error can't find the container with id 2fe5f0b45a0980dc5eb545fc3042f5ced2fbdd3d80235595a2aef2c763b6e596 Sep 17 03:12:44.720366 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:44.720266 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0532d583_5a56_4b5c_84d6_41813e578c36.slice/crio-c05cd5ab6bfc4e64a2db27aed3dd232b0d23d2873ccc01e39cb20153fe3a547e WatchSource:0}: Error finding container c05cd5ab6bfc4e64a2db27aed3dd232b0d23d2873ccc01e39cb20153fe3a547e: Status 404 returned error can't find the container with id c05cd5ab6bfc4e64a2db27aed3dd232b0d23d2873ccc01e39cb20153fe3a547e Sep 17 03:12:44.722033 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:12:44.721903 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ef68f6_bc19_4935_a47f_32cf61ecb480.slice/crio-319775623b2db7924c6e64e80c42e8bdcea8be6cf4c8b77d186a78957bf24214 WatchSource:0}: Error finding container 319775623b2db7924c6e64e80c42e8bdcea8be6cf4c8b77d186a78957bf24214: Status 404 returned error can't find the container with id 319775623b2db7924c6e64e80c42e8bdcea8be6cf4c8b77d186a78957bf24214 Sep 17 03:12:45.100120 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.099976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:45.100280 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.100151 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:45.100280 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.100217 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:47.100200896 +0000 UTC m=+5.963461986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:45.201693 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.201066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:45.201693 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.201247 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:45.201693 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.201311 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret podName:9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc nodeName:}" failed. No retries permitted until 2026-09-17 03:12:47.201293573 +0000 UTC m=+6.064554668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret") pod "global-pull-secret-syncer-7f78c" (UID: "9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:45.301995 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.301954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:45.302177 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.302149 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:45.302177 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.302169 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:45.302283 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.302182 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cbmb8 for pod openshift-network-diagnostics/network-check-target-xp5z7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:45.302283 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.302240 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8 podName:c699a707-ec90-468b-bb43-f7fee8be33b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:47.30222156 +0000 UTC m=+6.165482645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbmb8" (UniqueName: "kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8") pod "network-check-target-xp5z7" (UID: "c699a707-ec90-468b-bb43-f7fee8be33b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:45.514549 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.514429 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:07:43 +0000 UTC" deadline="2028-03-12 11:16:29.363381175 +0000 UTC" Sep 17 03:12:45.514549 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.514495 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13016h3m43.848890243s" Sep 17 03:12:45.607832 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.607802 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:45.607996 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.607940 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:12:45.608349 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.608329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:45.608460 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:45.608439 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:45.615653 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.614987 2562 generic.go:356] "Generic (PLEG): container finished" podID="9fbdb2946952c0407983c912e3ae8e84" containerID="7f12615332b9160c43dc18434b4ccb38845df49a82bf2363d68d6d85d38f514e" exitCode=0 Sep 17 03:12:45.615653 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.615070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" event={"ID":"9fbdb2946952c0407983c912e3ae8e84","Type":"ContainerDied","Data":"7f12615332b9160c43dc18434b4ccb38845df49a82bf2363d68d6d85d38f514e"} Sep 17 03:12:45.621929 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.621900 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8xw5" event={"ID":"0532d583-5a56-4b5c-84d6-41813e578c36","Type":"ContainerStarted","Data":"c05cd5ab6bfc4e64a2db27aed3dd232b0d23d2873ccc01e39cb20153fe3a547e"} Sep 17 03:12:45.628614 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.628587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerStarted","Data":"319775623b2db7924c6e64e80c42e8bdcea8be6cf4c8b77d186a78957bf24214"} Sep 17 03:12:45.634804 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.634773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4brbb" event={"ID":"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500","Type":"ContainerStarted","Data":"329e1d7768486b2811eb70a9997580433b436a1aefc47f4ad1b58948b9ce9329"} Sep 17 03:12:45.655368 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.655285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-plvzf" event={"ID":"26576713-2e08-4aee-982c-0204f319cedb","Type":"ContainerStarted","Data":"2a03c5dddade6703e07a476b42a5cda022e7501a8fc38b1b9ca30ba33f6af1c9"} Sep 17 03:12:45.668292 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.668227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ccc4b" event={"ID":"eb6b281c-57cb-4f14-bd80-5bb14259031b","Type":"ContainerStarted","Data":"e8df9f3ecfdf6e9fea984d39c1a0174f769da93ed5b902e17a45328db98b4ce8"} Sep 17 03:12:45.693712 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.693672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" event={"ID":"c6a0ddb2d746c4b2daf268b391c6bd11","Type":"ContainerStarted","Data":"3d140bb6b0a5133d016dc5d4f76455af22e69ca74600127aa4ac1fd7dde30aa8"} Sep 17 03:12:45.710287 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.710195 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9lkk" event={"ID":"7650d0ed-b945-4f0e-9388-02dd48fdca9b","Type":"ContainerStarted","Data":"acc1cf4913760c287ba046f8246b628acc2cb9c842bb93e0ca3fbe12206e9807"} Sep 17 03:12:45.712058 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.711699 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-44.ec2.internal" podStartSLOduration=3.711679889 podStartE2EDuration="3.711679889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:12:45.710460497 +0000 UTC m=+4.573721596" watchObservedRunningTime="2026-09-17 03:12:45.711679889 +0000 UTC m=+4.574940991" Sep 17 03:12:45.732016 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.731980 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" event={"ID":"21afd526-ac70-4470-8e49-d80e44eb06e7","Type":"ContainerStarted","Data":"2fe5f0b45a0980dc5eb545fc3042f5ced2fbdd3d80235595a2aef2c763b6e596"} Sep 17 03:12:45.742775 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.742742 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"ec1337f4a9c0e736cab4eeb19d765377c523935ed1d05f1d245d3fedab3b02c1"} Sep 17 03:12:45.768834 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:45.768752 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s6k82" event={"ID":"910e82f1-c23b-4aac-bcc9-d5c6c2fc931f","Type":"ContainerStarted","Data":"0f6d0684735b187964daf7734ff190c39de2f2b330bc3519f70bb65d7db3102e"} Sep 17 03:12:46.602335 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:46.601830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:46.602335 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:46.601956 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:46.792188 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:46.792126 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" event={"ID":"9fbdb2946952c0407983c912e3ae8e84","Type":"ContainerStarted","Data":"787b0b1675eca1845aa8f08424134e593b3a765b4eb283ea3e8ce8b233fd113f"} Sep 17 03:12:47.129122 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:47.128505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:47.129122 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.128705 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:47.129122 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.128772 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:51.128752232 +0000 UTC m=+9.992013312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:47.230341 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:47.229734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:47.230341 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.229933 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:47.230341 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.229996 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret podName:9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc nodeName:}" failed. No retries permitted until 2026-09-17 03:12:51.229978844 +0000 UTC m=+10.093239935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret") pod "global-pull-secret-syncer-7f78c" (UID: "9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:47.331195 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:47.330500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:47.331195 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.330749 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:47.331195 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.330768 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:47.331195 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.330781 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cbmb8 for pod openshift-network-diagnostics/network-check-target-xp5z7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:47.331195 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.330843 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8 podName:c699a707-ec90-468b-bb43-f7fee8be33b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:51.330825446 +0000 UTC m=+10.194086545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbmb8" (UniqueName: "kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8") pod "network-check-target-xp5z7" (UID: "c699a707-ec90-468b-bb43-f7fee8be33b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:47.605979 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:47.605896 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:47.606410 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.606029 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:12:47.606472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:47.606409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:47.606520 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:47.606498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:48.602031 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:48.602000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:48.602217 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:48.602136 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:49.602098 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:49.602055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:49.602582 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:49.602055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:49.602582 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:49.602178 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:49.602582 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:49.602258 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:12:50.602408 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:50.602317 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:50.602929 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:50.602465 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:51.164433 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:51.164392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:51.164604 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.164578 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:51.164701 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.164676 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:59.164653691 +0000 UTC m=+18.027914784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:51.265340 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:51.265301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:51.265533 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.265481 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:51.265597 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.265550 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret podName:9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc nodeName:}" failed. No retries permitted until 2026-09-17 03:12:59.265533102 +0000 UTC m=+18.128794181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret") pod "global-pull-secret-syncer-7f78c" (UID: "9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:51.366255 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:51.366214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:51.366443 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.366426 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:51.366511 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.366448 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:51.366511 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.366462 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cbmb8 for pod openshift-network-diagnostics/network-check-target-xp5z7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:51.366611 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.366524 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8 podName:c699a707-ec90-468b-bb43-f7fee8be33b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:59.366505632 +0000 UTC m=+18.229766729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbmb8" (UniqueName: "kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8") pod "network-check-target-xp5z7" (UID: "c699a707-ec90-468b-bb43-f7fee8be33b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:51.605771 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:51.605489 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:51.606188 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.605837 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:12:51.606188 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:51.605538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:51.606287 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:51.606223 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:52.602057 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:52.602023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:52.602215 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:52.602162 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:53.602534 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:53.602502 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:53.603004 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:53.602645 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:53.603004 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:53.602682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:53.603004 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:53.602777 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:12:54.602339 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:54.602299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:54.602523 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:54.602425 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:55.602247 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:55.602212 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:55.602726 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:55.602208 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:55.602726 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:55.602328 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:55.602726 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:55.602388 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:12:56.602531 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:56.602497 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:56.602964 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:56.602617 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:57.601878 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:57.601846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:57.602065 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:57.601861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:57.602065 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:57.601983 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:57.602065 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:57.602055 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:12:58.602541 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:58.602450 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:58.603023 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:58.602588 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:12:59.225691 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:59.225655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:59.225872 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.225799 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:59.225872 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.225868 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:15.225847735 +0000 UTC m=+34.089108832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:59.326232 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:59.326188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:12:59.326416 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.326335 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:59.326416 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.326398 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret podName:9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc nodeName:}" failed. No retries permitted until 2026-09-17 03:13:15.326383766 +0000 UTC m=+34.189644864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret") pod "global-pull-secret-syncer-7f78c" (UID: "9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:59.427426 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:59.427390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:59.427596 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.427550 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:59.427596 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.427570 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:59.427596 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.427582 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cbmb8 for pod openshift-network-diagnostics/network-check-target-xp5z7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:59.427732 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.427645 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8 podName:c699a707-ec90-468b-bb43-f7fee8be33b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:15.427618973 +0000 UTC m=+34.290880054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbmb8" (UniqueName: "kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8") pod "network-check-target-xp5z7" (UID: "c699a707-ec90-468b-bb43-f7fee8be33b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:59.601939 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:59.601852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:12:59.601939 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:12:59.601897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:12:59.602157 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.601988 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:12:59.602157 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:12:59.602116 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:00.602566 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:00.602530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:00.602990 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:00.602656 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:01.603016 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:01.602977 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:01.603474 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:01.603148 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:13:01.603474 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:01.603187 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:01.603474 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:01.603289 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:02.603012 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.601941 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:02.603012 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:02.602057 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:02.828428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.828234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8xw5" event={"ID":"0532d583-5a56-4b5c-84d6-41813e578c36","Type":"ContainerStarted","Data":"1095dfeb85552e9624387eebaea1cfa9c131980a40f79dfe2e4494000db1646a"} Sep 17 03:13:02.829989 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.829961 2562 generic.go:356] "Generic (PLEG): container finished" podID="c5ef68f6-bc19-4935-a47f-32cf61ecb480" containerID="6d0b57e30182fbaa4e80141ac0b9ba1b778bb89713e43cfdf9fa2107ce29ebd0" exitCode=0 Sep 17 03:13:02.830095 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.830059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerDied","Data":"6d0b57e30182fbaa4e80141ac0b9ba1b778bb89713e43cfdf9fa2107ce29ebd0"} Sep 17 03:13:02.831591 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.831566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4brbb" event={"ID":"c898e1e8-f2c0-4a0a-a34e-747bfeb4d500","Type":"ContainerStarted","Data":"21abef34cc12248ef2dedc9719b15528c8a11c9a6d64062d1f24e74d856d85ad"} Sep 17 03:13:02.833339 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.833316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ccc4b" event={"ID":"eb6b281c-57cb-4f14-bd80-5bb14259031b","Type":"ContainerStarted","Data":"cca549879350432c498484f49c0f8936da4aebe3e6658a50f43d9a3da56fcc96"} Sep 17 03:13:02.836660 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.835154 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9lkk" event={"ID":"7650d0ed-b945-4f0e-9388-02dd48fdca9b","Type":"ContainerStarted","Data":"cc4f22480eae96e1386f511f4e0029ff8e717f6c9868b183028cfc41ad819185"} Sep 17 03:13:02.838220 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.838201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" event={"ID":"21afd526-ac70-4470-8e49-d80e44eb06e7","Type":"ContainerStarted","Data":"53efda5110587b8f6d89f22e77e2dcddfaaee5e4e9592f16f59d7dce0011229c"} Sep 17 03:13:02.840057 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.840040 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"e4eac4c7c76bbf16972cf8ac082bae650c0a778efe6ea728ffcf80937f3f82b3"} Sep 17 03:13:02.840137 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.840101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"9eb98db393256f50c9f575121fcc833dcd8e03233e3a4154ec6125aa4e2f1f46"} Sep 17 03:13:02.840199 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.840137 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"308f5599aabf1bfb7ed199f5b2005d023ac6d9ba9a80953d1a141031bec4c840"} Sep 17 03:13:02.841302 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.841284 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s6k82" event={"ID":"910e82f1-c23b-4aac-bcc9-d5c6c2fc931f","Type":"ContainerStarted","Data":"c09300a4afd873af47d8e0b60149d972a834cde4eff6efe094e7df18d3500696"} Sep 17 03:13:02.843942 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.843904 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l8xw5" podStartSLOduration=4.222445391 podStartE2EDuration="21.843893376s" totalImagesPullingTime="17.621447985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.84340799 +0000 UTC m=+21.706669110" watchObservedRunningTime="2026-09-17 03:13:02.843893376 +0000 UTC m=+21.707154476" Sep 17 03:13:02.844230 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.844209 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-44.ec2.internal" podStartSLOduration=20.844204089 podStartE2EDuration="20.844204089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:12:46.808293332 +0000 UTC m=+5.671554432" watchObservedRunningTime="2026-09-17 03:13:02.844204089 +0000 UTC m=+21.707465187" Sep 17 03:13:02.860561 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.860492 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4brbb" podStartSLOduration=4.236781859 podStartE2EDuration="21.860481874s" totalImagesPullingTime="17.623700015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.860408576 +0000 UTC m=+21.723669675" watchObservedRunningTime="2026-09-17 03:13:02.860481874 +0000 UTC m=+21.723742973" Sep 17 03:13:02.876304 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.876269 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ccc4b" podStartSLOduration=4.265534337 podStartE2EDuration="21.876254299s" totalImagesPullingTime="17.610719962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.876235609 +0000 UTC m=+21.739496707" watchObservedRunningTime="2026-09-17 03:13:02.876254299 +0000 UTC m=+21.739515382" Sep 17 03:13:02.918870 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.918833 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m9lkk" podStartSLOduration=4.259579338 podStartE2EDuration="21.918819257s" totalImagesPullingTime="17.659239919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.918787288 +0000 UTC m=+21.782048386" watchObservedRunningTime="2026-09-17 03:13:02.918819257 +0000 UTC m=+21.782080357" Sep 17 03:13:02.934521 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:02.934486 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s6k82" podStartSLOduration=8.402610453 podStartE2EDuration="21.934472338s" totalImagesPullingTime="13.531861885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.934423585 +0000 UTC m=+21.797684695" watchObservedRunningTime="2026-09-17 03:13:02.934472338 +0000 UTC m=+21.797733415" Sep 17 03:13:03.602371 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:03.602344 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:03.602503 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:03.602358 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:03.602503 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:03.602471 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:13:03.602621 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:03.602531 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:03.847473 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:03.847388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"22c6a86a9edd9440fb7b7a330d7f3e777045e54cffae2fe3ed8e8b3c2b085862"} Sep 17 03:13:03.848318 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:03.847480 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"dfb2d9ba7a764bb7707f71bc03188dbcf3a25cf67e66a95969caad7386afa9d8"} Sep 17 03:13:03.848318 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:03.847512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"af6b82064f212764d9bf52fb9abd2cd6ac2c6ae3a98de8e75ac6a29f0ea61261"} Sep 17 03:13:03.849094 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:03.849003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-plvzf" event={"ID":"26576713-2e08-4aee-982c-0204f319cedb","Type":"ContainerStarted","Data":"1a903fdb9b54a42e7467d6c0f4d70e9945289ef2d6b75a32a984bec4bffca8e8"} Sep 17 03:13:03.865014 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:03.864969 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-plvzf" podStartSLOduration=5.259690738 podStartE2EDuration="22.864955435s" totalImagesPullingTime="17.605264697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:03.864762208 +0000 UTC m=+22.728023305" watchObservedRunningTime="2026-09-17 03:13:03.864955435 +0000 UTC m=+22.728216534" Sep 17 03:13:04.001382 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:04.001206 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 03:13:04.537720 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:04.537588 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T03:13:04.001379889Z","UUID":"20c5d09d-d144-43ca-bae0-b88b76d510ad","Handler":null,"Name":"","Endpoint":""} Sep 17 03:13:04.539386 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:04.539352 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 03:13:04.539513 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:04.539394 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 03:13:04.601788 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:04.601734 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:04.601958 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:04.601888 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:04.853733 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:04.853662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" event={"ID":"21afd526-ac70-4470-8e49-d80e44eb06e7","Type":"ContainerStarted","Data":"5f3720e6e65ea00d49ab1788dfea9f0b0f83b610b60959dd394bd17e97d1a902"} Sep 17 03:13:05.602073 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:05.601981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:05.602239 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:05.601995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:05.602239 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:05.602127 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:05.602347 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:05.602234 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:13:05.858881 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:05.858802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" event={"ID":"21afd526-ac70-4470-8e49-d80e44eb06e7","Type":"ContainerStarted","Data":"3c453120caaebae78bf750074e0ce4f224bf4fbe9ef053245f5cb4721a5b574b"} Sep 17 03:13:05.863081 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:05.863053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"28dbd70e9381f8044e8c75d6290894dde83bd41b1e5471209c7eca0197967015"} Sep 17 03:13:06.601651 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:06.601609 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:06.601831 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:06.601762 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:07.096776 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.096698 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:13:07.097320 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.097294 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:13:07.113204 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.113162 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n64wh" podStartSLOduration=6.101968058 podStartE2EDuration="26.113147083s" totalImagesPullingTime="20.011179025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:05.875605268 +0000 UTC m=+24.738866367" watchObservedRunningTime="2026-09-17 03:13:07.113147083 +0000 UTC m=+25.976408182" Sep 17 03:13:07.601983 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.601820 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:07.602112 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.601848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:07.602112 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:07.602101 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:13:07.602224 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:07.602195 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:07.868788 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.868761 2562 generic.go:356] "Generic (PLEG): container finished" podID="c5ef68f6-bc19-4935-a47f-32cf61ecb480" containerID="5132560955e0e7890b5d0b210971b52783077f0f611f303cbe42a5cb1d851d85" exitCode=0 Sep 17 03:13:07.868937 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.868859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerDied","Data":"5132560955e0e7890b5d0b210971b52783077f0f611f303cbe42a5cb1d851d85"} Sep 17 03:13:07.872931 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.872906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" event={"ID":"b8c931ac-1fa1-402f-a2ab-805cc98932e9","Type":"ContainerStarted","Data":"de9e693b8b64973af302c3cc2c9fc561c68ab35ecab8fe15bae7495942812406"} Sep 17 03:13:07.873218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.873200 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:13:07.873647 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.873612 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s6k82" Sep 17 03:13:07.915325 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:07.915283 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" podStartSLOduration=9.170142164 podStartE2EDuration="26.915271108s" totalImagesPullingTime="17.745128944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:07.913430643 +0000 UTC m=+26.776691744" watchObservedRunningTime="2026-09-17 03:13:07.915271108 +0000 UTC m=+26.778532207" Sep 17 03:13:08.602171 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:08.602139 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:08.602625 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:08.602246 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:08.876221 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:08.876149 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:13:08.876354 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:08.876235 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:13:08.876354 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:08.876287 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:13:08.892425 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:08.892400 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:13:08.892925 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:08.892903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:13:09.468319 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:09.468248 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7f78c"] Sep 17 03:13:09.468454 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:09.468409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:09.468531 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:09.468512 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:09.471606 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:09.471583 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xp5z7"] Sep 17 03:13:09.471751 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:09.471705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:09.471828 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:09.471784 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:13:09.472343 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:09.472320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fc2sm"] Sep 17 03:13:09.472442 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:09.472429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:09.472645 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:09.472600 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:09.880143 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:09.879917 2562 generic.go:356] "Generic (PLEG): container finished" podID="c5ef68f6-bc19-4935-a47f-32cf61ecb480" containerID="d7d6ac11a8457ce368497d4fa372b02f1f0c757617caeead8070b8f10d256fac" exitCode=0 Sep 17 03:13:09.880143 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:09.879997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerDied","Data":"d7d6ac11a8457ce368497d4fa372b02f1f0c757617caeead8070b8f10d256fac"} Sep 17 03:13:10.602581 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:10.602498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:10.602760 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:10.602623 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:10.602760 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:10.602687 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:10.602872 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:10.602792 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:13:11.605032 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:11.604957 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:11.605360 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:11.605053 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:11.886761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:11.886683 2562 generic.go:356] "Generic (PLEG): container finished" podID="c5ef68f6-bc19-4935-a47f-32cf61ecb480" containerID="3904944171e5f5967239d20d5f05a01efed46fcca3bad4720ea5d8cc4412f156" exitCode=0 Sep 17 03:13:11.886879 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:11.886749 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerDied","Data":"3904944171e5f5967239d20d5f05a01efed46fcca3bad4720ea5d8cc4412f156"} Sep 17 03:13:12.602166 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:12.602080 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:12.602350 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:12.602185 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:13:12.602350 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:12.602284 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:12.602467 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:12.602393 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:13.602366 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:13.602334 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:13.602816 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:13.602477 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:14.601953 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:14.601915 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:14.602152 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:14.601918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:14.602152 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:14.602048 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f78c" podUID="9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc" Sep 17 03:13:14.602152 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:14.602127 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp5z7" podUID="c699a707-ec90-468b-bb43-f7fee8be33b7" Sep 17 03:13:15.242801 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:15.242765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:15.243308 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.242905 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:13:15.243308 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.242962 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:47.24294929 +0000 UTC m=+66.106210367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:13:15.343873 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:15.343832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:15.344049 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.343993 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:13:15.344114 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.344089 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret podName:9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc nodeName:}" failed. No retries permitted until 2026-09-17 03:13:47.344060752 +0000 UTC m=+66.207321842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret") pod "global-pull-secret-syncer-7f78c" (UID: "9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:13:15.445075 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:15.445042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:15.445263 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.445196 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:13:15.445263 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.445214 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:13:15.445263 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.445227 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cbmb8 for pod openshift-network-diagnostics/network-check-target-xp5z7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:13:15.445410 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.445279 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8 podName:c699a707-ec90-468b-bb43-f7fee8be33b7 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:47.445264004 +0000 UTC m=+66.308525084 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbmb8" (UniqueName: "kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8") pod "network-check-target-xp5z7" (UID: "c699a707-ec90-468b-bb43-f7fee8be33b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:13:15.602692 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:15.602596 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:15.602858 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:15.602743 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:13:15.899819 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:15.899783 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerStarted","Data":"3ad1472748024868e5cbccb2fe6fef7b59e0287119a3f91d6f633440fb9ff7a3"} Sep 17 03:13:15.948883 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:15.948861 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-44.ec2.internal" event="NodeReady" Sep 17 03:13:15.949018 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:15.949007 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 03:13:15.988805 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:15.988777 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-87nwc"] Sep 17 03:13:16.002170 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.002143 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-chj7k"] Sep 17 03:13:16.002282 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.002259 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.005107 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.005080 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 03:13:16.005243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.005133 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 03:13:16.005243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.005163 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lg7wr\"" Sep 17 03:13:16.016252 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.016229 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87nwc"] Sep 17 03:13:16.016358 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.016270 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chj7k"] Sep 17 03:13:16.016358 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.016338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chj7k" Sep 17 03:13:16.019487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.019468 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 03:13:16.019487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.019482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jwfhr\"" Sep 17 03:13:16.019661 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.019466 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 03:13:16.019661 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.019510 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 03:13:16.149948 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.149862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5230005-8666-4201-9a9b-5c85bb4dd5dc-tmp-dir\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.149948 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.149910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5230005-8666-4201-9a9b-5c85bb4dd5dc-config-volume\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.150164 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.149975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4spzn\" (UniqueName: \"kubernetes.io/projected/d5230005-8666-4201-9a9b-5c85bb4dd5dc-kube-api-access-4spzn\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.150164 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.150033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b8b3cc-e169-4545-be8b-70ffd126acf6-cert\") pod \"ingress-canary-chj7k\" (UID: \"f5b8b3cc-e169-4545-be8b-70ffd126acf6\") " pod="openshift-ingress-canary/ingress-canary-chj7k" Sep 17 03:13:16.150164 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.150077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.150164 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.150104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr9g7\" (UniqueName: \"kubernetes.io/projected/f5b8b3cc-e169-4545-be8b-70ffd126acf6-kube-api-access-nr9g7\") pod \"ingress-canary-chj7k\" (UID: \"f5b8b3cc-e169-4545-be8b-70ffd126acf6\") " pod="openshift-ingress-canary/ingress-canary-chj7k" Sep 17 03:13:16.251172 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.251133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5230005-8666-4201-9a9b-5c85bb4dd5dc-config-volume\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.251172 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.251180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4spzn\" (UniqueName: \"kubernetes.io/projected/d5230005-8666-4201-9a9b-5c85bb4dd5dc-kube-api-access-4spzn\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.251708 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.251212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b8b3cc-e169-4545-be8b-70ffd126acf6-cert\") pod \"ingress-canary-chj7k\" (UID: \"f5b8b3cc-e169-4545-be8b-70ffd126acf6\") " pod="openshift-ingress-canary/ingress-canary-chj7k" Sep 17 03:13:16.251708 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.251244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.251708 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.251260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr9g7\" (UniqueName: \"kubernetes.io/projected/f5b8b3cc-e169-4545-be8b-70ffd126acf6-kube-api-access-nr9g7\") pod \"ingress-canary-chj7k\" (UID: \"f5b8b3cc-e169-4545-be8b-70ffd126acf6\") " pod="openshift-ingress-canary/ingress-canary-chj7k" Sep 17 03:13:16.251708 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.251275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5230005-8666-4201-9a9b-5c85bb4dd5dc-tmp-dir\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.251708 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:16.251460 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:16.251708 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:16.251527 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:13:16.7515074 +0000 UTC m=+35.614768489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:13:16.251914 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.251834 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5230005-8666-4201-9a9b-5c85bb4dd5dc-tmp-dir\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.251966 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.251948 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5230005-8666-4201-9a9b-5c85bb4dd5dc-config-volume\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.255436 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.255315 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b8b3cc-e169-4545-be8b-70ffd126acf6-cert\") pod \"ingress-canary-chj7k\" (UID: \"f5b8b3cc-e169-4545-be8b-70ffd126acf6\") " pod="openshift-ingress-canary/ingress-canary-chj7k" Sep 17 03:13:16.259996 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.259973 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4spzn\" (UniqueName: \"kubernetes.io/projected/d5230005-8666-4201-9a9b-5c85bb4dd5dc-kube-api-access-4spzn\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.260109 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.260027 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr9g7\" (UniqueName: \"kubernetes.io/projected/f5b8b3cc-e169-4545-be8b-70ffd126acf6-kube-api-access-nr9g7\") pod \"ingress-canary-chj7k\" (UID: \"f5b8b3cc-e169-4545-be8b-70ffd126acf6\") " pod="openshift-ingress-canary/ingress-canary-chj7k" Sep 17 03:13:16.324109 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.324079 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chj7k" Sep 17 03:13:16.602603 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.602563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:16.602603 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.602589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:16.605704 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.605684 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:13:16.605824 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.605727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:13:16.607104 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.607086 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gbwtv\"" Sep 17 03:13:16.607214 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.607178 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:13:16.638256 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.638218 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chj7k"] Sep 17 03:13:16.641297 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:13:16.641270 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b8b3cc_e169_4545_be8b_70ffd126acf6.slice/crio-eddcd22392cb3ba3d4c766096b621b13d26ef095fb26b4d7201c1a005f991ec9 WatchSource:0}: Error finding container eddcd22392cb3ba3d4c766096b621b13d26ef095fb26b4d7201c1a005f991ec9: Status 404 returned error can't find the container with id eddcd22392cb3ba3d4c766096b621b13d26ef095fb26b4d7201c1a005f991ec9 Sep 17 03:13:16.754166 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.754143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:16.754302 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:16.754247 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:16.754302 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:16.754301 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:13:17.75428809 +0000 UTC m=+36.617549180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:13:16.902900 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.902870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chj7k" event={"ID":"f5b8b3cc-e169-4545-be8b-70ffd126acf6","Type":"ContainerStarted","Data":"eddcd22392cb3ba3d4c766096b621b13d26ef095fb26b4d7201c1a005f991ec9"} Sep 17 03:13:16.905683 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.905653 2562 generic.go:356] "Generic (PLEG): container finished" podID="c5ef68f6-bc19-4935-a47f-32cf61ecb480" containerID="3ad1472748024868e5cbccb2fe6fef7b59e0287119a3f91d6f633440fb9ff7a3" exitCode=0 Sep 17 03:13:16.905808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:16.905704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerDied","Data":"3ad1472748024868e5cbccb2fe6fef7b59e0287119a3f91d6f633440fb9ff7a3"} Sep 17 03:13:17.601774 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:17.601738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:17.604811 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:17.604789 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltdl9\"" Sep 17 03:13:17.604940 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:17.604789 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:13:17.762361 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:17.762324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:17.762537 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:17.762494 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:17.762604 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:17.762576 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:13:19.762553708 +0000 UTC m=+38.625814803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:13:17.911408 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:17.911331 2562 generic.go:356] "Generic (PLEG): container finished" podID="c5ef68f6-bc19-4935-a47f-32cf61ecb480" containerID="ac743c95093cce93552a7efb8e4947d4f125050d761270d62422d0766d2ea623" exitCode=0 Sep 17 03:13:17.911408 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:17.911392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerDied","Data":"ac743c95093cce93552a7efb8e4947d4f125050d761270d62422d0766d2ea623"} Sep 17 03:13:18.916748 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:18.916710 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" event={"ID":"c5ef68f6-bc19-4935-a47f-32cf61ecb480","Type":"ContainerStarted","Data":"bba2a6c71c733b853d8b7b0a84159821670da98475cd1740c6571b1c90751e75"} Sep 17 03:13:18.939473 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:18.939416 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sh6t2" podStartSLOduration=9.562119151 podStartE2EDuration="37.939395705s" totalImagesPullingTime="28.377276554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:18.937285985 +0000 UTC m=+37.800547084" watchObservedRunningTime="2026-09-17 03:13:18.939395705 +0000 UTC m=+37.802656805" Sep 17 03:13:19.780201 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:19.780166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:19.780363 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:19.780313 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:19.780404 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:19.780377 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:13:23.780362712 +0000 UTC m=+42.643623789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:13:19.920862 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:19.920825 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chj7k" event={"ID":"f5b8b3cc-e169-4545-be8b-70ffd126acf6","Type":"ContainerStarted","Data":"a19aec1cf8b2016f2e6400610d53196ede655a5bd4ec1f3e5860590ccbbf0e14"} Sep 17 03:13:19.936428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:19.936377 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-chj7k" podStartSLOduration=2.526128713 podStartE2EDuration="4.936360836s" totalImagesPullingTime="2.410232123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:19.935997915 +0000 UTC m=+38.799259015" watchObservedRunningTime="2026-09-17 03:13:19.936360836 +0000 UTC m=+38.799621932" Sep 17 03:13:23.805604 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:23.805567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:23.806046 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:23.805694 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:23.806046 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:23.805747 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:13:31.80573521 +0000 UTC m=+50.668996288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:13:31.858300 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:31.858257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:31.858783 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:31.858405 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:31.858783 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:31.858465 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:13:47.858448024 +0000 UTC m=+66.721709119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:13:40.895011 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:40.892521 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9p46" Sep 17 03:13:47.257845 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.257801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:13:47.260991 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.260969 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:13:47.268426 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:47.268405 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:13:47.268514 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:47.268484 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:14:51.268463539 +0000 UTC m=+130.131724629 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : secret "metrics-daemon-secret" not found Sep 17 03:13:47.358463 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.358424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:47.361345 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.361325 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:13:47.371640 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.371614 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc-original-pull-secret\") pod \"global-pull-secret-syncer-7f78c\" (UID: \"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc\") " pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:47.459307 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.459262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:47.462327 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.462307 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:13:47.472170 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.472150 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:13:47.482749 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.482723 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbmb8\" (UniqueName: \"kubernetes.io/projected/c699a707-ec90-468b-bb43-f7fee8be33b7-kube-api-access-cbmb8\") pod \"network-check-target-xp5z7\" (UID: \"c699a707-ec90-468b-bb43-f7fee8be33b7\") " pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:47.515268 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.515212 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gbwtv\"" Sep 17 03:13:47.517271 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.517254 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f78c" Sep 17 03:13:47.523221 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.523203 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:47.787671 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.787568 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7f78c"] Sep 17 03:13:47.790715 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:13:47.790682 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1e6a4a_ef43_4043_93fa_ce7b90d1bfcc.slice/crio-4bd9e4ff89dfeb52ddd0068bde8e86d6f6a6bf4f1db6f17355a96936f6f1c841 WatchSource:0}: Error finding container 4bd9e4ff89dfeb52ddd0068bde8e86d6f6a6bf4f1db6f17355a96936f6f1c841: Status 404 returned error can't find the container with id 4bd9e4ff89dfeb52ddd0068bde8e86d6f6a6bf4f1db6f17355a96936f6f1c841 Sep 17 03:13:47.791833 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.791807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xp5z7"] Sep 17 03:13:47.798021 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:13:47.798000 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc699a707_ec90_468b_bb43_f7fee8be33b7.slice/crio-6d866dac83d0491791b18435c6ee539bc87048212c43acb2b9a842a4bab5b6b1 WatchSource:0}: Error finding container 6d866dac83d0491791b18435c6ee539bc87048212c43acb2b9a842a4bab5b6b1: Status 404 returned error can't find the container with id 6d866dac83d0491791b18435c6ee539bc87048212c43acb2b9a842a4bab5b6b1 Sep 17 03:13:47.862193 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.862150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:13:47.862355 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:47.862293 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:47.862401 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:13:47.862361 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:14:19.862345612 +0000 UTC m=+98.725606707 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:13:47.988570 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.988529 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xp5z7" event={"ID":"c699a707-ec90-468b-bb43-f7fee8be33b7","Type":"ContainerStarted","Data":"6d866dac83d0491791b18435c6ee539bc87048212c43acb2b9a842a4bab5b6b1"} Sep 17 03:13:47.989718 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:47.989688 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7f78c" event={"ID":"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc","Type":"ContainerStarted","Data":"4bd9e4ff89dfeb52ddd0068bde8e86d6f6a6bf4f1db6f17355a96936f6f1c841"} Sep 17 03:13:50.373223 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.373187 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6"] Sep 17 03:13:50.377582 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.377556 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" Sep 17 03:13:50.380608 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.380585 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kw5g9\"" Sep 17 03:13:50.382189 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.382169 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 03:13:50.382298 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.382193 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 17 03:13:50.382298 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.382207 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 03:13:50.382398 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.382373 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 03:13:50.385220 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.385153 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6"] Sep 17 03:13:50.481145 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.481108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/504fffd2-7c99-48d6-8ebd-eb47e121c776-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78c8868cf8-sj7b6\" (UID: \"504fffd2-7c99-48d6-8ebd-eb47e121c776\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" Sep 17 03:13:50.481334 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.481185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjqb\" (UniqueName: \"kubernetes.io/projected/504fffd2-7c99-48d6-8ebd-eb47e121c776-kube-api-access-tpjqb\") pod \"managed-serviceaccount-addon-agent-78c8868cf8-sj7b6\" (UID: \"504fffd2-7c99-48d6-8ebd-eb47e121c776\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" Sep 17 03:13:50.581871 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.581826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/504fffd2-7c99-48d6-8ebd-eb47e121c776-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78c8868cf8-sj7b6\" (UID: \"504fffd2-7c99-48d6-8ebd-eb47e121c776\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" Sep 17 03:13:50.582065 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.581917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjqb\" (UniqueName: \"kubernetes.io/projected/504fffd2-7c99-48d6-8ebd-eb47e121c776-kube-api-access-tpjqb\") pod \"managed-serviceaccount-addon-agent-78c8868cf8-sj7b6\" (UID: \"504fffd2-7c99-48d6-8ebd-eb47e121c776\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" Sep 17 03:13:50.584644 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.584600 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/504fffd2-7c99-48d6-8ebd-eb47e121c776-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78c8868cf8-sj7b6\" (UID: \"504fffd2-7c99-48d6-8ebd-eb47e121c776\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" Sep 17 03:13:50.590671 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.590647 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjqb\" (UniqueName: \"kubernetes.io/projected/504fffd2-7c99-48d6-8ebd-eb47e121c776-kube-api-access-tpjqb\") pod \"managed-serviceaccount-addon-agent-78c8868cf8-sj7b6\" (UID: \"504fffd2-7c99-48d6-8ebd-eb47e121c776\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" Sep 17 03:13:50.696055 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:50.695967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" Sep 17 03:13:52.403703 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:52.403616 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6"] Sep 17 03:13:52.406833 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:13:52.406804 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod504fffd2_7c99_48d6_8ebd_eb47e121c776.slice/crio-aa3dd1bda1c41f2f217e7b4a9024343332d129b264d0e748d126b3528afadf34 WatchSource:0}: Error finding container aa3dd1bda1c41f2f217e7b4a9024343332d129b264d0e748d126b3528afadf34: Status 404 returned error can't find the container with id aa3dd1bda1c41f2f217e7b4a9024343332d129b264d0e748d126b3528afadf34 Sep 17 03:13:53.004807 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:53.004767 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xp5z7" event={"ID":"c699a707-ec90-468b-bb43-f7fee8be33b7","Type":"ContainerStarted","Data":"9d976fbc089a4fd55f4ef308dbb961a66f507b067934ff960469470dff68d72d"} Sep 17 03:13:53.007810 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:53.005128 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:13:53.009535 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:53.009509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7f78c" event={"ID":"9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc","Type":"ContainerStarted","Data":"86cbbf9a88b4e3ceb4754606148dbe286810da014c8a6fc5fd63b5e26af06836"} Sep 17 03:13:53.010625 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:53.010601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" event={"ID":"504fffd2-7c99-48d6-8ebd-eb47e121c776","Type":"ContainerStarted","Data":"aa3dd1bda1c41f2f217e7b4a9024343332d129b264d0e748d126b3528afadf34"} Sep 17 03:13:53.020650 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:53.020596 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xp5z7" podStartSLOduration=67.666069713 podStartE2EDuration="1m12.020583706s" totalImagesPullingTime="4.354513993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:53.019319639 +0000 UTC m=+71.882580738" watchObservedRunningTime="2026-09-17 03:13:53.020583706 +0000 UTC m=+71.883844837" Sep 17 03:13:53.032806 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:53.032771 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7f78c" podStartSLOduration=67.670776066 podStartE2EDuration="1m12.032759538s" totalImagesPullingTime="4.361983472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:53.032298705 +0000 UTC m=+71.895559807" watchObservedRunningTime="2026-09-17 03:13:53.032759538 +0000 UTC m=+71.896020628" Sep 17 03:13:55.017389 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:55.017345 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" event={"ID":"504fffd2-7c99-48d6-8ebd-eb47e121c776","Type":"ContainerStarted","Data":"422ea8a2cade33c8e5507079ebd50076d18442c67eb65159940536594312b02a"} Sep 17 03:13:55.032431 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:13:55.032382 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" podStartSLOduration=2.500021577 podStartE2EDuration="5.032366243s" totalImagesPullingTime="2.532344666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:55.031608604 +0000 UTC m=+73.894869704" watchObservedRunningTime="2026-09-17 03:13:55.032366243 +0000 UTC m=+73.895627342" Sep 17 03:14:19.882530 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:14:19.882472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:14:19.883010 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:14:19.882644 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:14:19.883010 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:14:19.882719 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:15:23.882702821 +0000 UTC m=+162.745963911 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:14:24.015539 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:14:24.015511 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xp5z7" Sep 17 03:14:51.296112 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:14:51.296049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:14:51.296602 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:14:51.296205 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:14:51.296602 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:14:51.296281 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:16:53.296265165 +0000 UTC m=+252.159526242 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : secret "metrics-daemon-secret" not found Sep 17 03:15:19.011973 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:15:19.011924 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-87nwc" podUID="d5230005-8666-4201-9a9b-5c85bb4dd5dc" Sep 17 03:15:19.214706 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:15:19.214680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87nwc" Sep 17 03:15:20.611352 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:15:20.611304 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:15:23.908533 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:15:23.908489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:15:23.908991 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:15:23.908609 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:15:23.908991 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:15:23.908704 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls podName:d5230005-8666-4201-9a9b-5c85bb4dd5dc nodeName:}" failed. No retries permitted until 2026-09-17 03:17:25.908689957 +0000 UTC m=+284.771951035 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls") pod "dns-default-87nwc" (UID: "d5230005-8666-4201-9a9b-5c85bb4dd5dc") : secret "dns-default-metrics-tls" not found Sep 17 03:15:31.603372 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:15:31.603338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:15:55.301804 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:15:55.301708 2562 generic.go:356] "Generic (PLEG): container finished" podID="504fffd2-7c99-48d6-8ebd-eb47e121c776" containerID="422ea8a2cade33c8e5507079ebd50076d18442c67eb65159940536594312b02a" exitCode=255 Sep 17 03:15:55.301804 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:15:55.301778 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" event={"ID":"504fffd2-7c99-48d6-8ebd-eb47e121c776","Type":"ContainerDied","Data":"422ea8a2cade33c8e5507079ebd50076d18442c67eb65159940536594312b02a"} Sep 17 03:15:55.307083 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:15:55.307064 2562 scope.go:117] "RemoveContainer" containerID="422ea8a2cade33c8e5507079ebd50076d18442c67eb65159940536594312b02a" Sep 17 03:15:56.305393 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:15:56.305358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78c8868cf8-sj7b6" event={"ID":"504fffd2-7c99-48d6-8ebd-eb47e121c776","Type":"ContainerStarted","Data":"ffb41caca3299088311eafed739dc2f6102e0531641773baa19c1a7edb5710d3"} Sep 17 03:16:53.391615 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:53.391565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:16:53.392115 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:53.391724 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:16:53.392115 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:53.391799 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs podName:e543faf0-188b-4617-91a4-2c86fc7a2f29 nodeName:}" failed. No retries permitted until 2026-09-17 03:18:55.391781568 +0000 UTC m=+374.255042652 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs") pod "network-metrics-daemon-fc2sm" (UID: "e543faf0-188b-4617-91a4-2c86fc7a2f29") : secret "metrics-daemon-secret" not found Sep 17 03:16:56.424238 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.424208 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x"] Sep 17 03:16:56.429411 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.429381 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:16:56.430421 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.430398 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs"] Sep 17 03:16:56.432576 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.432552 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 17 03:16:56.432716 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.432588 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 17 03:16:56.432813 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.432790 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xjnln\"" Sep 17 03:16:56.433307 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.433291 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-fwdt9"] Sep 17 03:16:56.433401 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.433389 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.435929 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.435899 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59c4bb7d84-8vnzp"] Sep 17 03:16:56.436289 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.435956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.436927 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.436904 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 17 03:16:56.436927 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.436915 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 17 03:16:56.437201 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.437184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t8xpn\"" Sep 17 03:16:56.437292 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.437277 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 17 03:16:56.437392 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.437378 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:16:56.438978 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.438959 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5779b6f89c-tsrnd"] Sep 17 03:16:56.439095 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.439080 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.439993 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.439969 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 17 03:16:56.440083 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.440020 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:16:56.440211 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.440197 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 17 03:16:56.440256 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.440206 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 17 03:16:56.440427 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.440411 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m7qfr\"" Sep 17 03:16:56.441746 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.441728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x"] Sep 17 03:16:56.441824 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.441795 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.443561 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.443540 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 03:16:56.443660 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.443544 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 03:16:56.443660 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.443570 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 03:16:56.443660 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.443571 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 03:16:56.443869 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.443846 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 03:16:56.443994 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.443894 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2fssg\"" Sep 17 03:16:56.444098 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.443921 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 03:16:56.444980 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.444962 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 03:16:56.446553 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.446533 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 03:16:56.446833 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.446815 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xl2rt\"" Sep 17 03:16:56.446931 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.446916 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 03:16:56.448557 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.448541 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 17 03:16:56.451521 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.451500 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs"] Sep 17 03:16:56.452307 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.452283 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 03:16:56.452489 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.452470 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-fwdt9"] Sep 17 03:16:56.453368 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.453349 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59c4bb7d84-8vnzp"] Sep 17 03:16:56.454114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.454096 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5779b6f89c-tsrnd"] Sep 17 03:16:56.512648 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqhg7\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-kube-api-access-tqhg7\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.512648 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c00e6a5-3798-4b66-9849-97d1a8387ee3-serving-cert\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.512819 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:16:56.512819 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.512819 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7428q\" (UniqueName: \"kubernetes.io/projected/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-kube-api-access-7428q\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.512932 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-trusted-ca\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.512932 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccaf6521-3a7b-4992-a879-461eac6a48c2-config\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.512932 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.512932 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccaf6521-3a7b-4992-a879-461eac6a48c2-trusted-ca\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.512932 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2q4p\" (UniqueName: \"kubernetes.io/projected/ccaf6521-3a7b-4992-a879-461eac6a48c2-kube-api-access-w2q4p\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.512932 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512932 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a9a0215-7a4d-4433-abda-32234a58050c-ca-trust-extracted\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.513114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-stats-auth\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.513114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-bound-sa-token\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.513114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.512986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-image-registry-private-configuration\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.513114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.513002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-default-certificate\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.513114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.513072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccaf6521-3a7b-4992-a879-461eac6a48c2-serving-cert\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.513114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.513091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.513114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.513106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c00e6a5-3798-4b66-9849-97d1a8387ee3-config\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.513355 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.513122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-registry-certificates\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.513355 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.513145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw82p\" (UniqueName: \"kubernetes.io/projected/5c00e6a5-3798-4b66-9849-97d1a8387ee3-kube-api-access-rw82p\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.513355 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.513168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:16:56.513355 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.513192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-installation-pull-secrets\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.526293 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.526266 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-b86zv"] Sep 17 03:16:56.529177 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.529163 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b86zv" Sep 17 03:16:56.531816 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.531794 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-blpfz\"" Sep 17 03:16:56.536609 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.536588 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-b86zv"] Sep 17 03:16:56.614263 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.614409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7428q\" (UniqueName: \"kubernetes.io/projected/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-kube-api-access-7428q\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.614409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-trusted-ca\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.614409 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:56.614384 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:16:56.614409 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:56.614398 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5779b6f89c-tsrnd: secret "image-registry-tls" not found Sep 17 03:16:56.614573 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccaf6521-3a7b-4992-a879-461eac6a48c2-config\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.614573 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:56.614440 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls podName:8a9a0215-7a4d-4433-abda-32234a58050c nodeName:}" failed. No retries permitted until 2026-09-17 03:16:57.114425404 +0000 UTC m=+255.977686482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls") pod "image-registry-5779b6f89c-tsrnd" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c") : secret "image-registry-tls" not found Sep 17 03:16:56.614573 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.614573 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccaf6521-3a7b-4992-a879-461eac6a48c2-trusted-ca\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.614573 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2q4p\" (UniqueName: \"kubernetes.io/projected/ccaf6521-3a7b-4992-a879-461eac6a48c2-kube-api-access-w2q4p\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.614573 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a9a0215-7a4d-4433-abda-32234a58050c-ca-trust-extracted\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.614896 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614579 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-stats-auth\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.614896 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:56.614600 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 03:16:56.614896 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jmws\" (UniqueName: \"kubernetes.io/projected/adbea728-f68a-45f4-9090-eacf3a7a4944-kube-api-access-4jmws\") pod \"network-check-source-6f8b768455-b86zv\" (UID: \"adbea728-f68a-45f4-9090-eacf3a7a4944\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-b86zv" Sep 17 03:16:56.614896 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-bound-sa-token\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.614896 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:56.614697 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:16:57.114676347 +0000 UTC m=+255.977937444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : secret "router-metrics-certs-default" not found Sep 17 03:16:56.614896 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-image-registry-private-configuration\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.614896 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614852 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-default-certificate\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.615251 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccaf6521-3a7b-4992-a879-461eac6a48c2-serving-cert\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.615251 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.615251 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a9a0215-7a4d-4433-abda-32234a58050c-ca-trust-extracted\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.615251 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615176 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccaf6521-3a7b-4992-a879-461eac6a48c2-config\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.615457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615434 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-trusted-ca\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.615514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.614956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c00e6a5-3798-4b66-9849-97d1a8387ee3-config\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.615514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615475 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c00e6a5-3798-4b66-9849-97d1a8387ee3-config\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.615612 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-registry-certificates\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.615612 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw82p\" (UniqueName: \"kubernetes.io/projected/5c00e6a5-3798-4b66-9849-97d1a8387ee3-kube-api-access-rw82p\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.615612 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:16:56.615612 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:56.615589 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:16:57.115572862 +0000 UTC m=+255.978833946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : configmap references non-existent config key: service-ca.crt Sep 17 03:16:56.615851 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-installation-pull-secrets\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.615851 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:56.615666 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 03:16:56.615851 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqhg7\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-kube-api-access-tqhg7\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.615851 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:56.615725 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert podName:eda1aac9-88e6-4505-a041-b3d9a47fd0ea nodeName:}" failed. No retries permitted until 2026-09-17 03:16:57.115709216 +0000 UTC m=+255.978970307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xlq5x" (UID: "eda1aac9-88e6-4505-a041-b3d9a47fd0ea") : secret "networking-console-plugin-cert" not found Sep 17 03:16:56.615851 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c00e6a5-3798-4b66-9849-97d1a8387ee3-serving-cert\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.615851 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:16:56.616165 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.615660 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccaf6521-3a7b-4992-a879-461eac6a48c2-trusted-ca\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.616579 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.616554 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:16:56.616731 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.616708 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-registry-certificates\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.617539 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.617515 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-image-registry-private-configuration\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.617755 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.617725 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-stats-auth\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.617852 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.617732 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-default-certificate\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.617852 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.617779 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccaf6521-3a7b-4992-a879-461eac6a48c2-serving-cert\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.618054 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.618034 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-installation-pull-secrets\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.618696 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.618678 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c00e6a5-3798-4b66-9849-97d1a8387ee3-serving-cert\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.628448 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.628405 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-bound-sa-token\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.628967 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.628941 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7428q\" (UniqueName: \"kubernetes.io/projected/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-kube-api-access-7428q\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:56.629069 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.628972 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2q4p\" (UniqueName: \"kubernetes.io/projected/ccaf6521-3a7b-4992-a879-461eac6a48c2-kube-api-access-w2q4p\") pod \"console-operator-696884fb9c-fwdt9\" (UID: \"ccaf6521-3a7b-4992-a879-461eac6a48c2\") " pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.629069 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.629022 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw82p\" (UniqueName: \"kubernetes.io/projected/5c00e6a5-3798-4b66-9849-97d1a8387ee3-kube-api-access-rw82p\") pod \"service-ca-operator-cf7c776b7-fxqzs\" (UID: \"5c00e6a5-3798-4b66-9849-97d1a8387ee3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.629339 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.629320 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqhg7\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-kube-api-access-tqhg7\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:56.716279 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.716245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jmws\" (UniqueName: \"kubernetes.io/projected/adbea728-f68a-45f4-9090-eacf3a7a4944-kube-api-access-4jmws\") pod \"network-check-source-6f8b768455-b86zv\" (UID: \"adbea728-f68a-45f4-9090-eacf3a7a4944\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-b86zv" Sep 17 03:16:56.724730 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.724697 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jmws\" (UniqueName: \"kubernetes.io/projected/adbea728-f68a-45f4-9090-eacf3a7a4944-kube-api-access-4jmws\") pod \"network-check-source-6f8b768455-b86zv\" (UID: \"adbea728-f68a-45f4-9090-eacf3a7a4944\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-b86zv" Sep 17 03:16:56.747691 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.747672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" Sep 17 03:16:56.756752 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.756729 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:16:56.837930 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:56.837903 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b86zv" Sep 17 03:16:57.016655 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.016611 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs"] Sep 17 03:16:57.018465 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:16:57.018435 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c00e6a5_3798_4b66_9849_97d1a8387ee3.slice/crio-f463e968b0a68a50e1fb6406af5d60103d19f35ee5b33f290dcd685735b31151 WatchSource:0}: Error finding container f463e968b0a68a50e1fb6406af5d60103d19f35ee5b33f290dcd685735b31151: Status 404 returned error can't find the container with id f463e968b0a68a50e1fb6406af5d60103d19f35ee5b33f290dcd685735b31151 Sep 17 03:16:57.039252 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.039231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-fwdt9"] Sep 17 03:16:57.041541 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:16:57.041516 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccaf6521_3a7b_4992_a879_461eac6a48c2.slice/crio-5e905e7e65231b57addacc26e91bde1eba262672ee256c70f8e60c089cf7c83c WatchSource:0}: Error finding container 5e905e7e65231b57addacc26e91bde1eba262672ee256c70f8e60c089cf7c83c: Status 404 returned error can't find the container with id 5e905e7e65231b57addacc26e91bde1eba262672ee256c70f8e60c089cf7c83c Sep 17 03:16:57.104501 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.104387 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-b86zv"] Sep 17 03:16:57.106785 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:16:57.106755 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbea728_f68a_45f4_9090_eacf3a7a4944.slice/crio-611a5bf2cbdcd3a152b087bb980198b1503b3af5b2b532699e38c2497cc41a63 WatchSource:0}: Error finding container 611a5bf2cbdcd3a152b087bb980198b1503b3af5b2b532699e38c2497cc41a63: Status 404 returned error can't find the container with id 611a5bf2cbdcd3a152b087bb980198b1503b3af5b2b532699e38c2497cc41a63 Sep 17 03:16:57.119775 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.119751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:57.119870 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.119793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:57.119870 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.119821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:16:57.119941 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.119896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:57.119941 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:57.119906 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 03:16:57.119999 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:57.119939 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:16:58.119918329 +0000 UTC m=+256.983179422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : configmap references non-existent config key: service-ca.crt Sep 17 03:16:57.119999 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:57.119963 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:16:58.119954089 +0000 UTC m=+256.983215167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : secret "router-metrics-certs-default" not found Sep 17 03:16:57.119999 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:57.119981 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 03:16:57.119999 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:57.119990 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:16:57.120155 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:57.120002 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5779b6f89c-tsrnd: secret "image-registry-tls" not found Sep 17 03:16:57.120155 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:57.120036 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert podName:eda1aac9-88e6-4505-a041-b3d9a47fd0ea nodeName:}" failed. No retries permitted until 2026-09-17 03:16:58.120020663 +0000 UTC m=+256.983281744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xlq5x" (UID: "eda1aac9-88e6-4505-a041-b3d9a47fd0ea") : secret "networking-console-plugin-cert" not found Sep 17 03:16:57.120155 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:57.120054 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls podName:8a9a0215-7a4d-4433-abda-32234a58050c nodeName:}" failed. No retries permitted until 2026-09-17 03:16:58.120044407 +0000 UTC m=+256.983305496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls") pod "image-registry-5779b6f89c-tsrnd" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c") : secret "image-registry-tls" not found Sep 17 03:16:57.451928 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.451836 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b86zv" event={"ID":"adbea728-f68a-45f4-9090-eacf3a7a4944","Type":"ContainerStarted","Data":"efcceda316adaee2d481521113ce67e7c49f2d7cb70f0b95d18701069281d299"} Sep 17 03:16:57.451928 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.451895 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b86zv" event={"ID":"adbea728-f68a-45f4-9090-eacf3a7a4944","Type":"ContainerStarted","Data":"611a5bf2cbdcd3a152b087bb980198b1503b3af5b2b532699e38c2497cc41a63"} Sep 17 03:16:57.453419 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.453385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" event={"ID":"ccaf6521-3a7b-4992-a879-461eac6a48c2","Type":"ContainerStarted","Data":"5e905e7e65231b57addacc26e91bde1eba262672ee256c70f8e60c089cf7c83c"} Sep 17 03:16:57.454669 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.454646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" event={"ID":"5c00e6a5-3798-4b66-9849-97d1a8387ee3","Type":"ContainerStarted","Data":"f463e968b0a68a50e1fb6406af5d60103d19f35ee5b33f290dcd685735b31151"} Sep 17 03:16:57.469712 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:57.469663 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b86zv" podStartSLOduration=1.469643794 podStartE2EDuration="1.469643794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:16:57.467118414 +0000 UTC m=+256.330379512" watchObservedRunningTime="2026-09-17 03:16:57.469643794 +0000 UTC m=+256.332904889" Sep 17 03:16:58.126868 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:58.126824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:58.127058 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:58.126972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:16:58.127058 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:58.126993 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:17:00.126972666 +0000 UTC m=+258.990233747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : configmap references non-existent config key: service-ca.crt Sep 17 03:16:58.127182 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:58.127066 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 03:16:58.127182 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:58.127088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:16:58.127182 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:58.127110 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert podName:eda1aac9-88e6-4505-a041-b3d9a47fd0ea nodeName:}" failed. No retries permitted until 2026-09-17 03:17:00.127096922 +0000 UTC m=+258.990358012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xlq5x" (UID: "eda1aac9-88e6-4505-a041-b3d9a47fd0ea") : secret "networking-console-plugin-cert" not found Sep 17 03:16:58.127182 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:58.127155 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:16:58.127182 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:16:58.127159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:16:58.127424 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:58.127166 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5779b6f89c-tsrnd: secret "image-registry-tls" not found Sep 17 03:16:58.127424 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:58.127222 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls podName:8a9a0215-7a4d-4433-abda-32234a58050c nodeName:}" failed. No retries permitted until 2026-09-17 03:17:00.127214626 +0000 UTC m=+258.990475706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls") pod "image-registry-5779b6f89c-tsrnd" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c") : secret "image-registry-tls" not found Sep 17 03:16:58.127424 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:58.127357 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 03:16:58.127424 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:16:58.127418 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:17:00.127400497 +0000 UTC m=+258.990661576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : secret "router-metrics-certs-default" not found Sep 17 03:17:00.142208 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.142160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.142254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.142292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:00.142309 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.142334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:00.142382 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert podName:eda1aac9-88e6-4505-a041-b3d9a47fd0ea nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.142364409 +0000 UTC m=+263.005625485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xlq5x" (UID: "eda1aac9-88e6-4505-a041-b3d9a47fd0ea") : secret "networking-console-plugin-cert" not found Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:00.142385 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:00.142403 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5779b6f89c-tsrnd: secret "image-registry-tls" not found Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:00.142422 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:00.142445 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls podName:8a9a0215-7a4d-4433-abda-32234a58050c nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.142434321 +0000 UTC m=+263.005695398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls") pod "image-registry-5779b6f89c-tsrnd" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c") : secret "image-registry-tls" not found Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:00.142458 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.142452196 +0000 UTC m=+263.005713273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : configmap references non-existent config key: service-ca.crt Sep 17 03:17:00.142715 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:00.142472 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.1424665 +0000 UTC m=+263.005727577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : secret "router-metrics-certs-default" not found Sep 17 03:17:00.466410 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.466372 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" event={"ID":"5c00e6a5-3798-4b66-9849-97d1a8387ee3","Type":"ContainerStarted","Data":"05a21fff1fc8a86e6b2e383d7c7a0702b025f31111b657b942aca277965bc1f3"} Sep 17 03:17:00.467993 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.467963 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/0.log" Sep 17 03:17:00.468129 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.468049 2562 generic.go:356] "Generic (PLEG): container finished" podID="ccaf6521-3a7b-4992-a879-461eac6a48c2" containerID="d1eb1e7259d8890bc54fa3bcab716b3c713899e19d7eeae114762a447187b08b" exitCode=255 Sep 17 03:17:00.468129 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.468082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" event={"ID":"ccaf6521-3a7b-4992-a879-461eac6a48c2","Type":"ContainerDied","Data":"d1eb1e7259d8890bc54fa3bcab716b3c713899e19d7eeae114762a447187b08b"} Sep 17 03:17:00.468308 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.468291 2562 scope.go:117] "RemoveContainer" containerID="d1eb1e7259d8890bc54fa3bcab716b3c713899e19d7eeae114762a447187b08b" Sep 17 03:17:00.483911 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.483869 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" podStartSLOduration=2.052854249 podStartE2EDuration="4.483847909s" totalImagesPullingTime="2.43099366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:00.483133269 +0000 UTC m=+259.346394388" watchObservedRunningTime="2026-09-17 03:17:00.483847909 +0000 UTC m=+259.347109064" Sep 17 03:17:00.907765 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.907146 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t8q4h"] Sep 17 03:17:00.911064 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.911039 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:00.913684 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.913661 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 03:17:00.913813 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.913686 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 03:17:00.913990 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.913949 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 03:17:00.914184 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.914163 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 03:17:00.914307 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.914170 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v629g\"" Sep 17 03:17:00.918796 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:00.918776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t8q4h"] Sep 17 03:17:01.049189 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.049145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-data-volume\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.049189 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.049195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.049441 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.049269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.049441 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.049364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-crio-socket\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.049441 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.049391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgxkz\" (UniqueName: \"kubernetes.io/projected/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-api-access-xgxkz\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.150190 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.150138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.150238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-crio-socket\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.150259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgxkz\" (UniqueName: \"kubernetes.io/projected/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-api-access-xgxkz\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.150265 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.150281 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-data-volume\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.150298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.150326 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:01.650309906 +0000 UTC m=+260.513570984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : configmap "kube-rbac-proxy" not found Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.150385 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.150394 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-crio-socket\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.150436 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:01.650424851 +0000 UTC m=+260.513685928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.150676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.150670 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-data-volume\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.161327 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.161270 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgxkz\" (UniqueName: \"kubernetes.io/projected/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-api-access-xgxkz\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.473189 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.473162 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/1.log" Sep 17 03:17:01.473573 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.473557 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/0.log" Sep 17 03:17:01.473622 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.473592 2562 generic.go:356] "Generic (PLEG): container finished" podID="ccaf6521-3a7b-4992-a879-461eac6a48c2" containerID="1adf166e0b5c04dec9e0d82685926a59536c425b17d7054ef9744c89e6ab3051" exitCode=255 Sep 17 03:17:01.473711 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.473687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" event={"ID":"ccaf6521-3a7b-4992-a879-461eac6a48c2","Type":"ContainerDied","Data":"1adf166e0b5c04dec9e0d82685926a59536c425b17d7054ef9744c89e6ab3051"} Sep 17 03:17:01.473759 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.473747 2562 scope.go:117] "RemoveContainer" containerID="d1eb1e7259d8890bc54fa3bcab716b3c713899e19d7eeae114762a447187b08b" Sep 17 03:17:01.473962 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.473944 2562 scope.go:117] "RemoveContainer" containerID="1adf166e0b5c04dec9e0d82685926a59536c425b17d7054ef9744c89e6ab3051" Sep 17 03:17:01.474157 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.474137 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-fwdt9_openshift-console-operator(ccaf6521-3a7b-4992-a879-461eac6a48c2)\"" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" podUID="ccaf6521-3a7b-4992-a879-461eac6a48c2" Sep 17 03:17:01.654077 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.654040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.654236 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.654161 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:01.654236 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:01.654168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:01.654312 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.654237 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:02.654218899 +0000 UTC m=+261.517479994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : configmap "kube-rbac-proxy" not found Sep 17 03:17:01.654312 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.654273 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.654312 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:01.654310 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:02.654299342 +0000 UTC m=+261.517560434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:02.478673 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.478646 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/1.log" Sep 17 03:17:02.479019 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.478972 2562 scope.go:117] "RemoveContainer" containerID="1adf166e0b5c04dec9e0d82685926a59536c425b17d7054ef9744c89e6ab3051" Sep 17 03:17:02.479134 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:02.479115 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-fwdt9_openshift-console-operator(ccaf6521-3a7b-4992-a879-461eac6a48c2)\"" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" podUID="ccaf6521-3a7b-4992-a879-461eac6a48c2" Sep 17 03:17:02.664410 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.664376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:02.664596 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.664445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:02.664596 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:02.664545 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:02.664596 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:02.664587 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:02.664770 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:02.664608 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.664590462 +0000 UTC m=+263.527851546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : configmap "kube-rbac-proxy" not found Sep 17 03:17:02.664770 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:02.664672 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.66465296 +0000 UTC m=+263.527914054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:02.727869 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.727832 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-cxqng"] Sep 17 03:17:02.732138 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.732075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.735277 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.735252 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 17 03:17:02.735277 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.735268 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 17 03:17:02.735455 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.735337 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bx674\"" Sep 17 03:17:02.735455 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.735401 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 17 03:17:02.735455 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.735428 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 17 03:17:02.738858 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.738835 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-cxqng"] Sep 17 03:17:02.866552 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.866513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1cb1a511-af16-4776-be31-b4fb594a4102-signing-key\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.866552 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.866554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1cb1a511-af16-4776-be31-b4fb594a4102-signing-cabundle\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.866825 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.866711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2ngq\" (UniqueName: \"kubernetes.io/projected/1cb1a511-af16-4776-be31-b4fb594a4102-kube-api-access-x2ngq\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.967324 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.967290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2ngq\" (UniqueName: \"kubernetes.io/projected/1cb1a511-af16-4776-be31-b4fb594a4102-kube-api-access-x2ngq\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.967487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.967363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1cb1a511-af16-4776-be31-b4fb594a4102-signing-key\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.967487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.967383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1cb1a511-af16-4776-be31-b4fb594a4102-signing-cabundle\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.967971 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.967949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1cb1a511-af16-4776-be31-b4fb594a4102-signing-cabundle\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.969746 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.969730 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1cb1a511-af16-4776-be31-b4fb594a4102-signing-key\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:02.975800 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:02.975776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2ngq\" (UniqueName: \"kubernetes.io/projected/1cb1a511-af16-4776-be31-b4fb594a4102-kube-api-access-x2ngq\") pod \"service-ca-568869fdc5-cxqng\" (UID: \"1cb1a511-af16-4776-be31-b4fb594a4102\") " pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:03.041283 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:03.041210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-cxqng" Sep 17 03:17:03.309411 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:03.309386 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-cxqng"] Sep 17 03:17:03.312058 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:03.312029 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb1a511_af16_4776_be31_b4fb594a4102.slice/crio-f83577d2f961a8534425d744f9fa8c6e714a96ffa6a4d29259c4c8a6281799b7 WatchSource:0}: Error finding container f83577d2f961a8534425d744f9fa8c6e714a96ffa6a4d29259c4c8a6281799b7: Status 404 returned error can't find the container with id f83577d2f961a8534425d744f9fa8c6e714a96ffa6a4d29259c4c8a6281799b7 Sep 17 03:17:03.482924 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:03.482885 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-cxqng" event={"ID":"1cb1a511-af16-4776-be31-b4fb594a4102","Type":"ContainerStarted","Data":"d2d11b32728e55a57004715261f6429aa4907e6a093ab9b554f139074d6756b3"} Sep 17 03:17:03.483332 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:03.482976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-cxqng" event={"ID":"1cb1a511-af16-4776-be31-b4fb594a4102","Type":"ContainerStarted","Data":"f83577d2f961a8534425d744f9fa8c6e714a96ffa6a4d29259c4c8a6281799b7"} Sep 17 03:17:03.501369 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:03.501318 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-cxqng" podStartSLOduration=1.501304213 podStartE2EDuration="1.501304213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:03.499908319 +0000 UTC m=+262.363169418" watchObservedRunningTime="2026-09-17 03:17:03.501304213 +0000 UTC m=+262.364565339" Sep 17 03:17:03.670881 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:03.670803 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8xw5_0532d583-5a56-4b5c-84d6-41813e578c36/dns-node-resolver/0.log" Sep 17 03:17:04.177181 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:04.177102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:04.177181 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:04.177153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:04.177426 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:04.177240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:04.177426 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:04.177298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:17:04.177426 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.177254 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:17:04.177426 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.177347 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5779b6f89c-tsrnd: secret "image-registry-tls" not found Sep 17 03:17:04.177426 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.177257 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 03:17:04.177426 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.177377 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 03:17:04.177426 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.177330 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:17:12.177316385 +0000 UTC m=+271.040577472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : configmap references non-existent config key: service-ca.crt Sep 17 03:17:04.177711 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.177489 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls podName:8a9a0215-7a4d-4433-abda-32234a58050c nodeName:}" failed. No retries permitted until 2026-09-17 03:17:12.177471565 +0000 UTC m=+271.040732642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls") pod "image-registry-5779b6f89c-tsrnd" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c") : secret "image-registry-tls" not found Sep 17 03:17:04.177711 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.177505 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs podName:fcefc92a-f05c-4f98-8dda-cb44f1f759fd nodeName:}" failed. No retries permitted until 2026-09-17 03:17:12.177496086 +0000 UTC m=+271.040757172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs") pod "router-default-59c4bb7d84-8vnzp" (UID: "fcefc92a-f05c-4f98-8dda-cb44f1f759fd") : secret "router-metrics-certs-default" not found Sep 17 03:17:04.177711 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.177520 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert podName:eda1aac9-88e6-4505-a041-b3d9a47fd0ea nodeName:}" failed. No retries permitted until 2026-09-17 03:17:12.177511156 +0000 UTC m=+271.040772251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xlq5x" (UID: "eda1aac9-88e6-4505-a041-b3d9a47fd0ea") : secret "networking-console-plugin-cert" not found Sep 17 03:17:04.669899 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:04.669870 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ccc4b_eb6b281c-57cb-4f14-bd80-5bb14259031b/node-ca/0.log" Sep 17 03:17:04.683456 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:04.683425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:04.683583 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:04.683506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:04.683661 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.683622 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:04.683661 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.683616 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:04.683761 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.683694 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:08.683676773 +0000 UTC m=+267.546937866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : configmap "kube-rbac-proxy" not found Sep 17 03:17:04.683761 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:04.683712 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:08.683702648 +0000 UTC m=+267.546963730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:05.470422 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:05.470391 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-chj7k_f5b8b3cc-e169-4545-be8b-70ffd126acf6/serve-healthcheck-canary/0.log" Sep 17 03:17:06.757089 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:06.757052 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:17:06.757566 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:06.757121 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:17:06.757675 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:06.757579 2562 scope.go:117] "RemoveContainer" containerID="1adf166e0b5c04dec9e0d82685926a59536c425b17d7054ef9744c89e6ab3051" Sep 17 03:17:06.757818 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:06.757794 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-fwdt9_openshift-console-operator(ccaf6521-3a7b-4992-a879-461eac6a48c2)\"" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" podUID="ccaf6521-3a7b-4992-a879-461eac6a48c2" Sep 17 03:17:08.719491 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:08.719454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:08.720068 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:08.719563 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:08.720191 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:08.720099 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:08.720191 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:08.720122 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:16.720100927 +0000 UTC m=+275.583362021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:08.720191 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:08.720046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:08.720191 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:08.720151 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm podName:d3f2eaf7-f107-468b-8cfc-14e1683bc0e4 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:16.720135929 +0000 UTC m=+275.583397015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8q4h" (UID: "d3f2eaf7-f107-468b-8cfc-14e1683bc0e4") : configmap "kube-rbac-proxy" not found Sep 17 03:17:12.250778 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.250733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:12.251250 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.250793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:12.251250 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.250822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:12.251250 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.250845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:17:12.251250 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:12.250962 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 03:17:12.251250 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:12.251019 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert podName:eda1aac9-88e6-4505-a041-b3d9a47fd0ea nodeName:}" failed. No retries permitted until 2026-09-17 03:17:28.251002478 +0000 UTC m=+287.114263557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-xlq5x" (UID: "eda1aac9-88e6-4505-a041-b3d9a47fd0ea") : secret "networking-console-plugin-cert" not found Sep 17 03:17:12.251577 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.251551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-service-ca-bundle\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:12.253217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.253190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcefc92a-f05c-4f98-8dda-cb44f1f759fd-metrics-certs\") pod \"router-default-59c4bb7d84-8vnzp\" (UID: \"fcefc92a-f05c-4f98-8dda-cb44f1f759fd\") " pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:12.253311 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.253264 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"image-registry-5779b6f89c-tsrnd\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:12.362951 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.362911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:12.367049 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.367026 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:12.643044 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.642974 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59c4bb7d84-8vnzp"] Sep 17 03:17:12.646073 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:12.646038 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcefc92a_f05c_4f98_8dda_cb44f1f759fd.slice/crio-143f943583970559fc69ce6d4de9ab1f7ee1412a7af1429fdafedc53cc022010 WatchSource:0}: Error finding container 143f943583970559fc69ce6d4de9ab1f7ee1412a7af1429fdafedc53cc022010: Status 404 returned error can't find the container with id 143f943583970559fc69ce6d4de9ab1f7ee1412a7af1429fdafedc53cc022010 Sep 17 03:17:12.647754 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:12.647728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5779b6f89c-tsrnd"] Sep 17 03:17:12.651046 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:12.651020 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9a0215_7a4d_4433_abda_32234a58050c.slice/crio-2609ecf3d54aa9ffeaa520c01daf31715ff19b4731dca0a76a5987cbbbafc2fe WatchSource:0}: Error finding container 2609ecf3d54aa9ffeaa520c01daf31715ff19b4731dca0a76a5987cbbbafc2fe: Status 404 returned error can't find the container with id 2609ecf3d54aa9ffeaa520c01daf31715ff19b4731dca0a76a5987cbbbafc2fe Sep 17 03:17:13.515004 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:13.514967 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" event={"ID":"8a9a0215-7a4d-4433-abda-32234a58050c","Type":"ContainerStarted","Data":"ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd"} Sep 17 03:17:13.515434 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:13.515024 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" event={"ID":"8a9a0215-7a4d-4433-abda-32234a58050c","Type":"ContainerStarted","Data":"2609ecf3d54aa9ffeaa520c01daf31715ff19b4731dca0a76a5987cbbbafc2fe"} Sep 17 03:17:13.515434 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:13.515048 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:13.516554 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:13.516534 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" event={"ID":"fcefc92a-f05c-4f98-8dda-cb44f1f759fd","Type":"ContainerStarted","Data":"4cfff73f85ab2556ebb6d1187e2bc4b82c5dd5ae81de92eec420d21d11191412"} Sep 17 03:17:13.516616 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:13.516573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" event={"ID":"fcefc92a-f05c-4f98-8dda-cb44f1f759fd","Type":"ContainerStarted","Data":"143f943583970559fc69ce6d4de9ab1f7ee1412a7af1429fdafedc53cc022010"} Sep 17 03:17:13.537281 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:13.537237 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" podStartSLOduration=17.537224824 podStartE2EDuration="17.537224824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:13.535937283 +0000 UTC m=+272.399198382" watchObservedRunningTime="2026-09-17 03:17:13.537224824 +0000 UTC m=+272.400485916" Sep 17 03:17:13.555752 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:13.555712 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" podStartSLOduration=17.555699047 podStartE2EDuration="17.555699047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:13.554316427 +0000 UTC m=+272.417577527" watchObservedRunningTime="2026-09-17 03:17:13.555699047 +0000 UTC m=+272.418960145" Sep 17 03:17:14.363685 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:14.363650 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:14.366231 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:14.366208 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:14.520280 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:14.520242 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:14.521384 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:14.521360 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59c4bb7d84-8vnzp" Sep 17 03:17:16.790600 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:16.790554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:16.791145 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:16.790670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:16.791269 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:16.791245 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:16.792962 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:16.792940 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f2eaf7-f107-468b-8cfc-14e1683bc0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8q4h\" (UID: \"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4\") " pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:16.820035 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:16.820006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t8q4h" Sep 17 03:17:17.089877 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:17.089775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t8q4h"] Sep 17 03:17:17.092585 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:17.092557 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f2eaf7_f107_468b_8cfc_14e1683bc0e4.slice/crio-d2c1210b86329560a1366e30b55940126f6c47fdd9387d66dbefa4e1c7f9b533 WatchSource:0}: Error finding container d2c1210b86329560a1366e30b55940126f6c47fdd9387d66dbefa4e1c7f9b533: Status 404 returned error can't find the container with id d2c1210b86329560a1366e30b55940126f6c47fdd9387d66dbefa4e1c7f9b533 Sep 17 03:17:17.533309 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:17.533274 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8q4h" event={"ID":"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4","Type":"ContainerStarted","Data":"13ba0162d6a611c124e4cdba544edcdcb807024a5a6691e0e7f76d97dd0dc2e3"} Sep 17 03:17:17.533478 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:17.533331 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8q4h" event={"ID":"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4","Type":"ContainerStarted","Data":"d2c1210b86329560a1366e30b55940126f6c47fdd9387d66dbefa4e1c7f9b533"} Sep 17 03:17:18.538055 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:18.538020 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8q4h" event={"ID":"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4","Type":"ContainerStarted","Data":"88dc76e5817cc31e10c8222d2917b41ee897389be94818bb72c9787c3a8b98ee"} Sep 17 03:17:20.546871 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:20.546832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8q4h" event={"ID":"d3f2eaf7-f107-468b-8cfc-14e1683bc0e4","Type":"ContainerStarted","Data":"30e03683e8f9d24e29b36dc26fbc3c04a3ad75e1f5f047110d7fde1e82c9ac48"} Sep 17 03:17:20.565428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:20.565380 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t8q4h" podStartSLOduration=18.011617653 podStartE2EDuration="20.565364369s" totalImagesPullingTime="2.553746716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:17:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:20.564228202 +0000 UTC m=+279.427489300" watchObservedRunningTime="2026-09-17 03:17:20.565364369 +0000 UTC m=+279.428625468" Sep 17 03:17:21.603935 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:21.603905 2562 scope.go:117] "RemoveContainer" containerID="1adf166e0b5c04dec9e0d82685926a59536c425b17d7054ef9744c89e6ab3051" Sep 17 03:17:22.215837 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:22.215776 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-87nwc" podUID="d5230005-8666-4201-9a9b-5c85bb4dd5dc" Sep 17 03:17:22.554121 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:22.554050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:17:22.554419 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:22.554404 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/1.log" Sep 17 03:17:22.554459 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:22.554435 2562 generic.go:356] "Generic (PLEG): container finished" podID="ccaf6521-3a7b-4992-a879-461eac6a48c2" containerID="90c0d37f8928e6a4afbb00b5ea59aa0a05f7c4ab08c71f4e8baf52e2d0d5274a" exitCode=255 Sep 17 03:17:22.554503 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:22.554494 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87nwc" Sep 17 03:17:22.554539 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:22.554510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" event={"ID":"ccaf6521-3a7b-4992-a879-461eac6a48c2","Type":"ContainerDied","Data":"90c0d37f8928e6a4afbb00b5ea59aa0a05f7c4ab08c71f4e8baf52e2d0d5274a"} Sep 17 03:17:22.554570 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:22.554562 2562 scope.go:117] "RemoveContainer" containerID="1adf166e0b5c04dec9e0d82685926a59536c425b17d7054ef9744c89e6ab3051" Sep 17 03:17:22.554849 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:22.554830 2562 scope.go:117] "RemoveContainer" containerID="90c0d37f8928e6a4afbb00b5ea59aa0a05f7c4ab08c71f4e8baf52e2d0d5274a" Sep 17 03:17:22.555009 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:22.554990 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-fwdt9_openshift-console-operator(ccaf6521-3a7b-4992-a879-461eac6a48c2)\"" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" podUID="ccaf6521-3a7b-4992-a879-461eac6a48c2" Sep 17 03:17:23.558771 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:23.558743 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:17:24.648340 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:24.648311 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5779b6f89c-tsrnd"] Sep 17 03:17:25.958975 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:25.958923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:17:25.961218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:25.961193 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5230005-8666-4201-9a9b-5c85bb4dd5dc-metrics-tls\") pod \"dns-default-87nwc\" (UID: \"d5230005-8666-4201-9a9b-5c85bb4dd5dc\") " pod="openshift-dns/dns-default-87nwc" Sep 17 03:17:26.157527 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:26.157493 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lg7wr\"" Sep 17 03:17:26.165861 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:26.165835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87nwc" Sep 17 03:17:26.437305 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:26.437218 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87nwc"] Sep 17 03:17:26.439793 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:26.439752 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5230005_8666_4201_9a9b_5c85bb4dd5dc.slice/crio-089538f6ff8a71522e7b11a15b6ab135747040c925c913701b65ad9ca84bb207 WatchSource:0}: Error finding container 089538f6ff8a71522e7b11a15b6ab135747040c925c913701b65ad9ca84bb207: Status 404 returned error can't find the container with id 089538f6ff8a71522e7b11a15b6ab135747040c925c913701b65ad9ca84bb207 Sep 17 03:17:26.568363 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:26.568280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87nwc" event={"ID":"d5230005-8666-4201-9a9b-5c85bb4dd5dc","Type":"ContainerStarted","Data":"089538f6ff8a71522e7b11a15b6ab135747040c925c913701b65ad9ca84bb207"} Sep 17 03:17:26.757558 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:26.757526 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:17:26.757738 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:26.757584 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:17:26.757912 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:26.757897 2562 scope.go:117] "RemoveContainer" containerID="90c0d37f8928e6a4afbb00b5ea59aa0a05f7c4ab08c71f4e8baf52e2d0d5274a" Sep 17 03:17:26.758057 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:26.758039 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-fwdt9_openshift-console-operator(ccaf6521-3a7b-4992-a879-461eac6a48c2)\"" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" podUID="ccaf6521-3a7b-4992-a879-461eac6a48c2" Sep 17 03:17:28.277041 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:28.276950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:17:28.279353 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:28.279330 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eda1aac9-88e6-4505-a041-b3d9a47fd0ea-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-xlq5x\" (UID: \"eda1aac9-88e6-4505-a041-b3d9a47fd0ea\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:17:28.541464 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:28.541363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" Sep 17 03:17:28.577588 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:28.577550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87nwc" event={"ID":"d5230005-8666-4201-9a9b-5c85bb4dd5dc","Type":"ContainerStarted","Data":"efb8a1fb27cc6f3481e9c92cf3c1642ad9def621edcad6e8a79018e62d2454df"} Sep 17 03:17:28.577769 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:28.577614 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87nwc" event={"ID":"d5230005-8666-4201-9a9b-5c85bb4dd5dc","Type":"ContainerStarted","Data":"6ef6da1e062b51fd4b142615d5f5a9e6fc5af40bf330fc39806542d45ea98e13"} Sep 17 03:17:28.577769 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:28.577690 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-87nwc" Sep 17 03:17:28.596353 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:28.596297 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-87nwc" podStartSLOduration=252.046036127 podStartE2EDuration="4m13.596273298s" totalImagesPullingTime="1.550237171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:28.593972426 +0000 UTC m=+287.457233525" watchObservedRunningTime="2026-09-17 03:17:28.596273298 +0000 UTC m=+287.459534399" Sep 17 03:17:28.811434 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:28.811362 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x"] Sep 17 03:17:28.814437 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:28.814408 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda1aac9_88e6_4505_a041_b3d9a47fd0ea.slice/crio-e769fba8e972711e84a270b8b3352d090a75e7c514069680493cd47300911e06 WatchSource:0}: Error finding container e769fba8e972711e84a270b8b3352d090a75e7c514069680493cd47300911e06: Status 404 returned error can't find the container with id e769fba8e972711e84a270b8b3352d090a75e7c514069680493cd47300911e06 Sep 17 03:17:29.582648 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:29.582609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" event={"ID":"eda1aac9-88e6-4505-a041-b3d9a47fd0ea","Type":"ContainerStarted","Data":"e769fba8e972711e84a270b8b3352d090a75e7c514069680493cd47300911e06"} Sep 17 03:17:30.587032 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:30.586995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" event={"ID":"eda1aac9-88e6-4505-a041-b3d9a47fd0ea","Type":"ContainerStarted","Data":"cfcc7230af0029973be5fa240a360ccd46840fd226be049aa78ed6238e07d834"} Sep 17 03:17:30.604875 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:30.604825 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-xlq5x" podStartSLOduration=33.276117222 podStartE2EDuration="34.604809581s" totalImagesPullingTime="1.328692359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:30.604378608 +0000 UTC m=+289.467639706" watchObservedRunningTime="2026-09-17 03:17:30.604809581 +0000 UTC m=+289.468070680" Sep 17 03:17:33.645212 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.645176 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x"] Sep 17 03:17:33.649974 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.649954 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.653072 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.653018 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 03:17:33.653191 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.653126 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 03:17:33.654371 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.654345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 03:17:33.654474 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.654351 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gglgj\"" Sep 17 03:17:33.654474 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.654351 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 03:17:33.654577 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.654357 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 03:17:33.661132 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.661112 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x"] Sep 17 03:17:33.679384 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.679358 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fslsd"] Sep 17 03:17:33.682798 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.682776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.685469 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.685449 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 03:17:33.685727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.685707 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qmnn9\"" Sep 17 03:17:33.685837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.685741 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 03:17:33.685837 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.685707 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 03:17:33.719850 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.719814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.720021 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.719854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zvb7\" (UniqueName: \"kubernetes.io/projected/8b0c1d49-d805-4024-a30a-79e5cccee7b3-kube-api-access-8zvb7\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.720021 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.719887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-sys\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.720021 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.719942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-wtmp\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.720021 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.719984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-root\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.720021 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.720017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-tls\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.720277 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.720047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.720277 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.720096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.720277 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.720131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b0c1d49-d805-4024-a30a-79e5cccee7b3-metrics-client-ca\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.720277 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.720223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01d0b864-230e-4407-9b44-99db90f9a929-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.720489 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.720299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc9zc\" (UniqueName: \"kubernetes.io/projected/01d0b864-230e-4407-9b44-99db90f9a929-kube-api-access-wc9zc\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.720489 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.720324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-textfile\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.720489 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.720357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.820989 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.820946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01d0b864-230e-4407-9b44-99db90f9a929-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.821180 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc9zc\" (UniqueName: \"kubernetes.io/projected/01d0b864-230e-4407-9b44-99db90f9a929-kube-api-access-wc9zc\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.821180 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-textfile\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821180 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821180 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821180 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zvb7\" (UniqueName: \"kubernetes.io/projected/8b0c1d49-d805-4024-a30a-79e5cccee7b3-kube-api-access-8zvb7\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821180 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821174 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-sys\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-wtmp\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-root\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-tls\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.821472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.821472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b0c1d49-d805-4024-a30a-79e5cccee7b3-metrics-client-ca\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821444 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-textfile\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821845 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821505 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-wtmp\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821845 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:33.821549 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 03:17:33.821845 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821567 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-sys\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821845 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:33.821618 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-tls podName:8b0c1d49-d805-4024-a30a-79e5cccee7b3 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:34.321598679 +0000 UTC m=+293.184859766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-tls") pod "node-exporter-fslsd" (UID: "8b0c1d49-d805-4024-a30a-79e5cccee7b3") : secret "node-exporter-tls" not found Sep 17 03:17:33.821845 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821677 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b0c1d49-d805-4024-a30a-79e5cccee7b3-root\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.821845 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:33.821770 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 17 03:17:33.821845 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:33.821837 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-tls podName:01d0b864-230e-4407-9b44-99db90f9a929 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:34.321820713 +0000 UTC m=+293.185081789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-6lx2x" (UID: "01d0b864-230e-4407-9b44-99db90f9a929") : secret "openshift-state-metrics-tls" not found Sep 17 03:17:33.822185 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.821860 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01d0b864-230e-4407-9b44-99db90f9a929-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.822185 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.822176 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b0c1d49-d805-4024-a30a-79e5cccee7b3-metrics-client-ca\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.822455 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.822428 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.824035 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.824013 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.824210 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.824194 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:33.830063 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.830038 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc9zc\" (UniqueName: \"kubernetes.io/projected/01d0b864-230e-4407-9b44-99db90f9a929-kube-api-access-wc9zc\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:33.830608 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:33.830576 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zvb7\" (UniqueName: \"kubernetes.io/projected/8b0c1d49-d805-4024-a30a-79e5cccee7b3-kube-api-access-8zvb7\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:34.327085 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.327037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-tls\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:34.327085 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.327092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:34.329458 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.329421 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b0c1d49-d805-4024-a30a-79e5cccee7b3-node-exporter-tls\") pod \"node-exporter-fslsd\" (UID: \"8b0c1d49-d805-4024-a30a-79e5cccee7b3\") " pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:34.329612 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.329593 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01d0b864-230e-4407-9b44-99db90f9a929-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-6lx2x\" (UID: \"01d0b864-230e-4407-9b44-99db90f9a929\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:34.560256 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.560219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" Sep 17 03:17:34.594136 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.594051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fslsd" Sep 17 03:17:34.604047 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:34.604011 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fc2sm" podUID="e543faf0-188b-4617-91a4-2c86fc7a2f29" Sep 17 03:17:34.605589 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:34.605558 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0c1d49_d805_4024_a30a_79e5cccee7b3.slice/crio-d79af9009ff8e83d979ea5066eeda3d434f19a146e133432684e939ca465725e WatchSource:0}: Error finding container d79af9009ff8e83d979ea5066eeda3d434f19a146e133432684e939ca465725e: Status 404 returned error can't find the container with id d79af9009ff8e83d979ea5066eeda3d434f19a146e133432684e939ca465725e Sep 17 03:17:34.653924 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.653881 2562 patch_prober.go:28] interesting pod/image-registry-5779b6f89c-tsrnd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 03:17:34.654333 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.653955 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" podUID="8a9a0215-7a4d-4433-abda-32234a58050c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 03:17:34.834627 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:34.834604 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x"] Sep 17 03:17:34.836754 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:34.836726 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d0b864_230e_4407_9b44_99db90f9a929.slice/crio-43cce4895cd713ccb93f20df8eea93646a81914d20bb552d869929d876397bb8 WatchSource:0}: Error finding container 43cce4895cd713ccb93f20df8eea93646a81914d20bb552d869929d876397bb8: Status 404 returned error can't find the container with id 43cce4895cd713ccb93f20df8eea93646a81914d20bb552d869929d876397bb8 Sep 17 03:17:35.615139 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:35.615095 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fslsd" event={"ID":"8b0c1d49-d805-4024-a30a-79e5cccee7b3","Type":"ContainerStarted","Data":"d79af9009ff8e83d979ea5066eeda3d434f19a146e133432684e939ca465725e"} Sep 17 03:17:35.617413 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:35.617377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" event={"ID":"01d0b864-230e-4407-9b44-99db90f9a929","Type":"ContainerStarted","Data":"2d77c6bd194dd6a13f75b135fa427fcf64b84abb4b9343e50273f1ad90ba83d1"} Sep 17 03:17:35.617539 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:35.617438 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" event={"ID":"01d0b864-230e-4407-9b44-99db90f9a929","Type":"ContainerStarted","Data":"e23e47f7ae086e8ee7e719f8947dfb612fde07c9b5e1504698e8e1d2e835e673"} Sep 17 03:17:35.617539 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:35.617468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" event={"ID":"01d0b864-230e-4407-9b44-99db90f9a929","Type":"ContainerStarted","Data":"43cce4895cd713ccb93f20df8eea93646a81914d20bb552d869929d876397bb8"} Sep 17 03:17:36.622619 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.622583 2562 generic.go:356] "Generic (PLEG): container finished" podID="8b0c1d49-d805-4024-a30a-79e5cccee7b3" containerID="b4c0cb571a872e8490ae6b1b67ccab58fb4cf8513b8fa458dbf87b14a82ebaee" exitCode=0 Sep 17 03:17:36.623091 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.622698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fslsd" event={"ID":"8b0c1d49-d805-4024-a30a-79e5cccee7b3","Type":"ContainerDied","Data":"b4c0cb571a872e8490ae6b1b67ccab58fb4cf8513b8fa458dbf87b14a82ebaee"} Sep 17 03:17:36.625044 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.625016 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-857fb9bdb7-w85sf"] Sep 17 03:17:36.628791 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.628770 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" event={"ID":"01d0b864-230e-4407-9b44-99db90f9a929","Type":"ContainerStarted","Data":"f072ee56752e9f54bfce684adde75bb22568d666f5dd83fa7114e98f328d3d29"} Sep 17 03:17:36.628890 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.628857 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.631891 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.631524 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 03:17:36.631891 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.631587 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4dso7i10q4vdv\"" Sep 17 03:17:36.631891 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.631603 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 03:17:36.632084 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.631969 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 03:17:36.632084 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.631987 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 03:17:36.632197 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.632109 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ws6qh\"" Sep 17 03:17:36.632197 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.632178 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 03:17:36.641265 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.641242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-857fb9bdb7-w85sf"] Sep 17 03:17:36.678411 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.678368 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-6lx2x" podStartSLOduration=2.527756279 podStartE2EDuration="3.678352116s" totalImagesPullingTime="1.150595837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:36.677187822 +0000 UTC m=+295.540448921" watchObservedRunningTime="2026-09-17 03:17:36.678352116 +0000 UTC m=+295.541613266" Sep 17 03:17:36.747447 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.747416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-tls\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.747567 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.747468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.747567 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.747542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8cq9\" (UniqueName: \"kubernetes.io/projected/462e8fda-2d5c-490c-afef-c06f747e0a2c-kube-api-access-q8cq9\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.747707 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.747591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.747707 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.747662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-grpc-tls\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.747804 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.747706 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.747804 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.747791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.747915 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.747829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462e8fda-2d5c-490c-afef-c06f747e0a2c-metrics-client-ca\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.849125 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.849089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.849287 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.849144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462e8fda-2d5c-490c-afef-c06f747e0a2c-metrics-client-ca\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.849287 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.849200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-tls\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.849287 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.849233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.849287 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.849271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8cq9\" (UniqueName: \"kubernetes.io/projected/462e8fda-2d5c-490c-afef-c06f747e0a2c-kube-api-access-q8cq9\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.849496 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.849304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.849496 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.849341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-grpc-tls\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.849496 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.849372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.850341 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.850307 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462e8fda-2d5c-490c-afef-c06f747e0a2c-metrics-client-ca\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.852046 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.852017 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.852229 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.852205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.852304 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.852281 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-tls\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.852664 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.852623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.852757 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.852731 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-grpc-tls\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.852860 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.852839 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/462e8fda-2d5c-490c-afef-c06f747e0a2c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.857490 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.857470 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8cq9\" (UniqueName: \"kubernetes.io/projected/462e8fda-2d5c-490c-afef-c06f747e0a2c-kube-api-access-q8cq9\") pod \"thanos-querier-857fb9bdb7-w85sf\" (UID: \"462e8fda-2d5c-490c-afef-c06f747e0a2c\") " pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:36.940582 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:36.940495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:37.215876 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:37.215846 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-857fb9bdb7-w85sf"] Sep 17 03:17:37.217694 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:37.217669 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462e8fda_2d5c_490c_afef_c06f747e0a2c.slice/crio-d003a92c834849237a6f361e21de5eb022dfc388091b62037606b0c8dbecf043 WatchSource:0}: Error finding container d003a92c834849237a6f361e21de5eb022dfc388091b62037606b0c8dbecf043: Status 404 returned error can't find the container with id d003a92c834849237a6f361e21de5eb022dfc388091b62037606b0c8dbecf043 Sep 17 03:17:37.631998 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:37.631908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fslsd" event={"ID":"8b0c1d49-d805-4024-a30a-79e5cccee7b3","Type":"ContainerStarted","Data":"e4faac7839d1a4f8c7b591f97626d9cb22602a7357cbaa7c9cd3158d66e58ab9"} Sep 17 03:17:37.631998 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:37.631959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fslsd" event={"ID":"8b0c1d49-d805-4024-a30a-79e5cccee7b3","Type":"ContainerStarted","Data":"0c9055aae7473d611e9ebf93520e65a9506d79fd0dcae6374b92f5ddd00a07a5"} Sep 17 03:17:37.633208 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:37.633181 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" event={"ID":"462e8fda-2d5c-490c-afef-c06f747e0a2c","Type":"ContainerStarted","Data":"d003a92c834849237a6f361e21de5eb022dfc388091b62037606b0c8dbecf043"} Sep 17 03:17:37.652904 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:37.652868 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fslsd" podStartSLOduration=3.498811711 podStartE2EDuration="4.652855256s" totalImagesPullingTime="1.084977512s" totalInitContainerRuntime="69.066033ms" isStatefulPod=true podCreationTimestamp="2026-09-17 03:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:37.650817257 +0000 UTC m=+296.514078355" watchObservedRunningTime="2026-09-17 03:17:37.652855256 +0000 UTC m=+296.516116355" Sep 17 03:17:38.413365 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.412868 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l"] Sep 17 03:17:38.417304 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.417271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:38.420321 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.420296 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 03:17:38.420462 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.420367 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mt2nz\"" Sep 17 03:17:38.423890 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.423859 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l"] Sep 17 03:17:38.463803 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.463766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68900ba-1cde-4473-903c-8feb28c63708-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vbd4l\" (UID: \"c68900ba-1cde-4473-903c-8feb28c63708\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:38.463969 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.463813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdjkw\" (UniqueName: \"kubernetes.io/projected/c68900ba-1cde-4473-903c-8feb28c63708-kube-api-access-kdjkw\") pod \"monitoring-plugin-5d85778b9d-vbd4l\" (UID: \"c68900ba-1cde-4473-903c-8feb28c63708\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:38.564586 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.564545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68900ba-1cde-4473-903c-8feb28c63708-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vbd4l\" (UID: \"c68900ba-1cde-4473-903c-8feb28c63708\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:38.564586 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.564597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdjkw\" (UniqueName: \"kubernetes.io/projected/c68900ba-1cde-4473-903c-8feb28c63708-kube-api-access-kdjkw\") pod \"monitoring-plugin-5d85778b9d-vbd4l\" (UID: \"c68900ba-1cde-4473-903c-8feb28c63708\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:38.564926 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:38.564736 2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 03:17:38.564926 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:38.564822 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68900ba-1cde-4473-903c-8feb28c63708-monitoring-plugin-cert podName:c68900ba-1cde-4473-903c-8feb28c63708 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:39.064801061 +0000 UTC m=+297.928062142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c68900ba-1cde-4473-903c-8feb28c63708-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-vbd4l" (UID: "c68900ba-1cde-4473-903c-8feb28c63708") : secret "monitoring-plugin-cert" not found Sep 17 03:17:38.575734 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.575711 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdjkw\" (UniqueName: \"kubernetes.io/projected/c68900ba-1cde-4473-903c-8feb28c63708-kube-api-access-kdjkw\") pod \"monitoring-plugin-5d85778b9d-vbd4l\" (UID: \"c68900ba-1cde-4473-903c-8feb28c63708\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:38.585439 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.585414 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-87nwc" Sep 17 03:17:38.602160 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:38.602095 2562 scope.go:117] "RemoveContainer" containerID="90c0d37f8928e6a4afbb00b5ea59aa0a05f7c4ab08c71f4e8baf52e2d0d5274a" Sep 17 03:17:38.602388 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:38.602345 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-fwdt9_openshift-console-operator(ccaf6521-3a7b-4992-a879-461eac6a48c2)\"" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" podUID="ccaf6521-3a7b-4992-a879-461eac6a48c2" Sep 17 03:17:39.069228 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:39.069183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68900ba-1cde-4473-903c-8feb28c63708-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vbd4l\" (UID: \"c68900ba-1cde-4473-903c-8feb28c63708\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:39.072091 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:39.072058 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68900ba-1cde-4473-903c-8feb28c63708-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-vbd4l\" (UID: \"c68900ba-1cde-4473-903c-8feb28c63708\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:39.330939 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:39.330878 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:39.598970 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:39.598946 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l"] Sep 17 03:17:39.600932 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:39.600906 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68900ba_1cde_4473_903c_8feb28c63708.slice/crio-fd6923d9c54e7bbf77ff8a12bb42d9c701e69493b7d0e26ae7aa7ce187c2fb73 WatchSource:0}: Error finding container fd6923d9c54e7bbf77ff8a12bb42d9c701e69493b7d0e26ae7aa7ce187c2fb73: Status 404 returned error can't find the container with id fd6923d9c54e7bbf77ff8a12bb42d9c701e69493b7d0e26ae7aa7ce187c2fb73 Sep 17 03:17:39.643353 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:39.643311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" event={"ID":"462e8fda-2d5c-490c-afef-c06f747e0a2c","Type":"ContainerStarted","Data":"7af68ab508938be8f1537e01802907b5491514a601c43b9da24aecb626d03112"} Sep 17 03:17:39.643491 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:39.643381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" event={"ID":"462e8fda-2d5c-490c-afef-c06f747e0a2c","Type":"ContainerStarted","Data":"5e48376594410fd0b0f9c1a96ff5ea25158a51df4f984fec3497489d83f0b9b9"} Sep 17 03:17:39.643491 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:39.643412 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" event={"ID":"462e8fda-2d5c-490c-afef-c06f747e0a2c","Type":"ContainerStarted","Data":"4dda8c92eb09e5fb085e134ca992c48b60ba3da30b801123d980bc2cdc54fbce"} Sep 17 03:17:39.644477 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:39.644451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" event={"ID":"c68900ba-1cde-4473-903c-8feb28c63708","Type":"ContainerStarted","Data":"fd6923d9c54e7bbf77ff8a12bb42d9c701e69493b7d0e26ae7aa7ce187c2fb73"} Sep 17 03:17:40.651206 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:40.651136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" event={"ID":"462e8fda-2d5c-490c-afef-c06f747e0a2c","Type":"ContainerStarted","Data":"c56c40cbcdc9bb9b9a8b5c8e0dd8f0ed30612aadbc3e5ed150cff6ebd8c37bcc"} Sep 17 03:17:40.651507 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:40.651205 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" event={"ID":"462e8fda-2d5c-490c-afef-c06f747e0a2c","Type":"ContainerStarted","Data":"e1bfe89d98fad8ded01c63aba0d793748ba9ad26e4a467b84611bf986460cfe8"} Sep 17 03:17:40.651507 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:40.651234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" event={"ID":"462e8fda-2d5c-490c-afef-c06f747e0a2c","Type":"ContainerStarted","Data":"534bd9a80ee3e11b49664f975112d37d69c58070fc4ce787935fe1554d2a9321"} Sep 17 03:17:40.651507 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:40.651303 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:40.676533 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:40.676487 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" podStartSLOduration=1.7250118909999999 podStartE2EDuration="4.676470196s" totalImagesPullingTime="2.951458305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:40.675419048 +0000 UTC m=+299.538680160" watchObservedRunningTime="2026-09-17 03:17:40.676470196 +0000 UTC m=+299.539731295" Sep 17 03:17:41.485896 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:41.485866 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:17:41.487084 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:41.487061 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:17:41.497415 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:41.497389 2562 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 03:17:41.656265 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:41.656121 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" event={"ID":"c68900ba-1cde-4473-903c-8feb28c63708","Type":"ContainerStarted","Data":"0f3710ba726d075dcb9a41fd2ce97498e909e0846e7b1ea6593ba701a9f7c6a4"} Sep 17 03:17:41.684205 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:41.656482 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:41.684205 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:41.661160 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" Sep 17 03:17:41.684205 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:41.672469 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-vbd4l" podStartSLOduration=2.256491712 podStartE2EDuration="3.672458764s" totalImagesPullingTime="1.415967052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:41.67111928 +0000 UTC m=+300.534380378" watchObservedRunningTime="2026-09-17 03:17:41.672458764 +0000 UTC m=+300.535719862" Sep 17 03:17:44.652779 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:44.652748 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:46.662255 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:46.662225 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-857fb9bdb7-w85sf" Sep 17 03:17:47.602570 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:47.602535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:17:49.666743 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:49.666675 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" podUID="8a9a0215-7a4d-4433-abda-32234a58050c" containerName="registry" containerID="cri-o://ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd" gracePeriod=30 Sep 17 03:17:49.919309 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:49.919247 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:50.060972 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.060940 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-image-registry-private-configuration\") pod \"8a9a0215-7a4d-4433-abda-32234a58050c\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " Sep 17 03:17:50.060972 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.060980 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-installation-pull-secrets\") pod \"8a9a0215-7a4d-4433-abda-32234a58050c\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " Sep 17 03:17:50.061243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.061009 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") pod \"8a9a0215-7a4d-4433-abda-32234a58050c\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " Sep 17 03:17:50.061243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.061030 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a9a0215-7a4d-4433-abda-32234a58050c-ca-trust-extracted\") pod \"8a9a0215-7a4d-4433-abda-32234a58050c\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " Sep 17 03:17:50.061243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.061057 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-bound-sa-token\") pod \"8a9a0215-7a4d-4433-abda-32234a58050c\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " Sep 17 03:17:50.061243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.061086 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-registry-certificates\") pod \"8a9a0215-7a4d-4433-abda-32234a58050c\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " Sep 17 03:17:50.061243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.061129 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-trusted-ca\") pod \"8a9a0215-7a4d-4433-abda-32234a58050c\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " Sep 17 03:17:50.061243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.061149 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqhg7\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-kube-api-access-tqhg7\") pod \"8a9a0215-7a4d-4433-abda-32234a58050c\" (UID: \"8a9a0215-7a4d-4433-abda-32234a58050c\") " Sep 17 03:17:50.061813 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.061757 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8a9a0215-7a4d-4433-abda-32234a58050c" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:17:50.061965 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.061934 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8a9a0215-7a4d-4433-abda-32234a58050c" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:17:50.063525 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.063496 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-kube-api-access-tqhg7" (OuterVolumeSpecName: "kube-api-access-tqhg7") pod "8a9a0215-7a4d-4433-abda-32234a58050c" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c"). InnerVolumeSpecName "kube-api-access-tqhg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:17:50.063649 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.063572 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8a9a0215-7a4d-4433-abda-32234a58050c" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:17:50.063811 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.063784 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8a9a0215-7a4d-4433-abda-32234a58050c" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:17:50.063923 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.063808 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8a9a0215-7a4d-4433-abda-32234a58050c" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:17:50.063923 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.063845 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8a9a0215-7a4d-4433-abda-32234a58050c" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:17:50.070018 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.069995 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9a0215-7a4d-4433-abda-32234a58050c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8a9a0215-7a4d-4433-abda-32234a58050c" (UID: "8a9a0215-7a4d-4433-abda-32234a58050c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:17:50.162357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.162317 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-bound-sa-token\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:17:50.162357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.162353 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-registry-certificates\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:17:50.162357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.162363 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a9a0215-7a4d-4433-abda-32234a58050c-trusted-ca\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:17:50.162533 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.162372 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqhg7\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-kube-api-access-tqhg7\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:17:50.162533 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.162382 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-image-registry-private-configuration\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:17:50.162533 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.162391 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a9a0215-7a4d-4433-abda-32234a58050c-installation-pull-secrets\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:17:50.162533 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.162398 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a9a0215-7a4d-4433-abda-32234a58050c-registry-tls\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:17:50.162533 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.162406 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a9a0215-7a4d-4433-abda-32234a58050c-ca-trust-extracted\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:17:50.689503 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.689467 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a9a0215-7a4d-4433-abda-32234a58050c" containerID="ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd" exitCode=0 Sep 17 03:17:50.689921 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.689515 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" Sep 17 03:17:50.689921 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.689540 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" event={"ID":"8a9a0215-7a4d-4433-abda-32234a58050c","Type":"ContainerDied","Data":"ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd"} Sep 17 03:17:50.689921 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.689586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5779b6f89c-tsrnd" event={"ID":"8a9a0215-7a4d-4433-abda-32234a58050c","Type":"ContainerDied","Data":"2609ecf3d54aa9ffeaa520c01daf31715ff19b4731dca0a76a5987cbbbafc2fe"} Sep 17 03:17:50.689921 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.689612 2562 scope.go:117] "RemoveContainer" containerID="ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd" Sep 17 03:17:50.698297 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.698275 2562 scope.go:117] "RemoveContainer" containerID="ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd" Sep 17 03:17:50.698585 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:17:50.698564 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd\": container with ID starting with ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd not found: ID does not exist" containerID="ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd" Sep 17 03:17:50.698656 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.698592 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd"} err="failed to get container status \"ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd\": rpc error: code = NotFound desc = could not find container \"ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd\": container with ID starting with ffe638a4254d0bdf5b696aed3a1078e86cba8c9741019104cf42f5e40ffa76bd not found: ID does not exist" Sep 17 03:17:50.710932 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.710910 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5779b6f89c-tsrnd"] Sep 17 03:17:50.716617 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:50.716597 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5779b6f89c-tsrnd"] Sep 17 03:17:51.603916 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:51.603890 2562 scope.go:117] "RemoveContainer" containerID="90c0d37f8928e6a4afbb00b5ea59aa0a05f7c4ab08c71f4e8baf52e2d0d5274a" Sep 17 03:17:51.606589 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:51.606564 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a9a0215-7a4d-4433-abda-32234a58050c" path="/var/lib/kubelet/pods/8a9a0215-7a4d-4433-abda-32234a58050c/volumes" Sep 17 03:17:51.696728 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:51.696699 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:17:51.697071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:51.696751 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" event={"ID":"ccaf6521-3a7b-4992-a879-461eac6a48c2","Type":"ContainerStarted","Data":"ead4946018f6f8f7065884c5eacbeec25746e53722d8585a055c42960229c214"} Sep 17 03:17:51.697071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:51.696995 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:17:51.698550 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:51.698523 2562 patch_prober.go:28] interesting pod/console-operator-696884fb9c-fwdt9 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.11:8443/readyz\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Sep 17 03:17:51.698665 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:51.698572 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" podUID="ccaf6521-3a7b-4992-a879-461eac6a48c2" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.11:8443/readyz\": dial tcp 10.134.0.11:8443: connect: connection refused" Sep 17 03:17:51.713515 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:51.713472 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" podStartSLOduration=53.308573396 podStartE2EDuration="55.713458204s" totalImagesPullingTime="2.404884808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:51.712535992 +0000 UTC m=+310.575797091" watchObservedRunningTime="2026-09-17 03:17:51.713458204 +0000 UTC m=+310.576719302" Sep 17 03:17:52.536724 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.536688 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-7pcnz"] Sep 17 03:17:52.537013 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.536998 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9a0215-7a4d-4433-abda-32234a58050c" containerName="registry" Sep 17 03:17:52.537013 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.537014 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9a0215-7a4d-4433-abda-32234a58050c" containerName="registry" Sep 17 03:17:52.537111 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.537066 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a9a0215-7a4d-4433-abda-32234a58050c" containerName="registry" Sep 17 03:17:52.540255 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.540239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-7pcnz" Sep 17 03:17:52.542957 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.542931 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 03:17:52.543072 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.543028 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 03:17:52.543072 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.543056 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wbgn8\"" Sep 17 03:17:52.549194 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.549174 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-7pcnz"] Sep 17 03:17:52.682891 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.682852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwz6s\" (UniqueName: \"kubernetes.io/projected/d2714123-e557-41b7-b044-f97d09266d3c-kube-api-access-vwz6s\") pod \"downloads-76f99584f4-7pcnz\" (UID: \"d2714123-e557-41b7-b044-f97d09266d3c\") " pod="openshift-console/downloads-76f99584f4-7pcnz" Sep 17 03:17:52.704204 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.704178 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-fwdt9" Sep 17 03:17:52.783768 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.783730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwz6s\" (UniqueName: \"kubernetes.io/projected/d2714123-e557-41b7-b044-f97d09266d3c-kube-api-access-vwz6s\") pod \"downloads-76f99584f4-7pcnz\" (UID: \"d2714123-e557-41b7-b044-f97d09266d3c\") " pod="openshift-console/downloads-76f99584f4-7pcnz" Sep 17 03:17:52.792141 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.792082 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwz6s\" (UniqueName: \"kubernetes.io/projected/d2714123-e557-41b7-b044-f97d09266d3c-kube-api-access-vwz6s\") pod \"downloads-76f99584f4-7pcnz\" (UID: \"d2714123-e557-41b7-b044-f97d09266d3c\") " pod="openshift-console/downloads-76f99584f4-7pcnz" Sep 17 03:17:52.850065 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:52.850021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-7pcnz" Sep 17 03:17:53.122363 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:53.122296 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-7pcnz"] Sep 17 03:17:53.125099 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:17:53.125071 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2714123_e557_41b7_b044_f97d09266d3c.slice/crio-bf5b0793039c91df4a10df72d3f48e7478bd6ddd1994915ccc34d9efecb6cdeb WatchSource:0}: Error finding container bf5b0793039c91df4a10df72d3f48e7478bd6ddd1994915ccc34d9efecb6cdeb: Status 404 returned error can't find the container with id bf5b0793039c91df4a10df72d3f48e7478bd6ddd1994915ccc34d9efecb6cdeb Sep 17 03:17:53.127028 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:53.127013 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:17:53.705869 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:17:53.705832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-7pcnz" event={"ID":"d2714123-e557-41b7-b044-f97d09266d3c","Type":"ContainerStarted","Data":"bf5b0793039c91df4a10df72d3f48e7478bd6ddd1994915ccc34d9efecb6cdeb"} Sep 17 03:18:09.639310 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.639270 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b4868fb9b-vhphp"] Sep 17 03:18:09.643981 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.643955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.648653 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.648297 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 03:18:09.648653 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.648417 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 03:18:09.648653 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.648469 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 03:18:09.648653 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.648476 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 03:18:09.648653 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.648531 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 03:18:09.649085 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.649056 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bl97j\"" Sep 17 03:18:09.654114 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.654078 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 03:18:09.655298 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.655273 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b4868fb9b-vhphp"] Sep 17 03:18:09.778038 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.777990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-7pcnz" event={"ID":"d2714123-e557-41b7-b044-f97d09266d3c","Type":"ContainerStarted","Data":"df1c195d2fa079138b0bc829a5be78e7dbabdd0c2fbd4cd4a187333e5477ed3e"} Sep 17 03:18:09.778232 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.778068 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-7pcnz" Sep 17 03:18:09.796121 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.796067 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-7pcnz" podStartSLOduration=2.024733662 podStartE2EDuration="17.796044243s" totalImagesPullingTime="15.771310581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:18:09.794825131 +0000 UTC m=+328.658086232" watchObservedRunningTime="2026-09-17 03:18:09.796044243 +0000 UTC m=+328.659305344" Sep 17 03:18:09.800336 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.800308 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-7pcnz" Sep 17 03:18:09.833593 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.833550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksgks\" (UniqueName: \"kubernetes.io/projected/dd1258e2-368d-4f36-a27a-14cd597ae810-kube-api-access-ksgks\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.833779 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.833611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-serving-cert\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.833779 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.833706 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-oauth-config\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.833779 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.833738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-trusted-ca-bundle\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.833957 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.833804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-console-config\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.833957 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.833916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-service-ca\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.834055 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.833994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-oauth-serving-cert\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.935211 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.935119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-service-ca\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.935377 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.935209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-oauth-serving-cert\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.935377 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.935237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksgks\" (UniqueName: \"kubernetes.io/projected/dd1258e2-368d-4f36-a27a-14cd597ae810-kube-api-access-ksgks\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.935377 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.935272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-serving-cert\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.935377 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.935310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-oauth-config\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.935377 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.935340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-trusted-ca-bundle\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.935686 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.935501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-console-config\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.936675 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.936619 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-oauth-serving-cert\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.936979 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.936751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-service-ca\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.937998 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.937076 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-console-config\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.945098 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.944420 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-trusted-ca-bundle\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.945730 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.945663 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-oauth-config\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.945879 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.945722 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksgks\" (UniqueName: \"kubernetes.io/projected/dd1258e2-368d-4f36-a27a-14cd597ae810-kube-api-access-ksgks\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.947998 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.947968 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-serving-cert\") pod \"console-7b4868fb9b-vhphp\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:09.956737 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:09.956714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:10.246356 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:10.246286 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b4868fb9b-vhphp"] Sep 17 03:18:10.249490 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:18:10.249380 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1258e2_368d_4f36_a27a_14cd597ae810.slice/crio-52adebce01f8894e7032e40a7a1468d2fe0301875147ed3766489b33c698fb80 WatchSource:0}: Error finding container 52adebce01f8894e7032e40a7a1468d2fe0301875147ed3766489b33c698fb80: Status 404 returned error can't find the container with id 52adebce01f8894e7032e40a7a1468d2fe0301875147ed3766489b33c698fb80 Sep 17 03:18:10.785540 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:10.785492 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4868fb9b-vhphp" event={"ID":"dd1258e2-368d-4f36-a27a-14cd597ae810","Type":"ContainerStarted","Data":"52adebce01f8894e7032e40a7a1468d2fe0301875147ed3766489b33c698fb80"} Sep 17 03:18:14.808967 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:14.808928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4868fb9b-vhphp" event={"ID":"dd1258e2-368d-4f36-a27a-14cd597ae810","Type":"ContainerStarted","Data":"63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3"} Sep 17 03:18:14.830433 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:14.830377 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b4868fb9b-vhphp" podStartSLOduration=2.30183257 podStartE2EDuration="5.830360318s" totalImagesPullingTime="3.528527748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:18:14.828608621 +0000 UTC m=+333.691869733" watchObservedRunningTime="2026-09-17 03:18:14.830360318 +0000 UTC m=+333.693621467" Sep 17 03:18:19.957456 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:19.957421 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:19.957943 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:19.957479 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:19.962468 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:19.962446 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:20.836996 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:20.836965 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:18:30.871195 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:30.871159 2562 generic.go:356] "Generic (PLEG): container finished" podID="5c00e6a5-3798-4b66-9849-97d1a8387ee3" containerID="05a21fff1fc8a86e6b2e383d7c7a0702b025f31111b657b942aca277965bc1f3" exitCode=0 Sep 17 03:18:30.871721 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:30.871208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" event={"ID":"5c00e6a5-3798-4b66-9849-97d1a8387ee3","Type":"ContainerDied","Data":"05a21fff1fc8a86e6b2e383d7c7a0702b025f31111b657b942aca277965bc1f3"} Sep 17 03:18:30.871721 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:30.871579 2562 scope.go:117] "RemoveContainer" containerID="05a21fff1fc8a86e6b2e383d7c7a0702b025f31111b657b942aca277965bc1f3" Sep 17 03:18:31.876549 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:31.876507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fxqzs" event={"ID":"5c00e6a5-3798-4b66-9849-97d1a8387ee3","Type":"ContainerStarted","Data":"b98571abccebeb71ebbff8c939b6721f0df57b5395911a8632eb22cdddddfdd0"} Sep 17 03:18:55.434145 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:55.434100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:18:55.436357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:55.436335 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e543faf0-188b-4617-91a4-2c86fc7a2f29-metrics-certs\") pod \"network-metrics-daemon-fc2sm\" (UID: \"e543faf0-188b-4617-91a4-2c86fc7a2f29\") " pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:18:55.706904 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:55.706814 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltdl9\"" Sep 17 03:18:55.714312 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:55.714290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc2sm" Sep 17 03:18:55.984497 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:55.984468 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fc2sm"] Sep 17 03:18:56.975852 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:56.975819 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc2sm" event={"ID":"e543faf0-188b-4617-91a4-2c86fc7a2f29","Type":"ContainerStarted","Data":"cdf7a9a078e62dc1a7f4a749b72395042c17853846c4522ff4f87f18a20c643c"} Sep 17 03:18:56.976180 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:56.975894 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc2sm" event={"ID":"e543faf0-188b-4617-91a4-2c86fc7a2f29","Type":"ContainerStarted","Data":"49ab1a8e5a7b1fc7b61324ba6640ab7f6f9e3b4282589b676acfc783bd275be4"} Sep 17 03:18:57.981517 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:57.981478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc2sm" event={"ID":"e543faf0-188b-4617-91a4-2c86fc7a2f29","Type":"ContainerStarted","Data":"628112168ca4f7f26a8eca3b5634fba6a2fa919a5be9182d8f81f37b39b1d67a"} Sep 17 03:18:57.999230 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:18:57.999177 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fc2sm" podStartSLOduration=376.132068251 podStartE2EDuration="6m16.999161508s" totalImagesPullingTime="867.093257ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:18:57.999054456 +0000 UTC m=+376.862315555" watchObservedRunningTime="2026-09-17 03:18:57.999161508 +0000 UTC m=+376.862422606" Sep 17 03:19:03.343882 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.343815 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f6fc94b8-kbwl7"] Sep 17 03:19:03.347478 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.347457 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.360325 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.360300 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f6fc94b8-kbwl7"] Sep 17 03:19:03.393707 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.393680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-service-ca\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.393831 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.393717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-config\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.393831 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.393741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgrm5\" (UniqueName: \"kubernetes.io/projected/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-kube-api-access-qgrm5\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.393926 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.393829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-oauth-config\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.393926 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.393868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-serving-cert\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.393926 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.393889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-oauth-serving-cert\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.393926 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.393921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-trusted-ca-bundle\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.494507 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.494461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-oauth-serving-cert\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.494724 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.494524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-trusted-ca-bundle\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.494724 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.494549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-service-ca\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.494724 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.494577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-config\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.494724 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.494607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgrm5\" (UniqueName: \"kubernetes.io/projected/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-kube-api-access-qgrm5\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.494724 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.494698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-oauth-config\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.495001 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.494733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-serving-cert\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.495336 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.495307 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-oauth-serving-cert\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.495457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.495343 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-service-ca\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.495457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.495386 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-config\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.495558 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.495397 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-trusted-ca-bundle\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.497124 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.497106 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-serving-cert\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.497182 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.497151 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-oauth-config\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.503155 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.503138 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgrm5\" (UniqueName: \"kubernetes.io/projected/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-kube-api-access-qgrm5\") pod \"console-8f6fc94b8-kbwl7\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.657439 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.657343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:03.927747 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:03.927721 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f6fc94b8-kbwl7"] Sep 17 03:19:03.929744 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:19:03.929715 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e345657_8a9c_40bf_8e51_37f3eea9a0d9.slice/crio-520a4e944b573f24d3f4569c8f5584e1ebb9a4dc5ca3820f2f7e50b37bb4d02f WatchSource:0}: Error finding container 520a4e944b573f24d3f4569c8f5584e1ebb9a4dc5ca3820f2f7e50b37bb4d02f: Status 404 returned error can't find the container with id 520a4e944b573f24d3f4569c8f5584e1ebb9a4dc5ca3820f2f7e50b37bb4d02f Sep 17 03:19:04.006444 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:04.006250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f6fc94b8-kbwl7" event={"ID":"4e345657-8a9c-40bf-8e51-37f3eea9a0d9","Type":"ContainerStarted","Data":"89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986"} Sep 17 03:19:04.006444 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:04.006311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f6fc94b8-kbwl7" event={"ID":"4e345657-8a9c-40bf-8e51-37f3eea9a0d9","Type":"ContainerStarted","Data":"520a4e944b573f24d3f4569c8f5584e1ebb9a4dc5ca3820f2f7e50b37bb4d02f"} Sep 17 03:19:04.023465 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:04.023419 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f6fc94b8-kbwl7" podStartSLOduration=1.023403413 podStartE2EDuration="1.023403413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:19:04.022793258 +0000 UTC m=+382.886054370" watchObservedRunningTime="2026-09-17 03:19:04.023403413 +0000 UTC m=+382.886664512" Sep 17 03:19:13.657965 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:13.657926 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:13.658424 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:13.657987 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:13.662503 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:13.662476 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:14.048981 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:14.048951 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:19:14.096650 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:14.096606 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b4868fb9b-vhphp"] Sep 17 03:19:39.118434 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.118365 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b4868fb9b-vhphp" podUID="dd1258e2-368d-4f36-a27a-14cd597ae810" containerName="console" containerID="cri-o://63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3" gracePeriod=15 Sep 17 03:19:39.357677 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.357651 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:19:39.487613 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.487583 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-trusted-ca-bundle\") pod \"dd1258e2-368d-4f36-a27a-14cd597ae810\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " Sep 17 03:19:39.487781 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.487653 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-oauth-config\") pod \"dd1258e2-368d-4f36-a27a-14cd597ae810\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " Sep 17 03:19:39.487781 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.487679 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-oauth-serving-cert\") pod \"dd1258e2-368d-4f36-a27a-14cd597ae810\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " Sep 17 03:19:39.487781 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.487702 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksgks\" (UniqueName: \"kubernetes.io/projected/dd1258e2-368d-4f36-a27a-14cd597ae810-kube-api-access-ksgks\") pod \"dd1258e2-368d-4f36-a27a-14cd597ae810\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " Sep 17 03:19:39.487781 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.487729 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-serving-cert\") pod \"dd1258e2-368d-4f36-a27a-14cd597ae810\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " Sep 17 03:19:39.487781 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.487758 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-console-config\") pod \"dd1258e2-368d-4f36-a27a-14cd597ae810\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " Sep 17 03:19:39.488037 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.487789 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-service-ca\") pod \"dd1258e2-368d-4f36-a27a-14cd597ae810\" (UID: \"dd1258e2-368d-4f36-a27a-14cd597ae810\") " Sep 17 03:19:39.488328 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.488125 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dd1258e2-368d-4f36-a27a-14cd597ae810" (UID: "dd1258e2-368d-4f36-a27a-14cd597ae810"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:19:39.488328 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.488241 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-console-config" (OuterVolumeSpecName: "console-config") pod "dd1258e2-368d-4f36-a27a-14cd597ae810" (UID: "dd1258e2-368d-4f36-a27a-14cd597ae810"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:19:39.488328 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.488267 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dd1258e2-368d-4f36-a27a-14cd597ae810" (UID: "dd1258e2-368d-4f36-a27a-14cd597ae810"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:19:39.488328 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.488274 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-service-ca" (OuterVolumeSpecName: "service-ca") pod "dd1258e2-368d-4f36-a27a-14cd597ae810" (UID: "dd1258e2-368d-4f36-a27a-14cd597ae810"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:19:39.490027 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.490006 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dd1258e2-368d-4f36-a27a-14cd597ae810" (UID: "dd1258e2-368d-4f36-a27a-14cd597ae810"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:19:39.490117 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.490015 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd1258e2-368d-4f36-a27a-14cd597ae810-kube-api-access-ksgks" (OuterVolumeSpecName: "kube-api-access-ksgks") pod "dd1258e2-368d-4f36-a27a-14cd597ae810" (UID: "dd1258e2-368d-4f36-a27a-14cd597ae810"). InnerVolumeSpecName "kube-api-access-ksgks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:19:39.490117 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.490039 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dd1258e2-368d-4f36-a27a-14cd597ae810" (UID: "dd1258e2-368d-4f36-a27a-14cd597ae810"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:19:39.588608 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.588553 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksgks\" (UniqueName: \"kubernetes.io/projected/dd1258e2-368d-4f36-a27a-14cd597ae810-kube-api-access-ksgks\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:19:39.588608 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.588602 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-serving-cert\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:19:39.588608 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.588617 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-console-config\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:19:39.588871 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.588654 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-service-ca\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:19:39.588871 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.588668 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-trusted-ca-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:19:39.588871 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.588679 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1258e2-368d-4f36-a27a-14cd597ae810-console-oauth-config\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:19:39.588871 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:39.588691 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1258e2-368d-4f36-a27a-14cd597ae810-oauth-serving-cert\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:19:40.150827 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.150794 2562 generic.go:356] "Generic (PLEG): container finished" podID="dd1258e2-368d-4f36-a27a-14cd597ae810" containerID="63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3" exitCode=0 Sep 17 03:19:40.151258 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.150837 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4868fb9b-vhphp" Sep 17 03:19:40.151258 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.150858 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4868fb9b-vhphp" event={"ID":"dd1258e2-368d-4f36-a27a-14cd597ae810","Type":"ContainerDied","Data":"63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3"} Sep 17 03:19:40.151258 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.150897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4868fb9b-vhphp" event={"ID":"dd1258e2-368d-4f36-a27a-14cd597ae810","Type":"ContainerDied","Data":"52adebce01f8894e7032e40a7a1468d2fe0301875147ed3766489b33c698fb80"} Sep 17 03:19:40.151258 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.150916 2562 scope.go:117] "RemoveContainer" containerID="63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3" Sep 17 03:19:40.158961 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.158945 2562 scope.go:117] "RemoveContainer" containerID="63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3" Sep 17 03:19:40.159209 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:19:40.159191 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3\": container with ID starting with 63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3 not found: ID does not exist" containerID="63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3" Sep 17 03:19:40.159254 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.159216 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3"} err="failed to get container status \"63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3\": rpc error: code = NotFound desc = could not find container \"63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3\": container with ID starting with 63122aea2f704f12b5d4bfbfee35b8ca0b433551e18dbd9b40e5c05dc77d18e3 not found: ID does not exist" Sep 17 03:19:40.166688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.166656 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b4868fb9b-vhphp"] Sep 17 03:19:40.175467 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:40.175443 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b4868fb9b-vhphp"] Sep 17 03:19:41.608004 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:19:41.607966 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd1258e2-368d-4f36-a27a-14cd597ae810" path="/var/lib/kubelet/pods/dd1258e2-368d-4f36-a27a-14cd597ae810/volumes" Sep 17 03:20:19.549043 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:19.548999 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f6fc94b8-kbwl7"] Sep 17 03:20:44.569152 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.569104 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8f6fc94b8-kbwl7" podUID="4e345657-8a9c-40bf-8e51-37f3eea9a0d9" containerName="console" containerID="cri-o://89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986" gracePeriod=15 Sep 17 03:20:44.805505 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.805482 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:20:44.892465 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892390 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-config\") pod \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " Sep 17 03:20:44.892465 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892432 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-oauth-config\") pod \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " Sep 17 03:20:44.892678 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892476 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-serving-cert\") pod \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " Sep 17 03:20:44.892678 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892504 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-oauth-serving-cert\") pod \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " Sep 17 03:20:44.892678 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892527 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-trusted-ca-bundle\") pod \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " Sep 17 03:20:44.892678 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892652 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgrm5\" (UniqueName: \"kubernetes.io/projected/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-kube-api-access-qgrm5\") pod \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " Sep 17 03:20:44.892885 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-service-ca\") pod \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\" (UID: \"4e345657-8a9c-40bf-8e51-37f3eea9a0d9\") " Sep 17 03:20:44.892938 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892907 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-config" (OuterVolumeSpecName: "console-config") pod "4e345657-8a9c-40bf-8e51-37f3eea9a0d9" (UID: "4e345657-8a9c-40bf-8e51-37f3eea9a0d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:20:44.892995 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892953 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e345657-8a9c-40bf-8e51-37f3eea9a0d9" (UID: "4e345657-8a9c-40bf-8e51-37f3eea9a0d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:20:44.892995 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.892966 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e345657-8a9c-40bf-8e51-37f3eea9a0d9" (UID: "4e345657-8a9c-40bf-8e51-37f3eea9a0d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:20:44.893123 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.893096 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e345657-8a9c-40bf-8e51-37f3eea9a0d9" (UID: "4e345657-8a9c-40bf-8e51-37f3eea9a0d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:20:44.894694 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.894663 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-kube-api-access-qgrm5" (OuterVolumeSpecName: "kube-api-access-qgrm5") pod "4e345657-8a9c-40bf-8e51-37f3eea9a0d9" (UID: "4e345657-8a9c-40bf-8e51-37f3eea9a0d9"). InnerVolumeSpecName "kube-api-access-qgrm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:20:44.894807 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.894723 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e345657-8a9c-40bf-8e51-37f3eea9a0d9" (UID: "4e345657-8a9c-40bf-8e51-37f3eea9a0d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:20:44.894807 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.894791 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e345657-8a9c-40bf-8e51-37f3eea9a0d9" (UID: "4e345657-8a9c-40bf-8e51-37f3eea9a0d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:20:44.994288 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.994252 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-config\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:20:44.994288 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.994280 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-oauth-config\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:20:44.994288 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.994290 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-console-serving-cert\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:20:44.994288 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.994298 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-oauth-serving-cert\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:20:44.994540 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.994307 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-trusted-ca-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:20:44.994540 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.994316 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgrm5\" (UniqueName: \"kubernetes.io/projected/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-kube-api-access-qgrm5\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:20:44.994540 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:44.994325 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e345657-8a9c-40bf-8e51-37f3eea9a0d9-service-ca\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:20:45.393972 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.393938 2562 generic.go:356] "Generic (PLEG): container finished" podID="4e345657-8a9c-40bf-8e51-37f3eea9a0d9" containerID="89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986" exitCode=0 Sep 17 03:20:45.394131 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.393987 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f6fc94b8-kbwl7" Sep 17 03:20:45.394131 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.393995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f6fc94b8-kbwl7" event={"ID":"4e345657-8a9c-40bf-8e51-37f3eea9a0d9","Type":"ContainerDied","Data":"89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986"} Sep 17 03:20:45.394131 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.394033 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f6fc94b8-kbwl7" event={"ID":"4e345657-8a9c-40bf-8e51-37f3eea9a0d9","Type":"ContainerDied","Data":"520a4e944b573f24d3f4569c8f5584e1ebb9a4dc5ca3820f2f7e50b37bb4d02f"} Sep 17 03:20:45.394131 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.394053 2562 scope.go:117] "RemoveContainer" containerID="89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986" Sep 17 03:20:45.404276 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.404256 2562 scope.go:117] "RemoveContainer" containerID="89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986" Sep 17 03:20:45.404554 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:20:45.404532 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986\": container with ID starting with 89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986 not found: ID does not exist" containerID="89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986" Sep 17 03:20:45.404649 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.404574 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986"} err="failed to get container status \"89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986\": rpc error: code = NotFound desc = could not find container \"89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986\": container with ID starting with 89d36d9ee7647bcf7e493b9a132e3dd5b1274bcb2d3674552321db4d0f38e986 not found: ID does not exist" Sep 17 03:20:45.416870 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.416845 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f6fc94b8-kbwl7"] Sep 17 03:20:45.422555 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.422533 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f6fc94b8-kbwl7"] Sep 17 03:20:45.606465 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:20:45.606436 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e345657-8a9c-40bf-8e51-37f3eea9a0d9" path="/var/lib/kubelet/pods/4e345657-8a9c-40bf-8e51-37f3eea9a0d9/volumes" Sep 17 03:21:22.980011 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.979977 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp"] Sep 17 03:21:22.980428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.980281 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd1258e2-368d-4f36-a27a-14cd597ae810" containerName="console" Sep 17 03:21:22.980428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.980292 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd1258e2-368d-4f36-a27a-14cd597ae810" containerName="console" Sep 17 03:21:22.980428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.980303 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e345657-8a9c-40bf-8e51-37f3eea9a0d9" containerName="console" Sep 17 03:21:22.980428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.980308 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e345657-8a9c-40bf-8e51-37f3eea9a0d9" containerName="console" Sep 17 03:21:22.980428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.980353 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd1258e2-368d-4f36-a27a-14cd597ae810" containerName="console" Sep 17 03:21:22.980428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.980361 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e345657-8a9c-40bf-8e51-37f3eea9a0d9" containerName="console" Sep 17 03:21:22.983285 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.983268 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:22.986226 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.986209 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 17 03:21:22.987618 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.987589 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 17 03:21:22.987711 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.987620 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zqr76\"" Sep 17 03:21:22.992328 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:22.992303 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp"] Sep 17 03:21:23.067993 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.067954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.068164 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.068012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.068164 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.068084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdjbw\" (UniqueName: \"kubernetes.io/projected/636a23d8-8b0b-4355-9a0c-a94fcc922a40-kube-api-access-rdjbw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.168437 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.168399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdjbw\" (UniqueName: \"kubernetes.io/projected/636a23d8-8b0b-4355-9a0c-a94fcc922a40-kube-api-access-rdjbw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.168610 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.168456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.168610 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.168492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.168946 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.168924 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.168946 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.168937 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.177999 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.177969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdjbw\" (UniqueName: \"kubernetes.io/projected/636a23d8-8b0b-4355-9a0c-a94fcc922a40-kube-api-access-rdjbw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.291792 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.291705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:23.563479 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:23.563361 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp"] Sep 17 03:21:23.566385 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:21:23.566355 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636a23d8_8b0b_4355_9a0c_a94fcc922a40.slice/crio-2bcc82c176fa12ed25d55a3dd19cb76df296029bbdfde9f5093f8068342b2a2b WatchSource:0}: Error finding container 2bcc82c176fa12ed25d55a3dd19cb76df296029bbdfde9f5093f8068342b2a2b: Status 404 returned error can't find the container with id 2bcc82c176fa12ed25d55a3dd19cb76df296029bbdfde9f5093f8068342b2a2b Sep 17 03:21:24.544650 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:24.544599 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" event={"ID":"636a23d8-8b0b-4355-9a0c-a94fcc922a40","Type":"ContainerStarted","Data":"2bcc82c176fa12ed25d55a3dd19cb76df296029bbdfde9f5093f8068342b2a2b"} Sep 17 03:21:30.571495 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:30.571456 2562 generic.go:356] "Generic (PLEG): container finished" podID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerID="b463aec1dedad3e1f09254eb0beaf7a9ec68d20d860ada678e22b5d1b06e2d4b" exitCode=0 Sep 17 03:21:30.571850 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:30.571513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" event={"ID":"636a23d8-8b0b-4355-9a0c-a94fcc922a40","Type":"ContainerDied","Data":"b463aec1dedad3e1f09254eb0beaf7a9ec68d20d860ada678e22b5d1b06e2d4b"} Sep 17 03:21:33.585475 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:33.585436 2562 generic.go:356] "Generic (PLEG): container finished" podID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerID="3e3e6ff3463b79ae317f937cbda3b5afed66f53b23c1c41325eef1c3ef7815d6" exitCode=0 Sep 17 03:21:33.585991 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:33.585501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" event={"ID":"636a23d8-8b0b-4355-9a0c-a94fcc922a40","Type":"ContainerDied","Data":"3e3e6ff3463b79ae317f937cbda3b5afed66f53b23c1c41325eef1c3ef7815d6"} Sep 17 03:21:40.619000 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:40.618960 2562 generic.go:356] "Generic (PLEG): container finished" podID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerID="ccace8d9ae969f2326bad65236f31891d1b0e24639c7ca87487b9c9cbebdc0c6" exitCode=0 Sep 17 03:21:40.619418 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:40.619037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" event={"ID":"636a23d8-8b0b-4355-9a0c-a94fcc922a40","Type":"ContainerDied","Data":"ccace8d9ae969f2326bad65236f31891d1b0e24639c7ca87487b9c9cbebdc0c6"} Sep 17 03:21:41.744324 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.744299 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:41.814011 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.813929 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdjbw\" (UniqueName: \"kubernetes.io/projected/636a23d8-8b0b-4355-9a0c-a94fcc922a40-kube-api-access-rdjbw\") pod \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " Sep 17 03:21:41.814167 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.814061 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-util\") pod \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " Sep 17 03:21:41.814167 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.814094 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-bundle\") pod \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\" (UID: \"636a23d8-8b0b-4355-9a0c-a94fcc922a40\") " Sep 17 03:21:41.814736 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.814714 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-bundle" (OuterVolumeSpecName: "bundle") pod "636a23d8-8b0b-4355-9a0c-a94fcc922a40" (UID: "636a23d8-8b0b-4355-9a0c-a94fcc922a40"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:21:41.816044 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.816022 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636a23d8-8b0b-4355-9a0c-a94fcc922a40-kube-api-access-rdjbw" (OuterVolumeSpecName: "kube-api-access-rdjbw") pod "636a23d8-8b0b-4355-9a0c-a94fcc922a40" (UID: "636a23d8-8b0b-4355-9a0c-a94fcc922a40"). InnerVolumeSpecName "kube-api-access-rdjbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:21:41.820346 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.820319 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-util" (OuterVolumeSpecName: "util") pod "636a23d8-8b0b-4355-9a0c-a94fcc922a40" (UID: "636a23d8-8b0b-4355-9a0c-a94fcc922a40"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:21:41.914729 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.914699 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdjbw\" (UniqueName: \"kubernetes.io/projected/636a23d8-8b0b-4355-9a0c-a94fcc922a40-kube-api-access-rdjbw\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:21:41.914729 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.914723 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-util\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:21:41.914729 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:41.914732 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/636a23d8-8b0b-4355-9a0c-a94fcc922a40-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:21:42.628363 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:42.628327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" event={"ID":"636a23d8-8b0b-4355-9a0c-a94fcc922a40","Type":"ContainerDied","Data":"2bcc82c176fa12ed25d55a3dd19cb76df296029bbdfde9f5093f8068342b2a2b"} Sep 17 03:21:42.628528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:42.628374 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrtrp" Sep 17 03:21:42.628528 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:42.628380 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bcc82c176fa12ed25d55a3dd19cb76df296029bbdfde9f5093f8068342b2a2b" Sep 17 03:21:45.732594 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.732559 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc"] Sep 17 03:21:45.732977 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.732850 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerName="util" Sep 17 03:21:45.732977 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.732863 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerName="util" Sep 17 03:21:45.732977 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.732884 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerName="pull" Sep 17 03:21:45.732977 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.732889 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerName="pull" Sep 17 03:21:45.732977 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.732901 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerName="extract" Sep 17 03:21:45.732977 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.732907 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerName="extract" Sep 17 03:21:45.732977 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.732953 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="636a23d8-8b0b-4355-9a0c-a94fcc922a40" containerName="extract" Sep 17 03:21:45.736481 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.736464 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" Sep 17 03:21:45.739482 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.739463 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 17 03:21:45.739577 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.739496 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:21:45.739577 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.739505 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7zxg5\"" Sep 17 03:21:45.750406 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.750379 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc"] Sep 17 03:21:45.840203 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.840171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72bb4a6b-c1e8-460d-bca8-4be79134f963-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sbssc\" (UID: \"72bb4a6b-c1e8-460d-bca8-4be79134f963\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" Sep 17 03:21:45.840364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.840212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx4mt\" (UniqueName: \"kubernetes.io/projected/72bb4a6b-c1e8-460d-bca8-4be79134f963-kube-api-access-xx4mt\") pod \"cert-manager-operator-controller-manager-55c444bf86-sbssc\" (UID: \"72bb4a6b-c1e8-460d-bca8-4be79134f963\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" Sep 17 03:21:45.941044 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.941008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72bb4a6b-c1e8-460d-bca8-4be79134f963-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sbssc\" (UID: \"72bb4a6b-c1e8-460d-bca8-4be79134f963\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" Sep 17 03:21:45.941044 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.941046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx4mt\" (UniqueName: \"kubernetes.io/projected/72bb4a6b-c1e8-460d-bca8-4be79134f963-kube-api-access-xx4mt\") pod \"cert-manager-operator-controller-manager-55c444bf86-sbssc\" (UID: \"72bb4a6b-c1e8-460d-bca8-4be79134f963\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" Sep 17 03:21:45.941399 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.941379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72bb4a6b-c1e8-460d-bca8-4be79134f963-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sbssc\" (UID: \"72bb4a6b-c1e8-460d-bca8-4be79134f963\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" Sep 17 03:21:45.949754 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:45.949726 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx4mt\" (UniqueName: \"kubernetes.io/projected/72bb4a6b-c1e8-460d-bca8-4be79134f963-kube-api-access-xx4mt\") pod \"cert-manager-operator-controller-manager-55c444bf86-sbssc\" (UID: \"72bb4a6b-c1e8-460d-bca8-4be79134f963\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" Sep 17 03:21:46.044983 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:46.044913 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" Sep 17 03:21:46.322030 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:46.321941 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc"] Sep 17 03:21:46.326867 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:21:46.326837 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bb4a6b_c1e8_460d_bca8_4be79134f963.slice/crio-9625de0aee7af270a069c8629f5affa5c26881cf6d94c0c03a6481a2966bac91 WatchSource:0}: Error finding container 9625de0aee7af270a069c8629f5affa5c26881cf6d94c0c03a6481a2966bac91: Status 404 returned error can't find the container with id 9625de0aee7af270a069c8629f5affa5c26881cf6d94c0c03a6481a2966bac91 Sep 17 03:21:46.644497 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:46.644413 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" event={"ID":"72bb4a6b-c1e8-460d-bca8-4be79134f963","Type":"ContainerStarted","Data":"9625de0aee7af270a069c8629f5affa5c26881cf6d94c0c03a6481a2966bac91"} Sep 17 03:21:48.654871 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:48.654827 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" event={"ID":"72bb4a6b-c1e8-460d-bca8-4be79134f963","Type":"ContainerStarted","Data":"0ac39b455d044f831ca96a0363dd736c3c247ebc02c13908fb8199010ba1680f"} Sep 17 03:21:48.678877 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:48.678809 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sbssc" podStartSLOduration=2.037811995 podStartE2EDuration="3.678787412s" totalImagesPullingTime="1.640975417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:21:48.678095298 +0000 UTC m=+547.541356399" watchObservedRunningTime="2026-09-17 03:21:48.678787412 +0000 UTC m=+547.542048514" Sep 17 03:21:49.841126 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:49.841088 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7lsp4"] Sep 17 03:21:49.844395 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:49.844376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:49.847075 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:49.847052 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 03:21:49.848446 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:49.848418 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zn4lm\"" Sep 17 03:21:49.848529 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:49.848513 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 03:21:49.853313 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:49.853291 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7lsp4"] Sep 17 03:21:49.971284 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:49.971254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtfqr\" (UniqueName: \"kubernetes.io/projected/3db00d0b-b301-4870-b206-1c541504632b-kube-api-access-vtfqr\") pod \"cert-manager-webhook-6486ffd997-7lsp4\" (UID: \"3db00d0b-b301-4870-b206-1c541504632b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:49.971449 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:49.971350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3db00d0b-b301-4870-b206-1c541504632b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7lsp4\" (UID: \"3db00d0b-b301-4870-b206-1c541504632b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:50.072465 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.072424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3db00d0b-b301-4870-b206-1c541504632b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7lsp4\" (UID: \"3db00d0b-b301-4870-b206-1c541504632b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:50.072657 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.072480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtfqr\" (UniqueName: \"kubernetes.io/projected/3db00d0b-b301-4870-b206-1c541504632b-kube-api-access-vtfqr\") pod \"cert-manager-webhook-6486ffd997-7lsp4\" (UID: \"3db00d0b-b301-4870-b206-1c541504632b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:50.081108 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.081083 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3db00d0b-b301-4870-b206-1c541504632b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7lsp4\" (UID: \"3db00d0b-b301-4870-b206-1c541504632b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:50.081332 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.081313 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtfqr\" (UniqueName: \"kubernetes.io/projected/3db00d0b-b301-4870-b206-1c541504632b-kube-api-access-vtfqr\") pod \"cert-manager-webhook-6486ffd997-7lsp4\" (UID: \"3db00d0b-b301-4870-b206-1c541504632b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:50.153360 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.153265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:50.200174 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.200144 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8"] Sep 17 03:21:50.205676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.204501 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.207600 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.207427 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zqr76\"" Sep 17 03:21:50.207600 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.207458 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 17 03:21:50.207909 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.207624 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 17 03:21:50.218380 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.218183 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8"] Sep 17 03:21:50.274556 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.274517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.274556 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.274566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.274786 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.274649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd46x\" (UniqueName: \"kubernetes.io/projected/a14fc17a-1b91-4298-98a3-261bdcf5f311-kube-api-access-kd46x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.375514 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.375477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd46x\" (UniqueName: \"kubernetes.io/projected/a14fc17a-1b91-4298-98a3-261bdcf5f311-kube-api-access-kd46x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.375697 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.375564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.375697 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.375597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.375934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.375917 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.375993 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.375974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.383571 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.383544 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd46x\" (UniqueName: \"kubernetes.io/projected/a14fc17a-1b91-4298-98a3-261bdcf5f311-kube-api-access-kd46x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.424219 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.422452 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7lsp4"] Sep 17 03:21:50.519258 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.519229 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:50.664833 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.664799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" event={"ID":"3db00d0b-b301-4870-b206-1c541504632b","Type":"ContainerStarted","Data":"8eb028fb47f41d792bce3b63ca41889304c8615f99c9eb149ce453bc9fce16d3"} Sep 17 03:21:50.791894 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:50.791852 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8"] Sep 17 03:21:50.795278 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:21:50.795251 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14fc17a_1b91_4298_98a3_261bdcf5f311.slice/crio-91147716adfac561a4b60dc29b2a0ec0eba41d33192c95b14fcecc557ba8d6ad WatchSource:0}: Error finding container 91147716adfac561a4b60dc29b2a0ec0eba41d33192c95b14fcecc557ba8d6ad: Status 404 returned error can't find the container with id 91147716adfac561a4b60dc29b2a0ec0eba41d33192c95b14fcecc557ba8d6ad Sep 17 03:21:51.672004 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:51.671960 2562 generic.go:356] "Generic (PLEG): container finished" podID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerID="319f32b35f89d725d4b72e6eac581752ac83f20b2df8b7bcc32b659b84ec9f8c" exitCode=0 Sep 17 03:21:51.672463 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:51.672050 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" event={"ID":"a14fc17a-1b91-4298-98a3-261bdcf5f311","Type":"ContainerDied","Data":"319f32b35f89d725d4b72e6eac581752ac83f20b2df8b7bcc32b659b84ec9f8c"} Sep 17 03:21:51.672463 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:51.672106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" event={"ID":"a14fc17a-1b91-4298-98a3-261bdcf5f311","Type":"ContainerStarted","Data":"91147716adfac561a4b60dc29b2a0ec0eba41d33192c95b14fcecc557ba8d6ad"} Sep 17 03:21:54.687979 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:54.687880 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" event={"ID":"3db00d0b-b301-4870-b206-1c541504632b","Type":"ContainerStarted","Data":"e7ad349cb91e8286a82431ab8020a473120a3be9b0014e79a673ebcd3a958b12"} Sep 17 03:21:54.688385 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:54.688036 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:21:54.689758 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:54.689732 2562 generic.go:356] "Generic (PLEG): container finished" podID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerID="577e441eaf42af3514cafcddc426edb321ae29430c4dea6c0446f0ee7d46aa41" exitCode=0 Sep 17 03:21:54.689875 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:54.689788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" event={"ID":"a14fc17a-1b91-4298-98a3-261bdcf5f311","Type":"ContainerDied","Data":"577e441eaf42af3514cafcddc426edb321ae29430c4dea6c0446f0ee7d46aa41"} Sep 17 03:21:54.703689 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:54.703648 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" podStartSLOduration=1.707709952 podStartE2EDuration="5.703614185s" totalImagesPullingTime="3.995904233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:21:54.702973461 +0000 UTC m=+553.566234560" watchObservedRunningTime="2026-09-17 03:21:54.703614185 +0000 UTC m=+553.566875283" Sep 17 03:21:55.695680 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:55.695624 2562 generic.go:356] "Generic (PLEG): container finished" podID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerID="2cd19c67308cf5337013c4e8a478cd4298d52a38272afba0eee7f9834c4cb296" exitCode=0 Sep 17 03:21:55.695680 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:55.695656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" event={"ID":"a14fc17a-1b91-4298-98a3-261bdcf5f311","Type":"ContainerDied","Data":"2cd19c67308cf5337013c4e8a478cd4298d52a38272afba0eee7f9834c4cb296"} Sep 17 03:21:56.823917 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:56.823889 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:56.935517 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:56.935478 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd46x\" (UniqueName: \"kubernetes.io/projected/a14fc17a-1b91-4298-98a3-261bdcf5f311-kube-api-access-kd46x\") pod \"a14fc17a-1b91-4298-98a3-261bdcf5f311\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " Sep 17 03:21:56.935517 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:56.935523 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-util\") pod \"a14fc17a-1b91-4298-98a3-261bdcf5f311\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " Sep 17 03:21:56.935737 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:56.935553 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-bundle\") pod \"a14fc17a-1b91-4298-98a3-261bdcf5f311\" (UID: \"a14fc17a-1b91-4298-98a3-261bdcf5f311\") " Sep 17 03:21:56.936000 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:56.935971 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-bundle" (OuterVolumeSpecName: "bundle") pod "a14fc17a-1b91-4298-98a3-261bdcf5f311" (UID: "a14fc17a-1b91-4298-98a3-261bdcf5f311"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:21:56.937558 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:56.937532 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a14fc17a-1b91-4298-98a3-261bdcf5f311-kube-api-access-kd46x" (OuterVolumeSpecName: "kube-api-access-kd46x") pod "a14fc17a-1b91-4298-98a3-261bdcf5f311" (UID: "a14fc17a-1b91-4298-98a3-261bdcf5f311"). InnerVolumeSpecName "kube-api-access-kd46x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:21:56.939712 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:56.939676 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-util" (OuterVolumeSpecName: "util") pod "a14fc17a-1b91-4298-98a3-261bdcf5f311" (UID: "a14fc17a-1b91-4298-98a3-261bdcf5f311"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:21:57.036763 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.036727 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd46x\" (UniqueName: \"kubernetes.io/projected/a14fc17a-1b91-4298-98a3-261bdcf5f311-kube-api-access-kd46x\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:21:57.036763 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.036757 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-util\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:21:57.036763 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.036770 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14fc17a-1b91-4298-98a3-261bdcf5f311-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:21:57.037025 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.037002 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wsl82"] Sep 17 03:21:57.037302 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.037288 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerName="util" Sep 17 03:21:57.037333 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.037305 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerName="util" Sep 17 03:21:57.037333 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.037322 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerName="extract" Sep 17 03:21:57.037333 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.037327 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerName="extract" Sep 17 03:21:57.037417 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.037341 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerName="pull" Sep 17 03:21:57.037417 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.037347 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerName="pull" Sep 17 03:21:57.037417 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.037398 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a14fc17a-1b91-4298-98a3-261bdcf5f311" containerName="extract" Sep 17 03:21:57.042708 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.042682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" Sep 17 03:21:57.045428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.045407 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qnbgb\"" Sep 17 03:21:57.050005 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.049987 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wsl82"] Sep 17 03:21:57.137594 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.137558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjzbs\" (UniqueName: \"kubernetes.io/projected/e7aade5a-3ee7-44a3-8168-00c334b8c8b5-kube-api-access-bjzbs\") pod \"cert-manager-cainjector-559cdd8c87-wsl82\" (UID: \"e7aade5a-3ee7-44a3-8168-00c334b8c8b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" Sep 17 03:21:57.137594 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.137595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7aade5a-3ee7-44a3-8168-00c334b8c8b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wsl82\" (UID: \"e7aade5a-3ee7-44a3-8168-00c334b8c8b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" Sep 17 03:21:57.238646 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.238597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjzbs\" (UniqueName: \"kubernetes.io/projected/e7aade5a-3ee7-44a3-8168-00c334b8c8b5-kube-api-access-bjzbs\") pod \"cert-manager-cainjector-559cdd8c87-wsl82\" (UID: \"e7aade5a-3ee7-44a3-8168-00c334b8c8b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" Sep 17 03:21:57.238825 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.238668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7aade5a-3ee7-44a3-8168-00c334b8c8b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wsl82\" (UID: \"e7aade5a-3ee7-44a3-8168-00c334b8c8b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" Sep 17 03:21:57.247158 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.247125 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7aade5a-3ee7-44a3-8168-00c334b8c8b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wsl82\" (UID: \"e7aade5a-3ee7-44a3-8168-00c334b8c8b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" Sep 17 03:21:57.247278 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.247247 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjzbs\" (UniqueName: \"kubernetes.io/projected/e7aade5a-3ee7-44a3-8168-00c334b8c8b5-kube-api-access-bjzbs\") pod \"cert-manager-cainjector-559cdd8c87-wsl82\" (UID: \"e7aade5a-3ee7-44a3-8168-00c334b8c8b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" Sep 17 03:21:57.352980 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.352903 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" Sep 17 03:21:57.623596 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.623564 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wsl82"] Sep 17 03:21:57.626338 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:21:57.626313 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7aade5a_3ee7_44a3_8168_00c334b8c8b5.slice/crio-79789fb4ef093c26b5e3bfdb67e35cb1d300dbcc5da2308d6c6a941d02da9a99 WatchSource:0}: Error finding container 79789fb4ef093c26b5e3bfdb67e35cb1d300dbcc5da2308d6c6a941d02da9a99: Status 404 returned error can't find the container with id 79789fb4ef093c26b5e3bfdb67e35cb1d300dbcc5da2308d6c6a941d02da9a99 Sep 17 03:21:57.707436 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.707411 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" Sep 17 03:21:57.707436 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.707424 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6vhd8" event={"ID":"a14fc17a-1b91-4298-98a3-261bdcf5f311","Type":"ContainerDied","Data":"91147716adfac561a4b60dc29b2a0ec0eba41d33192c95b14fcecc557ba8d6ad"} Sep 17 03:21:57.707613 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.707476 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91147716adfac561a4b60dc29b2a0ec0eba41d33192c95b14fcecc557ba8d6ad" Sep 17 03:21:57.709847 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.709824 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" event={"ID":"e7aade5a-3ee7-44a3-8168-00c334b8c8b5","Type":"ContainerStarted","Data":"57b6a0334e4e7d6beb1f8dd52c8b1ddce05c214f5c48e7655e0a04f7dfab06cb"} Sep 17 03:21:57.709971 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.709859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" event={"ID":"e7aade5a-3ee7-44a3-8168-00c334b8c8b5","Type":"ContainerStarted","Data":"79789fb4ef093c26b5e3bfdb67e35cb1d300dbcc5da2308d6c6a941d02da9a99"} Sep 17 03:21:57.725259 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:21:57.725209 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wsl82" podStartSLOduration=0.725195499 podStartE2EDuration="725.195499ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:21:57.724362386 +0000 UTC m=+556.587623509" watchObservedRunningTime="2026-09-17 03:21:57.725195499 +0000 UTC m=+556.588456599" Sep 17 03:22:00.698458 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:00.698428 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7lsp4" Sep 17 03:22:07.229539 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.229503 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp"] Sep 17 03:22:07.248028 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.247998 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp"] Sep 17 03:22:07.248163 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.248137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" Sep 17 03:22:07.251180 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.251134 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:22:07.256753 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.253002 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kpksf\"" Sep 17 03:22:07.256753 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.253054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 03:22:07.421266 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.421231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77e80a48-7c17-4fed-b8c5-a9b14c820305-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lxvzp\" (UID: \"77e80a48-7c17-4fed-b8c5-a9b14c820305\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" Sep 17 03:22:07.421266 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.421275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgbvd\" (UniqueName: \"kubernetes.io/projected/77e80a48-7c17-4fed-b8c5-a9b14c820305-kube-api-access-zgbvd\") pod \"openshift-lws-operator-fd8ccff4c-lxvzp\" (UID: \"77e80a48-7c17-4fed-b8c5-a9b14c820305\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" Sep 17 03:22:07.521808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.521714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77e80a48-7c17-4fed-b8c5-a9b14c820305-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lxvzp\" (UID: \"77e80a48-7c17-4fed-b8c5-a9b14c820305\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" Sep 17 03:22:07.521808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.521764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgbvd\" (UniqueName: \"kubernetes.io/projected/77e80a48-7c17-4fed-b8c5-a9b14c820305-kube-api-access-zgbvd\") pod \"openshift-lws-operator-fd8ccff4c-lxvzp\" (UID: \"77e80a48-7c17-4fed-b8c5-a9b14c820305\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" Sep 17 03:22:07.522122 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.522098 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77e80a48-7c17-4fed-b8c5-a9b14c820305-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lxvzp\" (UID: \"77e80a48-7c17-4fed-b8c5-a9b14c820305\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" Sep 17 03:22:07.529988 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.529963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgbvd\" (UniqueName: \"kubernetes.io/projected/77e80a48-7c17-4fed-b8c5-a9b14c820305-kube-api-access-zgbvd\") pod \"openshift-lws-operator-fd8ccff4c-lxvzp\" (UID: \"77e80a48-7c17-4fed-b8c5-a9b14c820305\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" Sep 17 03:22:07.560905 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.560880 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" Sep 17 03:22:07.853055 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:07.852980 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp"] Sep 17 03:22:07.855225 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:22:07.855195 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77e80a48_7c17_4fed_b8c5_a9b14c820305.slice/crio-f084ca1af2da28f229c707d16e7c5dd5fae4825170f2c9d44f30ab1b0176c44e WatchSource:0}: Error finding container f084ca1af2da28f229c707d16e7c5dd5fae4825170f2c9d44f30ab1b0176c44e: Status 404 returned error can't find the container with id f084ca1af2da28f229c707d16e7c5dd5fae4825170f2c9d44f30ab1b0176c44e Sep 17 03:22:08.757387 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:08.757353 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" event={"ID":"77e80a48-7c17-4fed-b8c5-a9b14c820305","Type":"ContainerStarted","Data":"f084ca1af2da28f229c707d16e7c5dd5fae4825170f2c9d44f30ab1b0176c44e"} Sep 17 03:22:10.768100 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:10.768061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" event={"ID":"77e80a48-7c17-4fed-b8c5-a9b14c820305","Type":"ContainerStarted","Data":"415b51016feea921c45d63be446b3a4c1d4fb9321ed8918e52d6547bf9d4ca56"} Sep 17 03:22:10.786459 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:10.786399 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lxvzp" podStartSLOduration=1.052831072 podStartE2EDuration="3.786383323s" totalImagesPullingTime="2.733552251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:10.784879495 +0000 UTC m=+569.648140598" watchObservedRunningTime="2026-09-17 03:22:10.786383323 +0000 UTC m=+569.649644422" Sep 17 03:22:12.977877 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:12.977837 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4"] Sep 17 03:22:12.981489 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:12.981466 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:12.984519 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:12.984496 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 17 03:22:12.985676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:12.985658 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zqr76\"" Sep 17 03:22:12.985767 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:12.985667 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 17 03:22:12.989957 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:12.989938 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4"] Sep 17 03:22:13.067325 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.067284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.067507 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.067334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.067507 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.067360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqlq4\" (UniqueName: \"kubernetes.io/projected/73b0d24a-0ef9-4987-b0d1-37373bacdf70-kube-api-access-sqlq4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.168209 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.168176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.168398 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.168217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlq4\" (UniqueName: \"kubernetes.io/projected/73b0d24a-0ef9-4987-b0d1-37373bacdf70-kube-api-access-sqlq4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.168398 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.168279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.168615 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.168587 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.168615 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.168605 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.177211 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.177186 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqlq4\" (UniqueName: \"kubernetes.io/projected/73b0d24a-0ef9-4987-b0d1-37373bacdf70-kube-api-access-sqlq4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.291986 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.291904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:13.561659 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.561618 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4"] Sep 17 03:22:13.563726 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:22:13.563696 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b0d24a_0ef9_4987_b0d1_37373bacdf70.slice/crio-61a81ca8729bdfb1e137e00c8da6a11d6714fc0337e15a8b74a4c7246364c4f2 WatchSource:0}: Error finding container 61a81ca8729bdfb1e137e00c8da6a11d6714fc0337e15a8b74a4c7246364c4f2: Status 404 returned error can't find the container with id 61a81ca8729bdfb1e137e00c8da6a11d6714fc0337e15a8b74a4c7246364c4f2 Sep 17 03:22:13.783540 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.783503 2562 generic.go:356] "Generic (PLEG): container finished" podID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerID="cd1c0b1e981d580f3e3826fcf54cfc6ae7018e64444a33f258cf568d73df0d62" exitCode=0 Sep 17 03:22:13.783725 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.783549 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" event={"ID":"73b0d24a-0ef9-4987-b0d1-37373bacdf70","Type":"ContainerDied","Data":"cd1c0b1e981d580f3e3826fcf54cfc6ae7018e64444a33f258cf568d73df0d62"} Sep 17 03:22:13.783725 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:13.783605 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" event={"ID":"73b0d24a-0ef9-4987-b0d1-37373bacdf70","Type":"ContainerStarted","Data":"61a81ca8729bdfb1e137e00c8da6a11d6714fc0337e15a8b74a4c7246364c4f2"} Sep 17 03:22:14.789688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:14.789654 2562 generic.go:356] "Generic (PLEG): container finished" podID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerID="fbb8ffe1ae60a2b8b978cae69a5a4bbc569f8752335c8829e83615aaae99e3aa" exitCode=0 Sep 17 03:22:14.790053 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:14.789708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" event={"ID":"73b0d24a-0ef9-4987-b0d1-37373bacdf70","Type":"ContainerDied","Data":"fbb8ffe1ae60a2b8b978cae69a5a4bbc569f8752335c8829e83615aaae99e3aa"} Sep 17 03:22:15.797160 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:15.797122 2562 generic.go:356] "Generic (PLEG): container finished" podID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerID="dba67333c29b388aa0bdfa0abb7a327ac83749c43c50425e7cd4e3d3ec80aebf" exitCode=0 Sep 17 03:22:15.797582 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:15.797198 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" event={"ID":"73b0d24a-0ef9-4987-b0d1-37373bacdf70","Type":"ContainerDied","Data":"dba67333c29b388aa0bdfa0abb7a327ac83749c43c50425e7cd4e3d3ec80aebf"} Sep 17 03:22:16.938462 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:16.938436 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:17.100177 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.100090 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqlq4\" (UniqueName: \"kubernetes.io/projected/73b0d24a-0ef9-4987-b0d1-37373bacdf70-kube-api-access-sqlq4\") pod \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " Sep 17 03:22:17.100177 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.100141 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-util\") pod \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " Sep 17 03:22:17.100362 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.100191 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-bundle\") pod \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\" (UID: \"73b0d24a-0ef9-4987-b0d1-37373bacdf70\") " Sep 17 03:22:17.100951 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.100920 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-bundle" (OuterVolumeSpecName: "bundle") pod "73b0d24a-0ef9-4987-b0d1-37373bacdf70" (UID: "73b0d24a-0ef9-4987-b0d1-37373bacdf70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:22:17.102393 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.102372 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73b0d24a-0ef9-4987-b0d1-37373bacdf70-kube-api-access-sqlq4" (OuterVolumeSpecName: "kube-api-access-sqlq4") pod "73b0d24a-0ef9-4987-b0d1-37373bacdf70" (UID: "73b0d24a-0ef9-4987-b0d1-37373bacdf70"). InnerVolumeSpecName "kube-api-access-sqlq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:22:17.108535 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.108510 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-util" (OuterVolumeSpecName: "util") pod "73b0d24a-0ef9-4987-b0d1-37373bacdf70" (UID: "73b0d24a-0ef9-4987-b0d1-37373bacdf70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:22:17.200808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.200771 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqlq4\" (UniqueName: \"kubernetes.io/projected/73b0d24a-0ef9-4987-b0d1-37373bacdf70-kube-api-access-sqlq4\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:22:17.200808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.200802 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-util\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:22:17.200808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.200813 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73b0d24a-0ef9-4987-b0d1-37373bacdf70-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:22:17.809079 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.809047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" event={"ID":"73b0d24a-0ef9-4987-b0d1-37373bacdf70","Type":"ContainerDied","Data":"61a81ca8729bdfb1e137e00c8da6a11d6714fc0337e15a8b74a4c7246364c4f2"} Sep 17 03:22:17.809079 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.809067 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrvw4" Sep 17 03:22:17.809317 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:17.809093 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61a81ca8729bdfb1e137e00c8da6a11d6714fc0337e15a8b74a4c7246364c4f2" Sep 17 03:22:26.993811 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.993774 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg"] Sep 17 03:22:26.994202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.994096 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerName="extract" Sep 17 03:22:26.994202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.994108 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerName="extract" Sep 17 03:22:26.994202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.994121 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerName="pull" Sep 17 03:22:26.994202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.994127 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerName="pull" Sep 17 03:22:26.994202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.994139 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerName="util" Sep 17 03:22:26.994202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.994145 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerName="util" Sep 17 03:22:26.994202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.994198 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="73b0d24a-0ef9-4987-b0d1-37373bacdf70" containerName="extract" Sep 17 03:22:26.998337 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:26.998315 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.001090 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.001061 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 17 03:22:27.001216 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.001064 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zqr76\"" Sep 17 03:22:27.002321 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.002305 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 17 03:22:27.006850 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.006820 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg"] Sep 17 03:22:27.073094 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.073060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.073238 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.073114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.073238 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.073135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmvd2\" (UniqueName: \"kubernetes.io/projected/77dd5de0-7483-4059-987f-2a73436706d4-kube-api-access-pmvd2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.173497 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.173465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.173658 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.173515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.173658 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.173624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmvd2\" (UniqueName: \"kubernetes.io/projected/77dd5de0-7483-4059-987f-2a73436706d4-kube-api-access-pmvd2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.173857 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.173840 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.173924 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.173871 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.182157 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.182134 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmvd2\" (UniqueName: \"kubernetes.io/projected/77dd5de0-7483-4059-987f-2a73436706d4-kube-api-access-pmvd2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.307962 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.307855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:27.594571 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.594463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg"] Sep 17 03:22:27.597423 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:22:27.597391 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77dd5de0_7483_4059_987f_2a73436706d4.slice/crio-5d131e97e6d22c83eb261a09174d7ffe58429bcdf5496bf37d078bafac1d665b WatchSource:0}: Error finding container 5d131e97e6d22c83eb261a09174d7ffe58429bcdf5496bf37d078bafac1d665b: Status 404 returned error can't find the container with id 5d131e97e6d22c83eb261a09174d7ffe58429bcdf5496bf37d078bafac1d665b Sep 17 03:22:27.854705 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.854605 2562 generic.go:356] "Generic (PLEG): container finished" podID="77dd5de0-7483-4059-987f-2a73436706d4" containerID="a3259dd00374a7735190e3e9851a9d5ca59a324f7f43cd5da93963716a2f068c" exitCode=0 Sep 17 03:22:27.854705 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.854664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" event={"ID":"77dd5de0-7483-4059-987f-2a73436706d4","Type":"ContainerDied","Data":"a3259dd00374a7735190e3e9851a9d5ca59a324f7f43cd5da93963716a2f068c"} Sep 17 03:22:27.854915 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:27.854729 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" event={"ID":"77dd5de0-7483-4059-987f-2a73436706d4","Type":"ContainerStarted","Data":"5d131e97e6d22c83eb261a09174d7ffe58429bcdf5496bf37d078bafac1d665b"} Sep 17 03:22:28.601782 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.601756 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746"] Sep 17 03:22:28.605130 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.605112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.607699 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.607675 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 17 03:22:28.607923 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.607903 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 03:22:28.608029 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.607971 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkzz5\"" Sep 17 03:22:28.608135 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.608120 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 17 03:22:28.608206 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.608171 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 03:22:28.626333 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.626308 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746"] Sep 17 03:22:28.683543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.683514 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26ca10ff-7525-4c39-af18-af12f642c4db-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.683697 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.683556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26ca10ff-7525-4c39-af18-af12f642c4db-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.683697 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.683624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26ca10ff-7525-4c39-af18-af12f642c4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.683697 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.683694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26ca10ff-7525-4c39-af18-af12f642c4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.683835 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.683740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk6mz\" (UniqueName: \"kubernetes.io/projected/26ca10ff-7525-4c39-af18-af12f642c4db-kube-api-access-hk6mz\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.784876 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.784780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26ca10ff-7525-4c39-af18-af12f642c4db-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.784876 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.784821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26ca10ff-7525-4c39-af18-af12f642c4db-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.784876 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.784840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26ca10ff-7525-4c39-af18-af12f642c4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.784876 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.784875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26ca10ff-7525-4c39-af18-af12f642c4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.785191 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.784893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk6mz\" (UniqueName: \"kubernetes.io/projected/26ca10ff-7525-4c39-af18-af12f642c4db-kube-api-access-hk6mz\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.785276 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.785248 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26ca10ff-7525-4c39-af18-af12f642c4db-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.787325 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.787289 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26ca10ff-7525-4c39-af18-af12f642c4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.787600 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.787575 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26ca10ff-7525-4c39-af18-af12f642c4db-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.787795 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.787777 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26ca10ff-7525-4c39-af18-af12f642c4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.792900 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.792880 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk6mz\" (UniqueName: \"kubernetes.io/projected/26ca10ff-7525-4c39-af18-af12f642c4db-kube-api-access-hk6mz\") pod \"opendatahub-operator-controller-manager-6b9b769b77-m8746\" (UID: \"26ca10ff-7525-4c39-af18-af12f642c4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:28.860711 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.860681 2562 generic.go:356] "Generic (PLEG): container finished" podID="77dd5de0-7483-4059-987f-2a73436706d4" containerID="59ba9b7be66b12b6686fddf326b83c18f6750eca358818dc4341465080afac3a" exitCode=0 Sep 17 03:22:28.860854 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.860768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" event={"ID":"77dd5de0-7483-4059-987f-2a73436706d4","Type":"ContainerDied","Data":"59ba9b7be66b12b6686fddf326b83c18f6750eca358818dc4341465080afac3a"} Sep 17 03:22:28.915572 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:28.915546 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:29.202454 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:29.202375 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746"] Sep 17 03:22:29.207500 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:22:29.207471 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ca10ff_7525_4c39_af18_af12f642c4db.slice/crio-ca0818d60202b9d9a35347f9adcd9dd5e2e91b6b48ac14b190ce232906710beb WatchSource:0}: Error finding container ca0818d60202b9d9a35347f9adcd9dd5e2e91b6b48ac14b190ce232906710beb: Status 404 returned error can't find the container with id ca0818d60202b9d9a35347f9adcd9dd5e2e91b6b48ac14b190ce232906710beb Sep 17 03:22:29.868339 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:29.868301 2562 generic.go:356] "Generic (PLEG): container finished" podID="77dd5de0-7483-4059-987f-2a73436706d4" containerID="5dd6d3cf16d3940146d115dbc26d53a12ade2db05b3d3a2e2c225031ced0b161" exitCode=0 Sep 17 03:22:29.868729 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:29.868377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" event={"ID":"77dd5de0-7483-4059-987f-2a73436706d4","Type":"ContainerDied","Data":"5dd6d3cf16d3940146d115dbc26d53a12ade2db05b3d3a2e2c225031ced0b161"} Sep 17 03:22:29.869617 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:29.869593 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" event={"ID":"26ca10ff-7525-4c39-af18-af12f642c4db","Type":"ContainerStarted","Data":"ca0818d60202b9d9a35347f9adcd9dd5e2e91b6b48ac14b190ce232906710beb"} Sep 17 03:22:32.380142 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.380117 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:32.410060 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.410032 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmvd2\" (UniqueName: \"kubernetes.io/projected/77dd5de0-7483-4059-987f-2a73436706d4-kube-api-access-pmvd2\") pod \"77dd5de0-7483-4059-987f-2a73436706d4\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " Sep 17 03:22:32.410217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.410100 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-util\") pod \"77dd5de0-7483-4059-987f-2a73436706d4\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " Sep 17 03:22:32.410217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.410145 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-bundle\") pod \"77dd5de0-7483-4059-987f-2a73436706d4\" (UID: \"77dd5de0-7483-4059-987f-2a73436706d4\") " Sep 17 03:22:32.411120 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.411095 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-bundle" (OuterVolumeSpecName: "bundle") pod "77dd5de0-7483-4059-987f-2a73436706d4" (UID: "77dd5de0-7483-4059-987f-2a73436706d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:22:32.412226 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.412205 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77dd5de0-7483-4059-987f-2a73436706d4-kube-api-access-pmvd2" (OuterVolumeSpecName: "kube-api-access-pmvd2") pod "77dd5de0-7483-4059-987f-2a73436706d4" (UID: "77dd5de0-7483-4059-987f-2a73436706d4"). InnerVolumeSpecName "kube-api-access-pmvd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:22:32.418140 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.418113 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-util" (OuterVolumeSpecName: "util") pod "77dd5de0-7483-4059-987f-2a73436706d4" (UID: "77dd5de0-7483-4059-987f-2a73436706d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:22:32.510888 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.510860 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmvd2\" (UniqueName: \"kubernetes.io/projected/77dd5de0-7483-4059-987f-2a73436706d4-kube-api-access-pmvd2\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:22:32.510888 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.510886 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-util\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:22:32.511036 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.510895 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77dd5de0-7483-4059-987f-2a73436706d4-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:22:32.887093 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.887054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" event={"ID":"77dd5de0-7483-4059-987f-2a73436706d4","Type":"ContainerDied","Data":"5d131e97e6d22c83eb261a09174d7ffe58429bcdf5496bf37d078bafac1d665b"} Sep 17 03:22:32.887267 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.887111 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d131e97e6d22c83eb261a09174d7ffe58429bcdf5496bf37d078bafac1d665b" Sep 17 03:22:32.887267 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.887064 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09lbdg" Sep 17 03:22:32.888823 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:32.888792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" event={"ID":"26ca10ff-7525-4c39-af18-af12f642c4db","Type":"ContainerStarted","Data":"055b569fc90d52f28884baa125a2fa1304df0c70edfdf4eb8acacaa78b61412d"} Sep 17 03:22:33.895068 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:33.894969 2562 generic.go:356] "Generic (PLEG): container finished" podID="26ca10ff-7525-4c39-af18-af12f642c4db" containerID="055b569fc90d52f28884baa125a2fa1304df0c70edfdf4eb8acacaa78b61412d" exitCode=0 Sep 17 03:22:33.895068 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:33.895043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" event={"ID":"26ca10ff-7525-4c39-af18-af12f642c4db","Type":"ContainerDied","Data":"055b569fc90d52f28884baa125a2fa1304df0c70edfdf4eb8acacaa78b61412d"} Sep 17 03:22:34.902367 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:34.902329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" event={"ID":"26ca10ff-7525-4c39-af18-af12f642c4db","Type":"ContainerStarted","Data":"b01c44e43c37fd571d67835c5076c0e70fc19483e0724ddf5fbd2141a38fbb24"} Sep 17 03:22:34.902806 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:34.902481 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:34.926978 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:34.926921 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" podStartSLOduration=2.33366439 podStartE2EDuration="6.926899831s" totalImagesPullingTime="3.503808592s" totalInitContainerRuntime="1.089426849s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:34.925004854 +0000 UTC m=+593.788265954" watchObservedRunningTime="2026-09-17 03:22:34.926899831 +0000 UTC m=+593.790161138" Sep 17 03:22:41.519697 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:41.519667 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:22:41.520225 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:41.519667 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:22:45.909762 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:45.909730 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-m8746" Sep 17 03:22:49.417130 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.417099 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t"] Sep 17 03:22:49.417487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.417404 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77dd5de0-7483-4059-987f-2a73436706d4" containerName="util" Sep 17 03:22:49.417487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.417415 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="77dd5de0-7483-4059-987f-2a73436706d4" containerName="util" Sep 17 03:22:49.417487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.417423 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77dd5de0-7483-4059-987f-2a73436706d4" containerName="pull" Sep 17 03:22:49.417487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.417429 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="77dd5de0-7483-4059-987f-2a73436706d4" containerName="pull" Sep 17 03:22:49.417487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.417443 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77dd5de0-7483-4059-987f-2a73436706d4" containerName="extract" Sep 17 03:22:49.417487 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.417449 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="77dd5de0-7483-4059-987f-2a73436706d4" containerName="extract" Sep 17 03:22:49.417696 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.417503 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="77dd5de0-7483-4059-987f-2a73436706d4" containerName="extract" Sep 17 03:22:49.420755 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.420735 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.423668 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.423646 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 17 03:22:49.423958 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.423941 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 17 03:22:49.424051 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.423964 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vglhj\"" Sep 17 03:22:49.430516 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.430493 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t"] Sep 17 03:22:49.544496 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.544457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e215289-b133-49d8-8375-6ab6818651bd-tls-certs\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.544496 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.544506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e215289-b133-49d8-8375-6ab6818651bd-tmp\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.544741 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.544531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gj2g\" (UniqueName: \"kubernetes.io/projected/4e215289-b133-49d8-8375-6ab6818651bd-kube-api-access-6gj2g\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.645821 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.645780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e215289-b133-49d8-8375-6ab6818651bd-tls-certs\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.646009 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.645834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e215289-b133-49d8-8375-6ab6818651bd-tmp\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.646009 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.645874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gj2g\" (UniqueName: \"kubernetes.io/projected/4e215289-b133-49d8-8375-6ab6818651bd-kube-api-access-6gj2g\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.648079 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.648028 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e215289-b133-49d8-8375-6ab6818651bd-tmp\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.648336 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.648316 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e215289-b133-49d8-8375-6ab6818651bd-tls-certs\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.654395 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.654367 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gj2g\" (UniqueName: \"kubernetes.io/projected/4e215289-b133-49d8-8375-6ab6818651bd-kube-api-access-6gj2g\") pod \"kube-auth-proxy-5b76b6489b-7wm7t\" (UID: \"4e215289-b133-49d8-8375-6ab6818651bd\") " pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:49.731953 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:49.731920 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" Sep 17 03:22:50.001977 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.001949 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t"] Sep 17 03:22:50.003675 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:22:50.003648 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e215289_b133_49d8_8375_6ab6818651bd.slice/crio-59911d4388778cbdbc7769e53aaca36ebed640ec85b9922789d51e22f5a2f51f WatchSource:0}: Error finding container 59911d4388778cbdbc7769e53aaca36ebed640ec85b9922789d51e22f5a2f51f: Status 404 returned error can't find the container with id 59911d4388778cbdbc7769e53aaca36ebed640ec85b9922789d51e22f5a2f51f Sep 17 03:22:50.816711 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.816675 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429"] Sep 17 03:22:50.820466 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.820438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.823503 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.823480 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 17 03:22:50.823677 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.823653 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 17 03:22:50.823767 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.823653 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 17 03:22:50.824014 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.823986 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 17 03:22:50.824153 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.824122 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bx4td\"" Sep 17 03:22:50.831104 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.831087 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429"] Sep 17 03:22:50.867364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.866949 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.867364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.866996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.867364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.867027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md4l9\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-kube-api-access-md4l9\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.867364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.867080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.867364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.867145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.867364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.867171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.867364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.867310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.968292 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.968242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.968292 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.968295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.968535 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.968322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.968535 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.968374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md4l9\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-kube-api-access-md4l9\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.968535 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.968426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.968535 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.968469 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.968535 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.968488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.969922 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.969890 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.971953 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.971577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.971953 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.971834 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.971953 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.971833 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.972177 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.972014 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.977905 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.977864 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md4l9\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-kube-api-access-md4l9\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.978489 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.978468 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gg429\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:50.985386 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:50.985357 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" event={"ID":"4e215289-b133-49d8-8375-6ab6818651bd","Type":"ContainerStarted","Data":"59911d4388778cbdbc7769e53aaca36ebed640ec85b9922789d51e22f5a2f51f"} Sep 17 03:22:51.134330 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:51.134245 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:51.425332 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:51.425298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429"] Sep 17 03:22:51.427093 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:22:51.427056 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6cc7fd_c55d_4fa2_81de_ec6692a798e5.slice/crio-69152e78d60fe0f77a20b078523a0b4a73eb86a763b0517f1dd3444854cae09e WatchSource:0}: Error finding container 69152e78d60fe0f77a20b078523a0b4a73eb86a763b0517f1dd3444854cae09e: Status 404 returned error can't find the container with id 69152e78d60fe0f77a20b078523a0b4a73eb86a763b0517f1dd3444854cae09e Sep 17 03:22:51.992886 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:51.992840 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" event={"ID":"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5","Type":"ContainerStarted","Data":"69152e78d60fe0f77a20b078523a0b4a73eb86a763b0517f1dd3444854cae09e"} Sep 17 03:22:53.002030 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:53.001995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" event={"ID":"4e215289-b133-49d8-8375-6ab6818651bd","Type":"ContainerStarted","Data":"03f7b015065855cb66d8b0819481799dd9a68eb820c1cbfc23fc6eb64d80f9dd"} Sep 17 03:22:53.019493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:53.019357 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b76b6489b-7wm7t" podStartSLOduration=1.188231333 podStartE2EDuration="4.019337112s" totalImagesPullingTime="2.831105779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:53.019198791 +0000 UTC m=+611.882459891" watchObservedRunningTime="2026-09-17 03:22:53.019337112 +0000 UTC m=+611.882598212" Sep 17 03:22:54.637132 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:54.637078 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:22:54.637445 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:54.637174 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:22:55.014203 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.014160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" event={"ID":"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5","Type":"ContainerStarted","Data":"a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71"} Sep 17 03:22:55.014371 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.014319 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:55.016002 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.015976 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-gg429 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 17 03:22:55.016119 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.016023 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" podUID="0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 03:22:55.036820 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.036775 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" podStartSLOduration=1.8298965699999998 podStartE2EDuration="5.036763685s" totalImagesPullingTime="3.206867115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:55.036486229 +0000 UTC m=+613.899747329" watchObservedRunningTime="2026-09-17 03:22:55.036763685 +0000 UTC m=+613.900024785" Sep 17 03:22:55.485619 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.485582 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2"] Sep 17 03:22:55.489374 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.489352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.492304 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.492279 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-54st8\"" Sep 17 03:22:55.505537 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.505511 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2"] Sep 17 03:22:55.609802 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.609773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.609802 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.609805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.609990 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.609832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.609990 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.609921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.609990 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.609958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.610106 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.610054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.610106 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.610093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.610172 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.610139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt7z8\" (UniqueName: \"kubernetes.io/projected/2322d045-e70f-4f77-9f82-50f7b6ef24a3-kube-api-access-xt7z8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.610212 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.610201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.710880 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.710842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.710880 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.710885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.710901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711213 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711262 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt7z8\" (UniqueName: \"kubernetes.io/projected/2322d045-e70f-4f77-9f82-50f7b6ef24a3-kube-api-access-xt7z8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711819 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711484 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711819 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711517 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.711819 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.711751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.713519 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.713496 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.713792 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.713769 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.720932 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.720908 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2322d045-e70f-4f77-9f82-50f7b6ef24a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.721207 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.721182 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt7z8\" (UniqueName: \"kubernetes.io/projected/2322d045-e70f-4f77-9f82-50f7b6ef24a3-kube-api-access-xt7z8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2\" (UID: \"2322d045-e70f-4f77-9f82-50f7b6ef24a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:55.800304 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:55.800232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:22:56.019152 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:56.019128 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:22:56.077234 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:56.077207 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2"] Sep 17 03:22:56.078210 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:22:56.078183 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2322d045_e70f_4f77_9f82_50f7b6ef24a3.slice/crio-2aac56b85f725f2bb5bca99ab41dc29feef8e335df66ba6f6f68a6a5d84e1d93 WatchSource:0}: Error finding container 2aac56b85f725f2bb5bca99ab41dc29feef8e335df66ba6f6f68a6a5d84e1d93: Status 404 returned error can't find the container with id 2aac56b85f725f2bb5bca99ab41dc29feef8e335df66ba6f6f68a6a5d84e1d93 Sep 17 03:22:56.080359 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:56.080339 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:22:57.023912 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:57.023872 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" event={"ID":"2322d045-e70f-4f77-9f82-50f7b6ef24a3","Type":"ContainerStarted","Data":"2aac56b85f725f2bb5bca99ab41dc29feef8e335df66ba6f6f68a6a5d84e1d93"} Sep 17 03:22:58.989703 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:58.989662 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:22:58.990063 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:58.989780 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:22:58.990063 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:22:58.989830 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:23:00.042384 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:00.042339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" event={"ID":"2322d045-e70f-4f77-9f82-50f7b6ef24a3","Type":"ContainerStarted","Data":"82cdf47df0c2a4cdfc0444bd39bd96ad5f065d5d6ae1ff412072ff8131845c9e"} Sep 17 03:23:00.800692 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:00.800655 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:23:00.806407 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:00.806378 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:23:00.829991 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:00.829927 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" podStartSLOduration=2.9209800660000003 podStartE2EDuration="5.82990973s" totalImagesPullingTime="2.908929664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:23:00.086503083 +0000 UTC m=+618.949764181" watchObservedRunningTime="2026-09-17 03:23:00.82990973 +0000 UTC m=+619.693170829" Sep 17 03:23:01.047440 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:01.047408 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:23:01.048352 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:01.048333 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2" Sep 17 03:23:05.820855 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.820776 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759854578-kppd6"] Sep 17 03:23:05.831092 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.831064 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:05.834788 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.834750 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 03:23:05.834943 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.834851 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 03:23:05.834943 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.834857 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 03:23:05.834943 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.834915 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bl97j\"" Sep 17 03:23:05.835133 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.835003 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 03:23:05.835242 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.835220 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 03:23:05.836118 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.836097 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759854578-kppd6"] Sep 17 03:23:05.841003 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.840982 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 03:23:05.905928 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.905891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-trusted-ca-bundle\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:05.905928 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.905929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-oauth-config\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:05.906148 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.905954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-serving-cert\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:05.906148 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.905969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h48kt\" (UniqueName: \"kubernetes.io/projected/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-kube-api-access-h48kt\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:05.906148 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.906070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-service-ca\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:05.906148 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.906098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-config\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:05.906148 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:05.906135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-oauth-serving-cert\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.007281 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.007239 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-service-ca\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.007281 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.007284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-config\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.007532 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.007328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-oauth-serving-cert\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.007532 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.007379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-trusted-ca-bundle\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.007532 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.007404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-oauth-config\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.007532 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.007444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-serving-cert\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.007532 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.007464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h48kt\" (UniqueName: \"kubernetes.io/projected/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-kube-api-access-h48kt\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.008075 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.008048 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-service-ca\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.008201 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.008107 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-oauth-serving-cert\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.008201 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.008166 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-config\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.008276 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.008259 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-trusted-ca-bundle\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.010001 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.009974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-serving-cert\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.010160 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.010139 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-console-oauth-config\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.018273 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.018249 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h48kt\" (UniqueName: \"kubernetes.io/projected/dc7a7d0b-7384-46e9-bfe6-1475601f68f9-kube-api-access-h48kt\") pod \"console-759854578-kppd6\" (UID: \"dc7a7d0b-7384-46e9-bfe6-1475601f68f9\") " pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.143981 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.143889 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:06.420226 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:06.420144 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759854578-kppd6"] Sep 17 03:23:06.423480 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:23:06.423451 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7a7d0b_7384_46e9_bfe6_1475601f68f9.slice/crio-9277c8ad981b621ca8abc2d53623120472fc7d4c820496e36158c559a5e6bf32 WatchSource:0}: Error finding container 9277c8ad981b621ca8abc2d53623120472fc7d4c820496e36158c559a5e6bf32: Status 404 returned error can't find the container with id 9277c8ad981b621ca8abc2d53623120472fc7d4c820496e36158c559a5e6bf32 Sep 17 03:23:07.081428 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:07.081395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759854578-kppd6" event={"ID":"dc7a7d0b-7384-46e9-bfe6-1475601f68f9","Type":"ContainerStarted","Data":"c38b0314acd543aa0b6804e78a87260c03358b71fb58ad4ec95261c3e1eaf880"} Sep 17 03:23:07.081854 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:07.081450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759854578-kppd6" event={"ID":"dc7a7d0b-7384-46e9-bfe6-1475601f68f9","Type":"ContainerStarted","Data":"9277c8ad981b621ca8abc2d53623120472fc7d4c820496e36158c559a5e6bf32"} Sep 17 03:23:07.106853 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:07.106806 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759854578-kppd6" podStartSLOduration=2.106790323 podStartE2EDuration="2.106790323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:23:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:23:07.106040366 +0000 UTC m=+625.969301477" watchObservedRunningTime="2026-09-17 03:23:07.106790323 +0000 UTC m=+625.970051491" Sep 17 03:23:08.344217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.344180 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr"] Sep 17 03:23:08.347676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.347655 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:08.353276 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.353258 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 17 03:23:08.353597 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.353578 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-d4x6n\"" Sep 17 03:23:08.371692 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.371662 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx"] Sep 17 03:23:08.375540 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.375481 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr"] Sep 17 03:23:08.375676 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.375610 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:08.379211 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.379188 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 17 03:23:08.379536 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.379199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8rngl\"" Sep 17 03:23:08.401578 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.401547 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx"] Sep 17 03:23:08.431425 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.431391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4flg\" (UniqueName: \"kubernetes.io/projected/2583d194-8988-4526-9650-94f60de2609b-kube-api-access-d4flg\") pod \"kserve-controller-manager-d6f4b65b8-pdvcr\" (UID: \"2583d194-8988-4526-9650-94f60de2609b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:08.431588 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.431443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2583d194-8988-4526-9650-94f60de2609b-cert\") pod \"kserve-controller-manager-d6f4b65b8-pdvcr\" (UID: \"2583d194-8988-4526-9650-94f60de2609b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:08.532847 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.532801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4flg\" (UniqueName: \"kubernetes.io/projected/2583d194-8988-4526-9650-94f60de2609b-kube-api-access-d4flg\") pod \"kserve-controller-manager-d6f4b65b8-pdvcr\" (UID: \"2583d194-8988-4526-9650-94f60de2609b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:08.533202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.532897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc2kx\" (UniqueName: \"kubernetes.io/projected/5d6ce20a-da83-4883-8d6e-04634409dc76-kube-api-access-fc2kx\") pod \"llmisvc-controller-manager-777c6bd7d5-wrqgx\" (UID: \"5d6ce20a-da83-4883-8d6e-04634409dc76\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:08.533202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.532932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2583d194-8988-4526-9650-94f60de2609b-cert\") pod \"kserve-controller-manager-d6f4b65b8-pdvcr\" (UID: \"2583d194-8988-4526-9650-94f60de2609b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:08.533202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.532959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6ce20a-da83-4883-8d6e-04634409dc76-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wrqgx\" (UID: \"5d6ce20a-da83-4883-8d6e-04634409dc76\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:08.538292 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.538258 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2583d194-8988-4526-9650-94f60de2609b-cert\") pod \"kserve-controller-manager-d6f4b65b8-pdvcr\" (UID: \"2583d194-8988-4526-9650-94f60de2609b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:08.543869 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.543843 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4flg\" (UniqueName: \"kubernetes.io/projected/2583d194-8988-4526-9650-94f60de2609b-kube-api-access-d4flg\") pod \"kserve-controller-manager-d6f4b65b8-pdvcr\" (UID: \"2583d194-8988-4526-9650-94f60de2609b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:08.634133 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.634043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6ce20a-da83-4883-8d6e-04634409dc76-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wrqgx\" (UID: \"5d6ce20a-da83-4883-8d6e-04634409dc76\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:08.634282 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:23:08.634202 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 17 03:23:08.634323 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:23:08.634282 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6ce20a-da83-4883-8d6e-04634409dc76-cert podName:5d6ce20a-da83-4883-8d6e-04634409dc76 nodeName:}" failed. No retries permitted until 2026-09-17 03:23:09.134263793 +0000 UTC m=+627.997524870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d6ce20a-da83-4883-8d6e-04634409dc76-cert") pod "llmisvc-controller-manager-777c6bd7d5-wrqgx" (UID: "5d6ce20a-da83-4883-8d6e-04634409dc76") : secret "llmisvc-webhook-server-cert" not found Sep 17 03:23:08.634323 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.634205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc2kx\" (UniqueName: \"kubernetes.io/projected/5d6ce20a-da83-4883-8d6e-04634409dc76-kube-api-access-fc2kx\") pod \"llmisvc-controller-manager-777c6bd7d5-wrqgx\" (UID: \"5d6ce20a-da83-4883-8d6e-04634409dc76\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:08.643545 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.643519 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc2kx\" (UniqueName: \"kubernetes.io/projected/5d6ce20a-da83-4883-8d6e-04634409dc76-kube-api-access-fc2kx\") pod \"llmisvc-controller-manager-777c6bd7d5-wrqgx\" (UID: \"5d6ce20a-da83-4883-8d6e-04634409dc76\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:08.658466 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.658441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:08.933365 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:08.933337 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr"] Sep 17 03:23:08.934882 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:23:08.934853 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2583d194_8988_4526_9650_94f60de2609b.slice/crio-a23a6277ccd7ec7bcadbe19e89f08e76f941e32c443251430426a0491fd250b8 WatchSource:0}: Error finding container a23a6277ccd7ec7bcadbe19e89f08e76f941e32c443251430426a0491fd250b8: Status 404 returned error can't find the container with id a23a6277ccd7ec7bcadbe19e89f08e76f941e32c443251430426a0491fd250b8 Sep 17 03:23:09.097297 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:09.097265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" event={"ID":"2583d194-8988-4526-9650-94f60de2609b","Type":"ContainerStarted","Data":"a23a6277ccd7ec7bcadbe19e89f08e76f941e32c443251430426a0491fd250b8"} Sep 17 03:23:09.138434 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:09.138404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6ce20a-da83-4883-8d6e-04634409dc76-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wrqgx\" (UID: \"5d6ce20a-da83-4883-8d6e-04634409dc76\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:09.140700 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:09.140683 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6ce20a-da83-4883-8d6e-04634409dc76-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wrqgx\" (UID: \"5d6ce20a-da83-4883-8d6e-04634409dc76\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:09.288431 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:09.288398 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:09.574613 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:09.574582 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx"] Sep 17 03:23:09.575726 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:23:09.575696 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5d6ce20a_da83_4883_8d6e_04634409dc76.slice/crio-1589680075e5fef7a7999362679b78270f5f3ab38a639e81db1982a2bbe9703c WatchSource:0}: Error finding container 1589680075e5fef7a7999362679b78270f5f3ab38a639e81db1982a2bbe9703c: Status 404 returned error can't find the container with id 1589680075e5fef7a7999362679b78270f5f3ab38a639e81db1982a2bbe9703c Sep 17 03:23:10.104674 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:10.104603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" event={"ID":"5d6ce20a-da83-4883-8d6e-04634409dc76","Type":"ContainerStarted","Data":"1589680075e5fef7a7999362679b78270f5f3ab38a639e81db1982a2bbe9703c"} Sep 17 03:23:12.128107 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:12.128063 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" event={"ID":"2583d194-8988-4526-9650-94f60de2609b","Type":"ContainerStarted","Data":"524ef4b7b1016954c96d799a9e9098a2c147efad546affefced53001423c3af2"} Sep 17 03:23:12.128472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:12.128136 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:12.145885 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:12.145823 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" podStartSLOduration=1.8858281890000002 podStartE2EDuration="4.14580274s" totalImagesPullingTime="2.259974551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:23:12.143860339 +0000 UTC m=+631.007121438" watchObservedRunningTime="2026-09-17 03:23:12.14580274 +0000 UTC m=+631.009063838" Sep 17 03:23:14.139053 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.139016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" event={"ID":"5d6ce20a-da83-4883-8d6e-04634409dc76","Type":"ContainerStarted","Data":"986145e14a2f9507c0a24f2bdd1035820f8ddbd843eb591dbc0f6c4c85f59583"} Sep 17 03:23:14.139448 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.139153 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:23:14.157617 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.157576 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" podStartSLOduration=2.6778924760000002 podStartE2EDuration="6.157562228s" totalImagesPullingTime="3.479669752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:23:14.155460414 +0000 UTC m=+633.018721526" watchObservedRunningTime="2026-09-17 03:23:14.157562228 +0000 UTC m=+633.020823326" Sep 17 03:23:14.195135 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.195105 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429"] Sep 17 03:23:14.195322 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.195301 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" podUID="0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" containerName="discovery" containerID="cri-o://a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71" gracePeriod=30 Sep 17 03:23:14.437944 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.437920 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:23:14.585465 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.585437 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md4l9\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-kube-api-access-md4l9\") pod \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " Sep 17 03:23:14.585625 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.585495 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-token\") pod \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " Sep 17 03:23:14.585625 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.585535 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-cacerts\") pod \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " Sep 17 03:23:14.585625 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.585549 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-dns-cert\") pod \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " Sep 17 03:23:14.585625 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.585575 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-ca-configmap\") pod \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " Sep 17 03:23:14.585625 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.585622 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-kubeconfig\") pod \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " Sep 17 03:23:14.585896 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.585706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-local-certs\") pod \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\" (UID: \"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5\") " Sep 17 03:23:14.586071 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.586037 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" (UID: "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:23:14.588056 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.588021 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-cacerts" (OuterVolumeSpecName: "cacerts") pod "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" (UID: "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:23:14.588056 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.588039 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" (UID: "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:23:14.588211 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.588108 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" (UID: "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:23:14.588211 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.588200 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-kube-api-access-md4l9" (OuterVolumeSpecName: "kube-api-access-md4l9") pod "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" (UID: "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5"). InnerVolumeSpecName "kube-api-access-md4l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:23:14.588321 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.588218 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" (UID: "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:23:14.588321 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.588286 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-local-certs" (OuterVolumeSpecName: "local-certs") pod "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" (UID: "0b6cc7fd-c55d-4fa2-81de-ec6692a798e5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:23:14.687218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.687118 2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-ca-configmap\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:23:14.687218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.687150 2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-kubeconfig\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:23:14.687218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.687165 2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-local-certs\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:23:14.687218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.687176 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md4l9\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-kube-api-access-md4l9\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:23:14.687218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.687187 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-token\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:23:14.687218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.687198 2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-cacerts\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:23:14.687218 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:14.687208 2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5-istio-csr-dns-cert\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:23:15.145547 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.145508 2562 generic.go:356] "Generic (PLEG): container finished" podID="0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" containerID="a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71" exitCode=0 Sep 17 03:23:15.146023 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.145552 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" Sep 17 03:23:15.146023 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.145586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" event={"ID":"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5","Type":"ContainerDied","Data":"a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71"} Sep 17 03:23:15.146023 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.145668 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429" event={"ID":"0b6cc7fd-c55d-4fa2-81de-ec6692a798e5","Type":"ContainerDied","Data":"69152e78d60fe0f77a20b078523a0b4a73eb86a763b0517f1dd3444854cae09e"} Sep 17 03:23:15.146023 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.145703 2562 scope.go:117] "RemoveContainer" containerID="a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71" Sep 17 03:23:15.162337 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.162309 2562 scope.go:117] "RemoveContainer" containerID="a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71" Sep 17 03:23:15.162691 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:23:15.162670 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71\": container with ID starting with a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71 not found: ID does not exist" containerID="a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71" Sep 17 03:23:15.162779 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.162703 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71"} err="failed to get container status \"a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71\": rpc error: code = NotFound desc = could not find container \"a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71\": container with ID starting with a64a12cc45e0fca73cf0b5e199e636c342cfe4d866be29392248d5b8e0bf3c71 not found: ID does not exist" Sep 17 03:23:15.175059 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.175033 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429"] Sep 17 03:23:15.179407 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.179382 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gg429"] Sep 17 03:23:15.609381 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:15.609347 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" path="/var/lib/kubelet/pods/0b6cc7fd-c55d-4fa2-81de-ec6692a798e5/volumes" Sep 17 03:23:16.145044 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:16.145012 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:16.145244 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:16.145068 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:16.149911 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:16.149887 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:16.154985 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:16.154963 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-759854578-kppd6" Sep 17 03:23:43.137608 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:43.137580 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pdvcr" Sep 17 03:23:45.148007 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:23:45.147974 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wrqgx" Sep 17 03:24:03.748008 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.747970 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d"] Sep 17 03:24:03.748460 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.748327 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" containerName="discovery" Sep 17 03:24:03.748460 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.748339 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" containerName="discovery" Sep 17 03:24:03.748460 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.748400 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6cc7fd-c55d-4fa2-81de-ec6692a798e5" containerName="discovery" Sep 17 03:24:03.755530 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.755510 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:03.758658 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.758594 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 17 03:24:03.760688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.760058 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 17 03:24:03.760688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.760063 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zqr76\"" Sep 17 03:24:03.763097 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.763072 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d"] Sep 17 03:24:03.848127 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.848095 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp"] Sep 17 03:24:03.851735 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.851713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:03.861934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.861910 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp"] Sep 17 03:24:03.915170 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.915131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:03.915359 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.915184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttjdn\" (UniqueName: \"kubernetes.io/projected/c941093f-54b7-4a6e-9a2e-ab9466effc10-kube-api-access-ttjdn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:03.915359 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.915234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:03.950827 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.950789 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r"] Sep 17 03:24:03.954788 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.954767 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:03.964077 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:03.964054 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r"] Sep 17 03:24:04.016175 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.016100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:04.016175 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.016132 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjdn\" (UniqueName: \"kubernetes.io/projected/c941093f-54b7-4a6e-9a2e-ab9466effc10-kube-api-access-ttjdn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:04.016175 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.016163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.016417 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.016186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:04.016417 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.016205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.016417 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.016342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btgvc\" (UniqueName: \"kubernetes.io/projected/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-kube-api-access-btgvc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.016546 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.016505 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:04.016584 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.016542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:04.024920 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.024900 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttjdn\" (UniqueName: \"kubernetes.io/projected/c941093f-54b7-4a6e-9a2e-ab9466effc10-kube-api-access-ttjdn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:04.051848 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.051803 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km"] Sep 17 03:24:04.056007 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.055990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.066040 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.066018 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km"] Sep 17 03:24:04.066135 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.066119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:04.117584 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.117549 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.117797 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.117677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.117797 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.117714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.117797 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.117749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h46pw\" (UniqueName: \"kubernetes.io/projected/c45802c7-4ec1-42be-b94d-957cfcca153e-kube-api-access-h46pw\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.117965 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.117805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.117965 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.117860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgvc\" (UniqueName: \"kubernetes.io/projected/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-kube-api-access-btgvc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.118397 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.118373 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.118675 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.118580 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.127697 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.127619 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btgvc\" (UniqueName: \"kubernetes.io/projected/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-kube-api-access-btgvc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.161044 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.161018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:04.221400 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.220324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.221400 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.220391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.221400 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.220475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h46pw\" (UniqueName: \"kubernetes.io/projected/c45802c7-4ec1-42be-b94d-957cfcca153e-kube-api-access-h46pw\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.221400 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.220502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq6tj\" (UniqueName: \"kubernetes.io/projected/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-kube-api-access-hq6tj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.221400 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.220539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.221400 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.220577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.221400 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.220985 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.223258 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.223196 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.234604 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.234576 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h46pw\" (UniqueName: \"kubernetes.io/projected/c45802c7-4ec1-42be-b94d-957cfcca153e-kube-api-access-h46pw\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.264571 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.264538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:04.321773 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.321735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6tj\" (UniqueName: \"kubernetes.io/projected/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-kube-api-access-hq6tj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.321866 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.321798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.321866 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.321849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.322323 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.322279 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.322551 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.322496 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.332477 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.332430 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq6tj\" (UniqueName: \"kubernetes.io/projected/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-kube-api-access-hq6tj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.340209 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.340034 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d"] Sep 17 03:24:04.343194 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:04.343166 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc941093f_54b7_4a6e_9a2e_ab9466effc10.slice/crio-cce0921fa5f79a26a8cc284e2e8b9b5118c6e29eb69f09dc0bf5795ce6b7a093 WatchSource:0}: Error finding container cce0921fa5f79a26a8cc284e2e8b9b5118c6e29eb69f09dc0bf5795ce6b7a093: Status 404 returned error can't find the container with id cce0921fa5f79a26a8cc284e2e8b9b5118c6e29eb69f09dc0bf5795ce6b7a093 Sep 17 03:24:04.365186 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.365165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:04.390546 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.390510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" event={"ID":"c941093f-54b7-4a6e-9a2e-ab9466effc10","Type":"ContainerStarted","Data":"cce0921fa5f79a26a8cc284e2e8b9b5118c6e29eb69f09dc0bf5795ce6b7a093"} Sep 17 03:24:04.439941 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.439901 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp"] Sep 17 03:24:04.442839 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:04.442813 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffdcb4c3_5eeb_4b30_b776_4c83b1c9bf08.slice/crio-aaead1f00f377a656f44c4bf3fbd9287e735624553fde8e79abb1ab903c3f41c WatchSource:0}: Error finding container aaead1f00f377a656f44c4bf3fbd9287e735624553fde8e79abb1ab903c3f41c: Status 404 returned error can't find the container with id aaead1f00f377a656f44c4bf3fbd9287e735624553fde8e79abb1ab903c3f41c Sep 17 03:24:04.543860 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.543832 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r"] Sep 17 03:24:04.550694 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:04.550666 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45802c7_4ec1_42be_b94d_957cfcca153e.slice/crio-05e6fca5144e1ef5b49001dad2b7b3014f23d4555a6def174a17dcb8221d949e WatchSource:0}: Error finding container 05e6fca5144e1ef5b49001dad2b7b3014f23d4555a6def174a17dcb8221d949e: Status 404 returned error can't find the container with id 05e6fca5144e1ef5b49001dad2b7b3014f23d4555a6def174a17dcb8221d949e Sep 17 03:24:04.637794 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:04.637768 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km"] Sep 17 03:24:04.658956 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:04.658922 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f511bc_bb03_4b7a_8d24_e3aa14b9e9c8.slice/crio-172ab6a604d27a42f4d9951b3fea4822656ddc7e4257a98b91348d9d755c96d4 WatchSource:0}: Error finding container 172ab6a604d27a42f4d9951b3fea4822656ddc7e4257a98b91348d9d755c96d4: Status 404 returned error can't find the container with id 172ab6a604d27a42f4d9951b3fea4822656ddc7e4257a98b91348d9d755c96d4 Sep 17 03:24:05.398576 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.398541 2562 generic.go:356] "Generic (PLEG): container finished" podID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerID="baa95e0460ae032379bee860f3a5747a8d8e6fffc2e1443c8ce4243877ad2a5c" exitCode=0 Sep 17 03:24:05.399024 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.398609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" event={"ID":"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8","Type":"ContainerDied","Data":"baa95e0460ae032379bee860f3a5747a8d8e6fffc2e1443c8ce4243877ad2a5c"} Sep 17 03:24:05.399024 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.398665 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" event={"ID":"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8","Type":"ContainerStarted","Data":"172ab6a604d27a42f4d9951b3fea4822656ddc7e4257a98b91348d9d755c96d4"} Sep 17 03:24:05.400345 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.400317 2562 generic.go:356] "Generic (PLEG): container finished" podID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerID="420771e5e08c2e94a6f3743ef82e9fbb353e39d93b9c1da7f8d26ed7e3a2172b" exitCode=0 Sep 17 03:24:05.400425 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.400392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" event={"ID":"c45802c7-4ec1-42be-b94d-957cfcca153e","Type":"ContainerDied","Data":"420771e5e08c2e94a6f3743ef82e9fbb353e39d93b9c1da7f8d26ed7e3a2172b"} Sep 17 03:24:05.400472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.400441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" event={"ID":"c45802c7-4ec1-42be-b94d-957cfcca153e","Type":"ContainerStarted","Data":"05e6fca5144e1ef5b49001dad2b7b3014f23d4555a6def174a17dcb8221d949e"} Sep 17 03:24:05.402054 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.402025 2562 generic.go:356] "Generic (PLEG): container finished" podID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerID="4779cd2d1da085eedcc6c0658743ca764786c925d258e87cd7e78dcb42434db6" exitCode=0 Sep 17 03:24:05.402151 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.402064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" event={"ID":"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08","Type":"ContainerDied","Data":"4779cd2d1da085eedcc6c0658743ca764786c925d258e87cd7e78dcb42434db6"} Sep 17 03:24:05.402151 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.402112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" event={"ID":"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08","Type":"ContainerStarted","Data":"aaead1f00f377a656f44c4bf3fbd9287e735624553fde8e79abb1ab903c3f41c"} Sep 17 03:24:05.404010 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.403989 2562 generic.go:356] "Generic (PLEG): container finished" podID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerID="b3ff7f708976bbc3bd777c69ad8454f049799efd63c1d2de9ca11afab461538a" exitCode=0 Sep 17 03:24:05.404096 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:05.404037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" event={"ID":"c941093f-54b7-4a6e-9a2e-ab9466effc10","Type":"ContainerDied","Data":"b3ff7f708976bbc3bd777c69ad8454f049799efd63c1d2de9ca11afab461538a"} Sep 17 03:24:07.417720 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:07.417687 2562 generic.go:356] "Generic (PLEG): container finished" podID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerID="1c8ec0972dcb2e3a08fbb29249dc930dc75b750a5c143887c12e873754fb5ca8" exitCode=0 Sep 17 03:24:07.418156 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:07.417770 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" event={"ID":"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08","Type":"ContainerDied","Data":"1c8ec0972dcb2e3a08fbb29249dc930dc75b750a5c143887c12e873754fb5ca8"} Sep 17 03:24:07.419817 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:07.419791 2562 generic.go:356] "Generic (PLEG): container finished" podID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerID="0018de2f045d881a4338e22833282e67f291e817a9040757ecdaab45f02724d0" exitCode=0 Sep 17 03:24:07.419965 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:07.419886 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" event={"ID":"c941093f-54b7-4a6e-9a2e-ab9466effc10","Type":"ContainerDied","Data":"0018de2f045d881a4338e22833282e67f291e817a9040757ecdaab45f02724d0"} Sep 17 03:24:07.421974 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:07.421950 2562 generic.go:356] "Generic (PLEG): container finished" podID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerID="8fa57ddf5cbed584a23e926aa39fafb7241e77dda77d8a1746fad5bb82b4a637" exitCode=0 Sep 17 03:24:07.422055 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:07.422021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" event={"ID":"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8","Type":"ContainerDied","Data":"8fa57ddf5cbed584a23e926aa39fafb7241e77dda77d8a1746fad5bb82b4a637"} Sep 17 03:24:07.424313 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:07.424294 2562 generic.go:356] "Generic (PLEG): container finished" podID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerID="3c25c4c41f5826d6a7ca8b40b500b7da53e4ddbfb93208ab770cbbed04e2edd6" exitCode=0 Sep 17 03:24:07.424402 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:07.424330 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" event={"ID":"c45802c7-4ec1-42be-b94d-957cfcca153e","Type":"ContainerDied","Data":"3c25c4c41f5826d6a7ca8b40b500b7da53e4ddbfb93208ab770cbbed04e2edd6"} Sep 17 03:24:08.432088 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:08.432046 2562 generic.go:356] "Generic (PLEG): container finished" podID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerID="c3f3bd4f14c3c317c06344c6d9553bae0d7a11af3011149839393ed91da24e51" exitCode=0 Sep 17 03:24:08.432473 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:08.432114 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" event={"ID":"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8","Type":"ContainerDied","Data":"c3f3bd4f14c3c317c06344c6d9553bae0d7a11af3011149839393ed91da24e51"} Sep 17 03:24:08.434316 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:08.434290 2562 generic.go:356] "Generic (PLEG): container finished" podID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerID="929cd9b85d20ee190ceb0ea4135f2ffe2c2e7add0c216e18725ffdc5b0ba9118" exitCode=0 Sep 17 03:24:08.434430 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:08.434371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" event={"ID":"c45802c7-4ec1-42be-b94d-957cfcca153e","Type":"ContainerDied","Data":"929cd9b85d20ee190ceb0ea4135f2ffe2c2e7add0c216e18725ffdc5b0ba9118"} Sep 17 03:24:08.436572 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:08.436549 2562 generic.go:356] "Generic (PLEG): container finished" podID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerID="f21e322f5c233955395a9cdfd2a414e9471a25bc6c42995fa4c0c73f09947ea5" exitCode=0 Sep 17 03:24:08.436688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:08.436645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" event={"ID":"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08","Type":"ContainerDied","Data":"f21e322f5c233955395a9cdfd2a414e9471a25bc6c42995fa4c0c73f09947ea5"} Sep 17 03:24:08.438830 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:08.438767 2562 generic.go:356] "Generic (PLEG): container finished" podID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerID="f6fd1454d1343d3855e6253a5259fdc21a2a3160ff37d50339049f7efb30fe5d" exitCode=0 Sep 17 03:24:08.438830 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:08.438796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" event={"ID":"c941093f-54b7-4a6e-9a2e-ab9466effc10","Type":"ContainerDied","Data":"f6fd1454d1343d3855e6253a5259fdc21a2a3160ff37d50339049f7efb30fe5d"} Sep 17 03:24:09.593786 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.593755 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:09.633621 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.633592 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:09.674077 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.674053 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:09.677240 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.677221 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:09.769288 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.769254 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-util\") pod \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " Sep 17 03:24:09.769459 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.769327 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq6tj\" (UniqueName: \"kubernetes.io/projected/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-kube-api-access-hq6tj\") pod \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " Sep 17 03:24:09.769459 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.769351 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-util\") pod \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " Sep 17 03:24:09.769459 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.769403 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-bundle\") pod \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " Sep 17 03:24:09.769459 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.769420 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-bundle\") pod \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\" (UID: \"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8\") " Sep 17 03:24:09.769459 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.769448 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btgvc\" (UniqueName: \"kubernetes.io/projected/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-kube-api-access-btgvc\") pod \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\" (UID: \"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08\") " Sep 17 03:24:09.769948 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.769914 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-bundle" (OuterVolumeSpecName: "bundle") pod "ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" (UID: "ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:09.770061 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.770036 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-bundle" (OuterVolumeSpecName: "bundle") pod "42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" (UID: "42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:09.772147 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.772124 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-kube-api-access-btgvc" (OuterVolumeSpecName: "kube-api-access-btgvc") pod "ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" (UID: "ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08"). InnerVolumeSpecName "kube-api-access-btgvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:09.772234 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.772153 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-kube-api-access-hq6tj" (OuterVolumeSpecName: "kube-api-access-hq6tj") pod "42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" (UID: "42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8"). InnerVolumeSpecName "kube-api-access-hq6tj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:09.778230 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.778192 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-util" (OuterVolumeSpecName: "util") pod "42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" (UID: "42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:09.778288 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.778269 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-util" (OuterVolumeSpecName: "util") pod "ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" (UID: "ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:09.870848 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.870817 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-util\") pod \"c45802c7-4ec1-42be-b94d-957cfcca153e\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " Sep 17 03:24:09.871020 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.870859 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-bundle\") pod \"c45802c7-4ec1-42be-b94d-957cfcca153e\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " Sep 17 03:24:09.871020 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.870901 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-util\") pod \"c941093f-54b7-4a6e-9a2e-ab9466effc10\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " Sep 17 03:24:09.871020 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.870935 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttjdn\" (UniqueName: \"kubernetes.io/projected/c941093f-54b7-4a6e-9a2e-ab9466effc10-kube-api-access-ttjdn\") pod \"c941093f-54b7-4a6e-9a2e-ab9466effc10\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " Sep 17 03:24:09.871020 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.870974 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h46pw\" (UniqueName: \"kubernetes.io/projected/c45802c7-4ec1-42be-b94d-957cfcca153e-kube-api-access-h46pw\") pod \"c45802c7-4ec1-42be-b94d-957cfcca153e\" (UID: \"c45802c7-4ec1-42be-b94d-957cfcca153e\") " Sep 17 03:24:09.871252 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871079 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-bundle\") pod \"c941093f-54b7-4a6e-9a2e-ab9466effc10\" (UID: \"c941093f-54b7-4a6e-9a2e-ab9466effc10\") " Sep 17 03:24:09.871349 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871332 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq6tj\" (UniqueName: \"kubernetes.io/projected/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-kube-api-access-hq6tj\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.871424 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871354 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-util\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.871424 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871369 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.871424 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871381 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.871424 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871395 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btgvc\" (UniqueName: \"kubernetes.io/projected/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-kube-api-access-btgvc\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.871424 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871407 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08-util\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.871688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871667 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-bundle" (OuterVolumeSpecName: "bundle") pod "c941093f-54b7-4a6e-9a2e-ab9466effc10" (UID: "c941093f-54b7-4a6e-9a2e-ab9466effc10"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:09.871806 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.871759 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-bundle" (OuterVolumeSpecName: "bundle") pod "c45802c7-4ec1-42be-b94d-957cfcca153e" (UID: "c45802c7-4ec1-42be-b94d-957cfcca153e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:09.873203 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.873178 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c941093f-54b7-4a6e-9a2e-ab9466effc10-kube-api-access-ttjdn" (OuterVolumeSpecName: "kube-api-access-ttjdn") pod "c941093f-54b7-4a6e-9a2e-ab9466effc10" (UID: "c941093f-54b7-4a6e-9a2e-ab9466effc10"). InnerVolumeSpecName "kube-api-access-ttjdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:09.873491 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.873465 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45802c7-4ec1-42be-b94d-957cfcca153e-kube-api-access-h46pw" (OuterVolumeSpecName: "kube-api-access-h46pw") pod "c45802c7-4ec1-42be-b94d-957cfcca153e" (UID: "c45802c7-4ec1-42be-b94d-957cfcca153e"). InnerVolumeSpecName "kube-api-access-h46pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:09.876153 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.876129 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-util" (OuterVolumeSpecName: "util") pod "c45802c7-4ec1-42be-b94d-957cfcca153e" (UID: "c45802c7-4ec1-42be-b94d-957cfcca153e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:09.876472 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.876451 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-util" (OuterVolumeSpecName: "util") pod "c941093f-54b7-4a6e-9a2e-ab9466effc10" (UID: "c941093f-54b7-4a6e-9a2e-ab9466effc10"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:09.972511 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.972476 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttjdn\" (UniqueName: \"kubernetes.io/projected/c941093f-54b7-4a6e-9a2e-ab9466effc10-kube-api-access-ttjdn\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.972511 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.972505 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h46pw\" (UniqueName: \"kubernetes.io/projected/c45802c7-4ec1-42be-b94d-957cfcca153e-kube-api-access-h46pw\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.972511 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.972517 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.972748 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.972528 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-util\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.972748 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.972536 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45802c7-4ec1-42be-b94d-957cfcca153e-bundle\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:09.972748 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:09.972542 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c941093f-54b7-4a6e-9a2e-ab9466effc10-util\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:10.450727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.450696 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" Sep 17 03:24:10.450901 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.450693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78zfvp" event={"ID":"ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08","Type":"ContainerDied","Data":"aaead1f00f377a656f44c4bf3fbd9287e735624553fde8e79abb1ab903c3f41c"} Sep 17 03:24:10.450901 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.450818 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aaead1f00f377a656f44c4bf3fbd9287e735624553fde8e79abb1ab903c3f41c" Sep 17 03:24:10.452648 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.452608 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" Sep 17 03:24:10.452778 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.452646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fhr2d" event={"ID":"c941093f-54b7-4a6e-9a2e-ab9466effc10","Type":"ContainerDied","Data":"cce0921fa5f79a26a8cc284e2e8b9b5118c6e29eb69f09dc0bf5795ce6b7a093"} Sep 17 03:24:10.452778 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.452681 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cce0921fa5f79a26a8cc284e2e8b9b5118c6e29eb69f09dc0bf5795ce6b7a093" Sep 17 03:24:10.454688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.454662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" event={"ID":"42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8","Type":"ContainerDied","Data":"172ab6a604d27a42f4d9951b3fea4822656ddc7e4257a98b91348d9d755c96d4"} Sep 17 03:24:10.454688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.454680 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clr7km" Sep 17 03:24:10.454854 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.454703 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="172ab6a604d27a42f4d9951b3fea4822656ddc7e4257a98b91348d9d755c96d4" Sep 17 03:24:10.456879 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.456856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" event={"ID":"c45802c7-4ec1-42be-b94d-957cfcca153e","Type":"ContainerDied","Data":"05e6fca5144e1ef5b49001dad2b7b3014f23d4555a6def174a17dcb8221d949e"} Sep 17 03:24:10.456984 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.456887 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6222r" Sep 17 03:24:10.456984 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:10.456896 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05e6fca5144e1ef5b49001dad2b7b3014f23d4555a6def174a17dcb8221d949e" Sep 17 03:24:16.668415 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668380 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs"] Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668744 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerName="util" Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668756 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerName="util" Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668766 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerName="pull" Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668771 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerName="pull" Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668779 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerName="pull" Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668786 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerName="pull" Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668799 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerName="util" Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668805 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerName="util" Sep 17 03:24:16.668808 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668810 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerName="util" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668816 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerName="util" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668821 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerName="pull" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668826 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerName="pull" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668833 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerName="pull" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668837 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerName="pull" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668849 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668854 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668861 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerName="util" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668866 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerName="util" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668870 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668875 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668880 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668885 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668889 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668894 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668942 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffdcb4c3-5eeb-4b30-b776-4c83b1c9bf08" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668951 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c941093f-54b7-4a6e-9a2e-ab9466effc10" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668957 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="42f511bc-bb03-4b7a-8d24-e3aa14b9e9c8" containerName="extract" Sep 17 03:24:16.669076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.668965 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45802c7-4ec1-42be-b94d-957cfcca153e" containerName="extract" Sep 17 03:24:16.673627 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.673609 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:16.676640 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.676607 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qs5tc\"" Sep 17 03:24:16.676746 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.676691 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 03:24:16.677813 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.677795 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 03:24:16.683708 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.683686 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs"] Sep 17 03:24:16.730459 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.730427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfc62\" (UniqueName: \"kubernetes.io/projected/a68f76fa-df47-4f8b-94aa-650fbcf47c59-kube-api-access-dfc62\") pod \"limitador-operator-controller-manager-74495c69f8-bpbrs\" (UID: \"a68f76fa-df47-4f8b-94aa-650fbcf47c59\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:16.831797 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.831759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfc62\" (UniqueName: \"kubernetes.io/projected/a68f76fa-df47-4f8b-94aa-650fbcf47c59-kube-api-access-dfc62\") pod \"limitador-operator-controller-manager-74495c69f8-bpbrs\" (UID: \"a68f76fa-df47-4f8b-94aa-650fbcf47c59\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:16.848293 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.848265 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfc62\" (UniqueName: \"kubernetes.io/projected/a68f76fa-df47-4f8b-94aa-650fbcf47c59-kube-api-access-dfc62\") pod \"limitador-operator-controller-manager-74495c69f8-bpbrs\" (UID: \"a68f76fa-df47-4f8b-94aa-650fbcf47c59\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:16.984603 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:16.984570 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:17.257303 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:17.257278 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs"] Sep 17 03:24:17.259399 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:17.259372 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68f76fa_df47_4f8b_94aa_650fbcf47c59.slice/crio-a8c6be9c4d72468c077daf4ea801440a94e963cacf90ed5c22959da75eef9518 WatchSource:0}: Error finding container a8c6be9c4d72468c077daf4ea801440a94e963cacf90ed5c22959da75eef9518: Status 404 returned error can't find the container with id a8c6be9c4d72468c077daf4ea801440a94e963cacf90ed5c22959da75eef9518 Sep 17 03:24:17.495376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:17.495339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" event={"ID":"a68f76fa-df47-4f8b-94aa-650fbcf47c59","Type":"ContainerStarted","Data":"a8c6be9c4d72468c077daf4ea801440a94e963cacf90ed5c22959da75eef9518"} Sep 17 03:24:18.782739 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:18.782686 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm"] Sep 17 03:24:18.786848 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:18.786824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" Sep 17 03:24:18.790907 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:18.790674 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-l949s\"" Sep 17 03:24:18.791042 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:18.790979 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 17 03:24:18.805080 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:18.805048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm"] Sep 17 03:24:18.847477 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:18.847433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4p7\" (UniqueName: \"kubernetes.io/projected/d517f58d-77ce-4ebd-bf74-af0870241bf2-kube-api-access-vm4p7\") pod \"dns-operator-controller-manager-7b84cd7c9c-2sggm\" (UID: \"d517f58d-77ce-4ebd-bf74-af0870241bf2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" Sep 17 03:24:18.948590 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:18.948554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4p7\" (UniqueName: \"kubernetes.io/projected/d517f58d-77ce-4ebd-bf74-af0870241bf2-kube-api-access-vm4p7\") pod \"dns-operator-controller-manager-7b84cd7c9c-2sggm\" (UID: \"d517f58d-77ce-4ebd-bf74-af0870241bf2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" Sep 17 03:24:18.960689 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:18.960661 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4p7\" (UniqueName: \"kubernetes.io/projected/d517f58d-77ce-4ebd-bf74-af0870241bf2-kube-api-access-vm4p7\") pod \"dns-operator-controller-manager-7b84cd7c9c-2sggm\" (UID: \"d517f58d-77ce-4ebd-bf74-af0870241bf2\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" Sep 17 03:24:19.102907 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:19.102822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" Sep 17 03:24:19.391104 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:19.391068 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm"] Sep 17 03:24:20.253588 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:20.253555 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd517f58d_77ce_4ebd_bf74_af0870241bf2.slice/crio-ea8fab2ef97f5a45ab04c47a3bcb5b1ae69b945c98bb7376bf5e9e2f7d1d8209 WatchSource:0}: Error finding container ea8fab2ef97f5a45ab04c47a3bcb5b1ae69b945c98bb7376bf5e9e2f7d1d8209: Status 404 returned error can't find the container with id ea8fab2ef97f5a45ab04c47a3bcb5b1ae69b945c98bb7376bf5e9e2f7d1d8209 Sep 17 03:24:20.512440 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:20.512351 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" event={"ID":"d517f58d-77ce-4ebd-bf74-af0870241bf2","Type":"ContainerStarted","Data":"ea8fab2ef97f5a45ab04c47a3bcb5b1ae69b945c98bb7376bf5e9e2f7d1d8209"} Sep 17 03:24:20.513968 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:20.513931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" event={"ID":"a68f76fa-df47-4f8b-94aa-650fbcf47c59","Type":"ContainerStarted","Data":"78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d"} Sep 17 03:24:20.514119 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:20.514057 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:20.537408 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:20.537365 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" podStartSLOduration=1.467780597 podStartE2EDuration="4.537350505s" totalImagesPullingTime="3.069569908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:20.536524863 +0000 UTC m=+699.399785963" watchObservedRunningTime="2026-09-17 03:24:20.537350505 +0000 UTC m=+699.400611604" Sep 17 03:24:22.527990 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:22.527949 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" event={"ID":"d517f58d-77ce-4ebd-bf74-af0870241bf2","Type":"ContainerStarted","Data":"cce220aa3d0329ed2d0b9839380eb92c8bf3e2380cb8a2045a057e1dced5b8b8"} Sep 17 03:24:22.528375 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:22.528093 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" Sep 17 03:24:22.546870 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:22.546824 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" podStartSLOduration=2.884696711 podStartE2EDuration="4.546811176s" totalImagesPullingTime="1.662114465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:22.545197655 +0000 UTC m=+701.408458775" watchObservedRunningTime="2026-09-17 03:24:22.546811176 +0000 UTC m=+701.410072276" Sep 17 03:24:23.322142 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.322112 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg"] Sep 17 03:24:23.325673 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.325655 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:23.328596 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.328580 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k4b22\"" Sep 17 03:24:23.340446 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.340423 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg"] Sep 17 03:24:23.387590 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.387561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" (UID: \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:23.387767 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.387624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6jgm\" (UniqueName: \"kubernetes.io/projected/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-kube-api-access-f6jgm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" (UID: \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:23.489054 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.489013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" (UID: \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:23.489228 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.489078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6jgm\" (UniqueName: \"kubernetes.io/projected/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-kube-api-access-f6jgm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" (UID: \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:23.489532 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.489393 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" (UID: \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:23.504261 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.504226 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6jgm\" (UniqueName: \"kubernetes.io/projected/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-kube-api-access-f6jgm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" (UID: \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:23.635068 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.634985 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:23.922767 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:23.922740 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg"] Sep 17 03:24:23.924622 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:23.924588 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b71515_9bba_4fcb_a3d6_a3cd34daacbc.slice/crio-b52cddfc0160b756bdfd86da45347b97646a834636c12a4cb168a76adb645d06 WatchSource:0}: Error finding container b52cddfc0160b756bdfd86da45347b97646a834636c12a4cb168a76adb645d06: Status 404 returned error can't find the container with id b52cddfc0160b756bdfd86da45347b97646a834636c12a4cb168a76adb645d06 Sep 17 03:24:24.542500 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:24.542461 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" event={"ID":"94b71515-9bba-4fcb-a3d6-a3cd34daacbc","Type":"ContainerStarted","Data":"b52cddfc0160b756bdfd86da45347b97646a834636c12a4cb168a76adb645d06"} Sep 17 03:24:28.568445 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:28.568403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" event={"ID":"94b71515-9bba-4fcb-a3d6-a3cd34daacbc","Type":"ContainerStarted","Data":"bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3"} Sep 17 03:24:28.568859 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:28.568489 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:28.592223 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:28.592171 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" podStartSLOduration=1.780313532 podStartE2EDuration="5.592156429s" totalImagesPullingTime="3.811842897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:28.589231568 +0000 UTC m=+707.452492669" watchObservedRunningTime="2026-09-17 03:24:28.592156429 +0000 UTC m=+707.455417528" Sep 17 03:24:30.577490 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.577451 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk"] Sep 17 03:24:30.580898 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.580875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:30.583836 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.583816 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 17 03:24:30.583947 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.583840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9thlg\"" Sep 17 03:24:30.583947 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.583819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 17 03:24:30.590248 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.590229 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk"] Sep 17 03:24:30.653757 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.653719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:30.653916 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.653776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:30.653916 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.653888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq524\" (UniqueName: \"kubernetes.io/projected/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-kube-api-access-kq524\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:30.754824 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.754777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:30.755002 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.754837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:30.755002 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.754913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq524\" (UniqueName: \"kubernetes.io/projected/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-kube-api-access-kq524\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:30.755002 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:30.754940 2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 17 03:24:30.755161 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:30.755030 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert podName:ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a nodeName:}" failed. No retries permitted until 2026-09-17 03:24:31.255006884 +0000 UTC m=+710.118267965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-6qrmk" (UID: "ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a") : secret "plugin-serving-cert" not found Sep 17 03:24:30.755542 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.755520 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:30.765877 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:30.765849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq524\" (UniqueName: \"kubernetes.io/projected/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-kube-api-access-kq524\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:31.260925 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:31.260885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:31.261141 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:31.261041 2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 17 03:24:31.261141 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:31.261104 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert podName:ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a nodeName:}" failed. No retries permitted until 2026-09-17 03:24:32.261087961 +0000 UTC m=+711.124349051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-6qrmk" (UID: "ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a") : secret "plugin-serving-cert" not found Sep 17 03:24:31.523543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:31.523458 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:32.270611 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:32.270575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:32.273141 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:32.273115 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6qrmk\" (UID: \"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:32.390881 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:32.390851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" Sep 17 03:24:32.665401 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:32.665370 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk"] Sep 17 03:24:32.666432 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:32.666405 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffb8f32c_83a1_4a82_b25e_5a2da6ad6c0a.slice/crio-98c732647db1c42714fdd08b470d2bd635327d17c1d55bb1ec5491473754bfaf WatchSource:0}: Error finding container 98c732647db1c42714fdd08b470d2bd635327d17c1d55bb1ec5491473754bfaf: Status 404 returned error can't find the container with id 98c732647db1c42714fdd08b470d2bd635327d17c1d55bb1ec5491473754bfaf Sep 17 03:24:33.538903 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:33.538869 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2sggm" Sep 17 03:24:33.611364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:33.611295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" event={"ID":"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a","Type":"ContainerStarted","Data":"98c732647db1c42714fdd08b470d2bd635327d17c1d55bb1ec5491473754bfaf"} Sep 17 03:24:37.629972 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:37.629880 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" event={"ID":"ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a","Type":"ContainerStarted","Data":"7e1fef883487c8a41402cc3e9a9cc40db5cbca5a188ccd1ff7a6735db8aeffae"} Sep 17 03:24:37.647485 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:37.647435 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6qrmk" podStartSLOduration=3.0340888010000002 podStartE2EDuration="7.647422065s" totalImagesPullingTime="4.613333264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:37.646470724 +0000 UTC m=+716.509731825" watchObservedRunningTime="2026-09-17 03:24:37.647422065 +0000 UTC m=+716.510683164" Sep 17 03:24:39.576330 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:39.576297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:40.716424 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.716392 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6"] Sep 17 03:24:40.721417 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.721392 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:40.736457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.736429 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6"] Sep 17 03:24:40.822313 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.822275 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6"] Sep 17 03:24:40.822594 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:40.822570 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-xf6gb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" podUID="56268448-220b-49d9-96ce-b8e8b2a368ff" Sep 17 03:24:40.849952 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.849910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6gb\" (UniqueName: \"kubernetes.io/projected/56268448-220b-49d9-96ce-b8e8b2a368ff-kube-api-access-xf6gb\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-kqzf6\" (UID: \"56268448-220b-49d9-96ce-b8e8b2a368ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:40.850053 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.849956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56268448-220b-49d9-96ce-b8e8b2a368ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-kqzf6\" (UID: \"56268448-220b-49d9-96ce-b8e8b2a368ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:40.950910 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.950872 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56268448-220b-49d9-96ce-b8e8b2a368ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-kqzf6\" (UID: \"56268448-220b-49d9-96ce-b8e8b2a368ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:40.951097 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.950993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6gb\" (UniqueName: \"kubernetes.io/projected/56268448-220b-49d9-96ce-b8e8b2a368ff-kube-api-access-xf6gb\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-kqzf6\" (UID: \"56268448-220b-49d9-96ce-b8e8b2a368ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:40.951316 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.951292 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56268448-220b-49d9-96ce-b8e8b2a368ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-kqzf6\" (UID: \"56268448-220b-49d9-96ce-b8e8b2a368ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:40.964273 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:40.964244 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6gb\" (UniqueName: \"kubernetes.io/projected/56268448-220b-49d9-96ce-b8e8b2a368ff-kube-api-access-xf6gb\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-kqzf6\" (UID: \"56268448-220b-49d9-96ce-b8e8b2a368ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:41.657856 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.657821 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:41.665416 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.665392 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:41.729395 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.729363 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6"] Sep 17 03:24:41.734570 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.734536 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6"] Sep 17 03:24:41.747924 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.747894 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg"] Sep 17 03:24:41.748107 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.748082 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" containerName="manager" containerID="cri-o://bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3" gracePeriod=2 Sep 17 03:24:41.757732 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.757706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf6gb\" (UniqueName: \"kubernetes.io/projected/56268448-220b-49d9-96ce-b8e8b2a368ff-kube-api-access-xf6gb\") pod \"56268448-220b-49d9-96ce-b8e8b2a368ff\" (UID: \"56268448-220b-49d9-96ce-b8e8b2a368ff\") " Sep 17 03:24:41.757974 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.757950 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56268448-220b-49d9-96ce-b8e8b2a368ff-extensions-socket-volume\") pod \"56268448-220b-49d9-96ce-b8e8b2a368ff\" (UID: \"56268448-220b-49d9-96ce-b8e8b2a368ff\") " Sep 17 03:24:41.758274 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.758250 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56268448-220b-49d9-96ce-b8e8b2a368ff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "56268448-220b-49d9-96ce-b8e8b2a368ff" (UID: "56268448-220b-49d9-96ce-b8e8b2a368ff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:41.760522 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.760494 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56268448-220b-49d9-96ce-b8e8b2a368ff-kube-api-access-xf6gb" (OuterVolumeSpecName: "kube-api-access-xf6gb") pod "56268448-220b-49d9-96ce-b8e8b2a368ff" (UID: "56268448-220b-49d9-96ce-b8e8b2a368ff"). InnerVolumeSpecName "kube-api-access-xf6gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:41.763283 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.763260 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg"] Sep 17 03:24:41.774856 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:41.774729 2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-slwxg\": pods \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:41.780790 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.780766 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs"] Sep 17 03:24:41.781012 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.780970 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" containerName="manager" containerID="cri-o://78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d" gracePeriod=2 Sep 17 03:24:41.790919 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.790893 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs"] Sep 17 03:24:41.793316 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:41.793284 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:41.793419 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.793328 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x"] Sep 17 03:24:41.793703 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.793689 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" containerName="manager" Sep 17 03:24:41.793755 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.793704 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" containerName="manager" Sep 17 03:24:41.793755 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.793713 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" containerName="manager" Sep 17 03:24:41.793755 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.793719 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" containerName="manager" Sep 17 03:24:41.793850 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.793788 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" containerName="manager" Sep 17 03:24:41.793850 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.793800 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" containerName="manager" Sep 17 03:24:41.796936 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.796918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:41.799729 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:41.799705 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bpbrs\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:41.802201 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:41.802174 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:41.813060 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.813038 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x"] Sep 17 03:24:41.816643 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.816609 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs"] Sep 17 03:24:41.820711 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.820691 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" Sep 17 03:24:41.830553 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.830517 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs"] Sep 17 03:24:41.832544 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:41.832508 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bpbrs\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:41.852267 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:41.852235 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:41.858624 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.858602 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf6gb\" (UniqueName: \"kubernetes.io/projected/56268448-220b-49d9-96ce-b8e8b2a368ff-kube-api-access-xf6gb\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:41.858739 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.858659 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56268448-220b-49d9-96ce-b8e8b2a368ff-extensions-socket-volume\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:41.959342 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.959311 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jksjp\" (UniqueName: \"kubernetes.io/projected/daaf4c6d-3339-40d8-b72f-6deea7036546-kube-api-access-jksjp\") pod \"limitador-operator-controller-manager-74495c69f8-vplcs\" (UID: \"daaf4c6d-3339-40d8-b72f-6deea7036546\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" Sep 17 03:24:41.959411 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.959361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/834b3014-187d-4ea6-91e8-65519d7caf70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ws62x\" (UID: \"834b3014-187d-4ea6-91e8-65519d7caf70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:41.959457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:41.959425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhhhq\" (UniqueName: \"kubernetes.io/projected/834b3014-187d-4ea6-91e8-65519d7caf70-kube-api-access-dhhhq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ws62x\" (UID: \"834b3014-187d-4ea6-91e8-65519d7caf70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:42.031457 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.031429 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:42.034225 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.034184 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bpbrs\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:42.034361 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.034320 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:42.036505 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.036481 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:42.038831 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.038804 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:42.041231 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.041207 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bpbrs\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:42.060422 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.060401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jksjp\" (UniqueName: \"kubernetes.io/projected/daaf4c6d-3339-40d8-b72f-6deea7036546-kube-api-access-jksjp\") pod \"limitador-operator-controller-manager-74495c69f8-vplcs\" (UID: \"daaf4c6d-3339-40d8-b72f-6deea7036546\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" Sep 17 03:24:42.060508 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.060430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/834b3014-187d-4ea6-91e8-65519d7caf70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ws62x\" (UID: \"834b3014-187d-4ea6-91e8-65519d7caf70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:42.060508 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.060447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhhhq\" (UniqueName: \"kubernetes.io/projected/834b3014-187d-4ea6-91e8-65519d7caf70-kube-api-access-dhhhq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ws62x\" (UID: \"834b3014-187d-4ea6-91e8-65519d7caf70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:42.060770 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.060751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/834b3014-187d-4ea6-91e8-65519d7caf70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ws62x\" (UID: \"834b3014-187d-4ea6-91e8-65519d7caf70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:42.068858 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.068833 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jksjp\" (UniqueName: \"kubernetes.io/projected/daaf4c6d-3339-40d8-b72f-6deea7036546-kube-api-access-jksjp\") pod \"limitador-operator-controller-manager-74495c69f8-vplcs\" (UID: \"daaf4c6d-3339-40d8-b72f-6deea7036546\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" Sep 17 03:24:42.068998 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.068977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhhhq\" (UniqueName: \"kubernetes.io/projected/834b3014-187d-4ea6-91e8-65519d7caf70-kube-api-access-dhhhq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ws62x\" (UID: \"834b3014-187d-4ea6-91e8-65519d7caf70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:42.161092 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.161059 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-extensions-socket-volume\") pod \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\" (UID: \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\") " Sep 17 03:24:42.161243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.161139 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6jgm\" (UniqueName: \"kubernetes.io/projected/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-kube-api-access-f6jgm\") pod \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\" (UID: \"94b71515-9bba-4fcb-a3d6-a3cd34daacbc\") " Sep 17 03:24:42.161243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.161159 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfc62\" (UniqueName: \"kubernetes.io/projected/a68f76fa-df47-4f8b-94aa-650fbcf47c59-kube-api-access-dfc62\") pod \"a68f76fa-df47-4f8b-94aa-650fbcf47c59\" (UID: \"a68f76fa-df47-4f8b-94aa-650fbcf47c59\") " Sep 17 03:24:42.161477 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.161453 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94b71515-9bba-4fcb-a3d6-a3cd34daacbc" (UID: "94b71515-9bba-4fcb-a3d6-a3cd34daacbc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:42.163346 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.163324 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a68f76fa-df47-4f8b-94aa-650fbcf47c59-kube-api-access-dfc62" (OuterVolumeSpecName: "kube-api-access-dfc62") pod "a68f76fa-df47-4f8b-94aa-650fbcf47c59" (UID: "a68f76fa-df47-4f8b-94aa-650fbcf47c59"). InnerVolumeSpecName "kube-api-access-dfc62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:42.163413 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.163353 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-kube-api-access-f6jgm" (OuterVolumeSpecName: "kube-api-access-f6jgm") pod "94b71515-9bba-4fcb-a3d6-a3cd34daacbc" (UID: "94b71515-9bba-4fcb-a3d6-a3cd34daacbc"). InnerVolumeSpecName "kube-api-access-f6jgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:42.181533 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.181513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:42.189766 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.189737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" Sep 17 03:24:42.262802 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.262774 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-extensions-socket-volume\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:42.262802 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.262800 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6jgm\" (UniqueName: \"kubernetes.io/projected/94b71515-9bba-4fcb-a3d6-a3cd34daacbc-kube-api-access-f6jgm\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:42.262961 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.262810 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfc62\" (UniqueName: \"kubernetes.io/projected/a68f76fa-df47-4f8b-94aa-650fbcf47c59-kube-api-access-dfc62\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:42.467194 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.467168 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x"] Sep 17 03:24:42.469057 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:42.469028 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834b3014_187d_4ea6_91e8_65519d7caf70.slice/crio-442ad1397aa8150c6183652ee5543b96c2fd78259aa0e62f5001566b7f930224 WatchSource:0}: Error finding container 442ad1397aa8150c6183652ee5543b96c2fd78259aa0e62f5001566b7f930224: Status 404 returned error can't find the container with id 442ad1397aa8150c6183652ee5543b96c2fd78259aa0e62f5001566b7f930224 Sep 17 03:24:42.473758 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.473736 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs"] Sep 17 03:24:42.474579 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:42.474556 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaaf4c6d_3339_40d8_b72f_6deea7036546.slice/crio-3593a586cf87b54fa5374644efd524c987ee20bd11d7618104a4101e621241da WatchSource:0}: Error finding container 3593a586cf87b54fa5374644efd524c987ee20bd11d7618104a4101e621241da: Status 404 returned error can't find the container with id 3593a586cf87b54fa5374644efd524c987ee20bd11d7618104a4101e621241da Sep 17 03:24:42.665658 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.665597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" event={"ID":"834b3014-187d-4ea6-91e8-65519d7caf70","Type":"ContainerStarted","Data":"f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5"} Sep 17 03:24:42.665843 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.665696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" event={"ID":"834b3014-187d-4ea6-91e8-65519d7caf70","Type":"ContainerStarted","Data":"442ad1397aa8150c6183652ee5543b96c2fd78259aa0e62f5001566b7f930224"} Sep 17 03:24:42.665843 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.665735 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:42.667052 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.667016 2562 generic.go:356] "Generic (PLEG): container finished" podID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" containerID="78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d" exitCode=0 Sep 17 03:24:42.667192 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.667057 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:42.667192 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.667110 2562 scope.go:117] "RemoveContainer" containerID="78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d" Sep 17 03:24:42.668432 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.668390 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bpbrs\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:42.668594 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.668574 2562 generic.go:356] "Generic (PLEG): container finished" podID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" containerID="bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3" exitCode=0 Sep 17 03:24:42.668687 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.668649 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:42.670531 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.670496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" event={"ID":"daaf4c6d-3339-40d8-b72f-6deea7036546","Type":"ContainerStarted","Data":"50920dd4e272cb8ccf18c63cb807e28c08a48e48456a94d297c70c60eea344f8"} Sep 17 03:24:42.670701 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.670548 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" Sep 17 03:24:42.670701 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.670567 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" event={"ID":"daaf4c6d-3339-40d8-b72f-6deea7036546","Type":"ContainerStarted","Data":"3593a586cf87b54fa5374644efd524c987ee20bd11d7618104a4101e621241da"} Sep 17 03:24:42.670701 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.670595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:42.670701 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.670622 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:42.677239 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.677219 2562 scope.go:117] "RemoveContainer" containerID="78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d" Sep 17 03:24:42.678116 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.677907 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d\": container with ID starting with 78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d not found: ID does not exist" containerID="78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d" Sep 17 03:24:42.678116 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.677945 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d"} err="failed to get container status \"78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d\": rpc error: code = NotFound desc = could not find container \"78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d\": container with ID starting with 78893ffbf86ac58c7b9f309e726157a0a9def5bcffd2cd109530dbbb8c8e777d not found: ID does not exist" Sep 17 03:24:42.678116 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.677969 2562 scope.go:117] "RemoveContainer" containerID="bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3" Sep 17 03:24:42.688498 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.688479 2562 scope.go:117] "RemoveContainer" containerID="bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3" Sep 17 03:24:42.688812 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.688794 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3\": container with ID starting with bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3 not found: ID does not exist" containerID="bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3" Sep 17 03:24:42.688876 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.688820 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3"} err="failed to get container status \"bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3\": rpc error: code = NotFound desc = could not find container \"bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3\": container with ID starting with bdd64d95e69d6f84d7f9c029eb6887717ddf94c30a942a43dadddfb928de41d3 not found: ID does not exist" Sep 17 03:24:42.691934 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.691895 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" podStartSLOduration=1.691880554 podStartE2EDuration="1.691880554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:42.690218367 +0000 UTC m=+721.553479466" watchObservedRunningTime="2026-09-17 03:24:42.691880554 +0000 UTC m=+721.555141652" Sep 17 03:24:42.692839 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.692807 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-slwxg\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-slwxg" Sep 17 03:24:42.695126 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.695098 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-kqzf6\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="56268448-220b-49d9-96ce-b8e8b2a368ff" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-kqzf6" Sep 17 03:24:42.697293 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:42.697270 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-bpbrs\" is forbidden: User \"system:node:ip-10-0-141-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-44.ec2.internal' and this object" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-bpbrs" Sep 17 03:24:42.718495 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:42.718419 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" podStartSLOduration=1.7184045079999999 podStartE2EDuration="1.718404508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:42.717652061 +0000 UTC m=+721.580913157" watchObservedRunningTime="2026-09-17 03:24:42.718404508 +0000 UTC m=+721.581665606" Sep 17 03:24:43.607646 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:43.607605 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56268448-220b-49d9-96ce-b8e8b2a368ff" path="/var/lib/kubelet/pods/56268448-220b-49d9-96ce-b8e8b2a368ff/volumes" Sep 17 03:24:43.608096 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:43.607898 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b71515-9bba-4fcb-a3d6-a3cd34daacbc" path="/var/lib/kubelet/pods/94b71515-9bba-4fcb-a3d6-a3cd34daacbc/volumes" Sep 17 03:24:43.608197 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:43.608184 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a68f76fa-df47-4f8b-94aa-650fbcf47c59" path="/var/lib/kubelet/pods/a68f76fa-df47-4f8b-94aa-650fbcf47c59/volumes" Sep 17 03:24:53.686716 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:53.686679 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:53.687217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:53.686762 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vplcs" Sep 17 03:24:57.772673 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:57.772624 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x"] Sep 17 03:24:57.773142 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:57.772837 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" podUID="834b3014-187d-4ea6-91e8-65519d7caf70" containerName="manager" containerID="cri-o://f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5" gracePeriod=10 Sep 17 03:24:58.020015 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.019991 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:58.078548 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.078458 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2"] Sep 17 03:24:58.079054 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.079032 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="834b3014-187d-4ea6-91e8-65519d7caf70" containerName="manager" Sep 17 03:24:58.079105 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.079058 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="834b3014-187d-4ea6-91e8-65519d7caf70" containerName="manager" Sep 17 03:24:58.079205 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.079185 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="834b3014-187d-4ea6-91e8-65519d7caf70" containerName="manager" Sep 17 03:24:58.083073 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.083051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.094451 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.094425 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2"] Sep 17 03:24:58.105910 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.105879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvnt6\" (UniqueName: \"kubernetes.io/projected/2db7ccc5-9144-441d-bf95-d228d3137720-kube-api-access-bvnt6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6kq2\" (UID: \"2db7ccc5-9144-441d-bf95-d228d3137720\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.106016 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.105920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2db7ccc5-9144-441d-bf95-d228d3137720-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6kq2\" (UID: \"2db7ccc5-9144-441d-bf95-d228d3137720\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.206364 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.206335 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/834b3014-187d-4ea6-91e8-65519d7caf70-extensions-socket-volume\") pod \"834b3014-187d-4ea6-91e8-65519d7caf70\" (UID: \"834b3014-187d-4ea6-91e8-65519d7caf70\") " Sep 17 03:24:58.206564 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.206389 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhhhq\" (UniqueName: \"kubernetes.io/projected/834b3014-187d-4ea6-91e8-65519d7caf70-kube-api-access-dhhhq\") pod \"834b3014-187d-4ea6-91e8-65519d7caf70\" (UID: \"834b3014-187d-4ea6-91e8-65519d7caf70\") " Sep 17 03:24:58.206648 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.206595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvnt6\" (UniqueName: \"kubernetes.io/projected/2db7ccc5-9144-441d-bf95-d228d3137720-kube-api-access-bvnt6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6kq2\" (UID: \"2db7ccc5-9144-441d-bf95-d228d3137720\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.206716 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.206673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2db7ccc5-9144-441d-bf95-d228d3137720-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6kq2\" (UID: \"2db7ccc5-9144-441d-bf95-d228d3137720\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.206761 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.206708 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/834b3014-187d-4ea6-91e8-65519d7caf70-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "834b3014-187d-4ea6-91e8-65519d7caf70" (UID: "834b3014-187d-4ea6-91e8-65519d7caf70"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:58.207027 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.207008 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2db7ccc5-9144-441d-bf95-d228d3137720-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6kq2\" (UID: \"2db7ccc5-9144-441d-bf95-d228d3137720\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.208544 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.208523 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834b3014-187d-4ea6-91e8-65519d7caf70-kube-api-access-dhhhq" (OuterVolumeSpecName: "kube-api-access-dhhhq") pod "834b3014-187d-4ea6-91e8-65519d7caf70" (UID: "834b3014-187d-4ea6-91e8-65519d7caf70"). InnerVolumeSpecName "kube-api-access-dhhhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:58.215155 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.215133 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvnt6\" (UniqueName: \"kubernetes.io/projected/2db7ccc5-9144-441d-bf95-d228d3137720-kube-api-access-bvnt6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-d6kq2\" (UID: \"2db7ccc5-9144-441d-bf95-d228d3137720\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.307742 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.307704 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/834b3014-187d-4ea6-91e8-65519d7caf70-extensions-socket-volume\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:58.307742 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.307733 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhhhq\" (UniqueName: \"kubernetes.io/projected/834b3014-187d-4ea6-91e8-65519d7caf70-kube-api-access-dhhhq\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:24:58.394864 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.394775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.677301 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.677272 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2"] Sep 17 03:24:58.678483 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:24:58.678451 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db7ccc5_9144_441d_bf95_d228d3137720.slice/crio-26965d2f43d464655f8a2c2832142188a269f24cb5a6cc593a3d09c5b63b65fa WatchSource:0}: Error finding container 26965d2f43d464655f8a2c2832142188a269f24cb5a6cc593a3d09c5b63b65fa: Status 404 returned error can't find the container with id 26965d2f43d464655f8a2c2832142188a269f24cb5a6cc593a3d09c5b63b65fa Sep 17 03:24:58.771541 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.771506 2562 generic.go:356] "Generic (PLEG): container finished" podID="834b3014-187d-4ea6-91e8-65519d7caf70" containerID="f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5" exitCode=0 Sep 17 03:24:58.771687 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.771552 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" Sep 17 03:24:58.771687 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.771583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" event={"ID":"834b3014-187d-4ea6-91e8-65519d7caf70","Type":"ContainerDied","Data":"f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5"} Sep 17 03:24:58.771687 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.771651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x" event={"ID":"834b3014-187d-4ea6-91e8-65519d7caf70","Type":"ContainerDied","Data":"442ad1397aa8150c6183652ee5543b96c2fd78259aa0e62f5001566b7f930224"} Sep 17 03:24:58.771687 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.771677 2562 scope.go:117] "RemoveContainer" containerID="f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5" Sep 17 03:24:58.773686 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.773658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" event={"ID":"2db7ccc5-9144-441d-bf95-d228d3137720","Type":"ContainerStarted","Data":"b0790123289cbdfe68f4ccb9c1b0f963f6c2da7e324708484ded0ffba73bbee5"} Sep 17 03:24:58.774052 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.773706 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" event={"ID":"2db7ccc5-9144-441d-bf95-d228d3137720","Type":"ContainerStarted","Data":"26965d2f43d464655f8a2c2832142188a269f24cb5a6cc593a3d09c5b63b65fa"} Sep 17 03:24:58.774052 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.773741 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:24:58.780919 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.780773 2562 scope.go:117] "RemoveContainer" containerID="f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5" Sep 17 03:24:58.781055 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:24:58.781037 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5\": container with ID starting with f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5 not found: ID does not exist" containerID="f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5" Sep 17 03:24:58.781098 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.781063 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5"} err="failed to get container status \"f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5\": rpc error: code = NotFound desc = could not find container \"f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5\": container with ID starting with f39459e4d1a584b3bc58c711fcae336ddaec3ea34be91d5e6886ccdd20bf04f5 not found: ID does not exist" Sep 17 03:24:58.809324 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.809281 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" podStartSLOduration=0.809268659 podStartE2EDuration="809.268659ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:24:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:24:58.806552742 +0000 UTC m=+737.669813841" watchObservedRunningTime="2026-09-17 03:24:58.809268659 +0000 UTC m=+737.672529757" Sep 17 03:24:58.830933 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.830892 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x"] Sep 17 03:24:58.832121 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:58.832097 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ws62x"] Sep 17 03:24:59.608468 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:24:59.608436 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="834b3014-187d-4ea6-91e8-65519d7caf70" path="/var/lib/kubelet/pods/834b3014-187d-4ea6-91e8-65519d7caf70/volumes" Sep 17 03:25:09.783108 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:09.783076 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-d6kq2" Sep 17 03:25:14.245829 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.245792 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85"] Sep 17 03:25:14.269019 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.268972 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85"] Sep 17 03:25:14.269212 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.269025 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.272069 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.272048 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ljdw2\"" Sep 17 03:25:14.355699 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.355669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.355882 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.355725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.355882 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.355834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.355882 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.355878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.356024 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.355933 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.356024 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.355952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.356024 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.355968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jxqp\" (UniqueName: \"kubernetes.io/projected/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-kube-api-access-7jxqp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.356024 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.355990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.356024 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.356017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.456979 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.456943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.456979 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.456982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457290 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457290 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457290 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457290 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457290 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457290 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jxqp\" (UniqueName: \"kubernetes.io/projected/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-kube-api-access-7jxqp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457290 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457611 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457611 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457415 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457611 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457532 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457796 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457778 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.457975 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.457951 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.459468 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.459449 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.459696 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.459681 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.465760 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.465739 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.465865 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.465796 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jxqp\" (UniqueName: \"kubernetes.io/projected/098edb2d-882e-45b6-aa9a-8d8dbd9fb729-kube-api-access-7jxqp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-n2b85\" (UID: \"098edb2d-882e-45b6-aa9a-8d8dbd9fb729\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.583948 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.583861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:14.859255 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.859217 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85"] Sep 17 03:25:14.860436 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:25:14.860405 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098edb2d_882e_45b6_aa9a_8d8dbd9fb729.slice/crio-0ea5ca35d1ada4caa38770958bb8e58d6fc6b0cbc5832722c0e2b1eb934e70db WatchSource:0}: Error finding container 0ea5ca35d1ada4caa38770958bb8e58d6fc6b0cbc5832722c0e2b1eb934e70db: Status 404 returned error can't find the container with id 0ea5ca35d1ada4caa38770958bb8e58d6fc6b0cbc5832722c0e2b1eb934e70db Sep 17 03:25:14.862667 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.862603 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:25:14.862752 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.862733 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:25:14.862800 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.862769 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:25:14.876475 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:14.876451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" event={"ID":"098edb2d-882e-45b6-aa9a-8d8dbd9fb729","Type":"ContainerStarted","Data":"0ea5ca35d1ada4caa38770958bb8e58d6fc6b0cbc5832722c0e2b1eb934e70db"} Sep 17 03:25:15.883788 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:15.883752 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" event={"ID":"098edb2d-882e-45b6-aa9a-8d8dbd9fb729","Type":"ContainerStarted","Data":"75fb67c85dd4b588417428581d447ff55edd3b1dc4c54cec5caaa737752427a5"} Sep 17 03:25:15.906997 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:15.906943 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" podStartSLOduration=1.9069273519999999 podStartE2EDuration="1.906927352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:25:15.903471205 +0000 UTC m=+754.766732318" watchObservedRunningTime="2026-09-17 03:25:15.906927352 +0000 UTC m=+754.770188450" Sep 17 03:25:16.584774 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:16.584735 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:16.589426 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:16.589400 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:16.890036 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:16.889944 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:16.890910 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:16.890889 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:25:27.620075 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.620041 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kpflv"] Sep 17 03:25:27.624550 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.624532 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:27.627458 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.627422 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 17 03:25:27.630827 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.630804 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kpflv"] Sep 17 03:25:27.721848 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.721816 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kpflv"] Sep 17 03:25:27.774725 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.774692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bt29\" (UniqueName: \"kubernetes.io/projected/d95b5485-d53a-46ab-9d6f-9a270d93ca23-kube-api-access-4bt29\") pod \"limitador-limitador-8588749977-kpflv\" (UID: \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\") " pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:27.774888 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.774849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d95b5485-d53a-46ab-9d6f-9a270d93ca23-config-file\") pod \"limitador-limitador-8588749977-kpflv\" (UID: \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\") " pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:27.876257 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.876172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d95b5485-d53a-46ab-9d6f-9a270d93ca23-config-file\") pod \"limitador-limitador-8588749977-kpflv\" (UID: \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\") " pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:27.876399 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.876332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bt29\" (UniqueName: \"kubernetes.io/projected/d95b5485-d53a-46ab-9d6f-9a270d93ca23-kube-api-access-4bt29\") pod \"limitador-limitador-8588749977-kpflv\" (UID: \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\") " pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:27.876863 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.876843 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d95b5485-d53a-46ab-9d6f-9a270d93ca23-config-file\") pod \"limitador-limitador-8588749977-kpflv\" (UID: \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\") " pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:27.885619 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.885591 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bt29\" (UniqueName: \"kubernetes.io/projected/d95b5485-d53a-46ab-9d6f-9a270d93ca23-kube-api-access-4bt29\") pod \"limitador-limitador-8588749977-kpflv\" (UID: \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\") " pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:27.936475 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:27.936432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:28.211023 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:28.210992 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kpflv"] Sep 17 03:25:28.212856 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:25:28.212831 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95b5485_d53a_46ab_9d6f_9a270d93ca23.slice/crio-7f56c0599366bd36aadc1bfd1e88a946eae073b4dcbd63765504ea61c01da272 WatchSource:0}: Error finding container 7f56c0599366bd36aadc1bfd1e88a946eae073b4dcbd63765504ea61c01da272: Status 404 returned error can't find the container with id 7f56c0599366bd36aadc1bfd1e88a946eae073b4dcbd63765504ea61c01da272 Sep 17 03:25:28.959781 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:28.959748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" event={"ID":"d95b5485-d53a-46ab-9d6f-9a270d93ca23","Type":"ContainerStarted","Data":"7f56c0599366bd36aadc1bfd1e88a946eae073b4dcbd63765504ea61c01da272"} Sep 17 03:25:29.967225 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:29.967185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" event={"ID":"d95b5485-d53a-46ab-9d6f-9a270d93ca23","Type":"ContainerStarted","Data":"7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b"} Sep 17 03:25:29.967647 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:29.967343 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:29.987076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:29.986998 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" podStartSLOduration=1.8699639160000001 podStartE2EDuration="2.98697806s" totalImagesPullingTime="1.117014144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:25:29.983059097 +0000 UTC m=+768.846320208" watchObservedRunningTime="2026-09-17 03:25:29.98697806 +0000 UTC m=+768.850239160" Sep 17 03:25:40.916854 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:40.916818 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kpflv"] Sep 17 03:25:40.917412 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:40.917014 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" podUID="d95b5485-d53a-46ab-9d6f-9a270d93ca23" containerName="limitador" containerID="cri-o://7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b" gracePeriod=30 Sep 17 03:25:40.917885 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:40.917864 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:41.868153 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:41.868123 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:41.888219 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:41.888187 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bt29\" (UniqueName: \"kubernetes.io/projected/d95b5485-d53a-46ab-9d6f-9a270d93ca23-kube-api-access-4bt29\") pod \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\" (UID: \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\") " Sep 17 03:25:41.888404 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:41.888272 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d95b5485-d53a-46ab-9d6f-9a270d93ca23-config-file\") pod \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\" (UID: \"d95b5485-d53a-46ab-9d6f-9a270d93ca23\") " Sep 17 03:25:41.888713 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:41.888679 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d95b5485-d53a-46ab-9d6f-9a270d93ca23-config-file" (OuterVolumeSpecName: "config-file") pod "d95b5485-d53a-46ab-9d6f-9a270d93ca23" (UID: "d95b5485-d53a-46ab-9d6f-9a270d93ca23"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:25:41.890805 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:41.890773 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d95b5485-d53a-46ab-9d6f-9a270d93ca23-kube-api-access-4bt29" (OuterVolumeSpecName: "kube-api-access-4bt29") pod "d95b5485-d53a-46ab-9d6f-9a270d93ca23" (UID: "d95b5485-d53a-46ab-9d6f-9a270d93ca23"). InnerVolumeSpecName "kube-api-access-4bt29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:25:41.989072 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:41.989045 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bt29\" (UniqueName: \"kubernetes.io/projected/d95b5485-d53a-46ab-9d6f-9a270d93ca23-kube-api-access-4bt29\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:25:41.989072 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:41.989070 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d95b5485-d53a-46ab-9d6f-9a270d93ca23-config-file\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:25:42.037453 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.037420 2562 generic.go:356] "Generic (PLEG): container finished" podID="d95b5485-d53a-46ab-9d6f-9a270d93ca23" containerID="7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b" exitCode=0 Sep 17 03:25:42.037671 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.037465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" event={"ID":"d95b5485-d53a-46ab-9d6f-9a270d93ca23","Type":"ContainerDied","Data":"7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b"} Sep 17 03:25:42.037671 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.037506 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" event={"ID":"d95b5485-d53a-46ab-9d6f-9a270d93ca23","Type":"ContainerDied","Data":"7f56c0599366bd36aadc1bfd1e88a946eae073b4dcbd63765504ea61c01da272"} Sep 17 03:25:42.037671 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.037528 2562 scope.go:117] "RemoveContainer" containerID="7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b" Sep 17 03:25:42.037671 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.037466 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-kpflv" Sep 17 03:25:42.047535 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.047515 2562 scope.go:117] "RemoveContainer" containerID="7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b" Sep 17 03:25:42.047855 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:25:42.047835 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b\": container with ID starting with 7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b not found: ID does not exist" containerID="7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b" Sep 17 03:25:42.047939 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.047864 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b"} err="failed to get container status \"7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b\": rpc error: code = NotFound desc = could not find container \"7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b\": container with ID starting with 7e9dc9b3decb403d3114b76e87df1a738e6da1c29224a71020842f262f79788b not found: ID does not exist" Sep 17 03:25:42.060575 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.060547 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kpflv"] Sep 17 03:25:42.064170 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:42.064147 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-kpflv"] Sep 17 03:25:43.608105 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.608072 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d95b5485-d53a-46ab-9d6f-9a270d93ca23" path="/var/lib/kubelet/pods/d95b5485-d53a-46ab-9d6f-9a270d93ca23/volumes" Sep 17 03:25:43.833054 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.833021 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd"] Sep 17 03:25:43.833401 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.833389 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d95b5485-d53a-46ab-9d6f-9a270d93ca23" containerName="limitador" Sep 17 03:25:43.833449 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.833403 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d95b5485-d53a-46ab-9d6f-9a270d93ca23" containerName="limitador" Sep 17 03:25:43.833484 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.833467 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d95b5485-d53a-46ab-9d6f-9a270d93ca23" containerName="limitador" Sep 17 03:25:43.837913 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.837892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:43.840867 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.840848 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bmhn9\"" Sep 17 03:25:43.841005 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.840863 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 17 03:25:43.841095 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.841082 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 17 03:25:43.842553 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.842535 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 17 03:25:43.848491 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.848471 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd"] Sep 17 03:25:43.905886 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.905794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/54a8e2e9-7ac5-4b4f-99de-12f539adb0fd-data\") pod \"postgres-69fb4594cf-9rvfd\" (UID: \"54a8e2e9-7ac5-4b4f-99de-12f539adb0fd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:43.905886 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:43.905875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kz6r\" (UniqueName: \"kubernetes.io/projected/54a8e2e9-7ac5-4b4f-99de-12f539adb0fd-kube-api-access-4kz6r\") pod \"postgres-69fb4594cf-9rvfd\" (UID: \"54a8e2e9-7ac5-4b4f-99de-12f539adb0fd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:44.006475 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:44.006441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kz6r\" (UniqueName: \"kubernetes.io/projected/54a8e2e9-7ac5-4b4f-99de-12f539adb0fd-kube-api-access-4kz6r\") pod \"postgres-69fb4594cf-9rvfd\" (UID: \"54a8e2e9-7ac5-4b4f-99de-12f539adb0fd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:44.006670 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:44.006504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/54a8e2e9-7ac5-4b4f-99de-12f539adb0fd-data\") pod \"postgres-69fb4594cf-9rvfd\" (UID: \"54a8e2e9-7ac5-4b4f-99de-12f539adb0fd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:44.006926 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:44.006908 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/54a8e2e9-7ac5-4b4f-99de-12f539adb0fd-data\") pod \"postgres-69fb4594cf-9rvfd\" (UID: \"54a8e2e9-7ac5-4b4f-99de-12f539adb0fd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:44.015773 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:44.015751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kz6r\" (UniqueName: \"kubernetes.io/projected/54a8e2e9-7ac5-4b4f-99de-12f539adb0fd-kube-api-access-4kz6r\") pod \"postgres-69fb4594cf-9rvfd\" (UID: \"54a8e2e9-7ac5-4b4f-99de-12f539adb0fd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:44.148561 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:44.148523 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:44.417882 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:44.417858 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd"] Sep 17 03:25:44.419090 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:25:44.419060 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a8e2e9_7ac5_4b4f_99de_12f539adb0fd.slice/crio-5ee90f6553bce26dc848ed29220603b34da818cafcad4d147bcf437a72104c6c WatchSource:0}: Error finding container 5ee90f6553bce26dc848ed29220603b34da818cafcad4d147bcf437a72104c6c: Status 404 returned error can't find the container with id 5ee90f6553bce26dc848ed29220603b34da818cafcad4d147bcf437a72104c6c Sep 17 03:25:45.056230 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:45.056194 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" event={"ID":"54a8e2e9-7ac5-4b4f-99de-12f539adb0fd","Type":"ContainerStarted","Data":"5ee90f6553bce26dc848ed29220603b34da818cafcad4d147bcf437a72104c6c"} Sep 17 03:25:50.093673 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:50.093621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" event={"ID":"54a8e2e9-7ac5-4b4f-99de-12f539adb0fd","Type":"ContainerStarted","Data":"59038ba2077495bbb882c54048f51fa46c71961a148f2bcfa0d43deec54963e5"} Sep 17 03:25:50.094122 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:50.093699 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:25:50.112234 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:50.112175 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" podStartSLOduration=1.96487492 podStartE2EDuration="7.1121542s" totalImagesPullingTime="5.14727928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:25:50.110848121 +0000 UTC m=+788.974109220" watchObservedRunningTime="2026-09-17 03:25:50.1121542 +0000 UTC m=+788.975415301" Sep 17 03:25:56.132342 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:25:56.132305 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9rvfd" Sep 17 03:26:03.980467 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:03.980382 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-jdvdc"] Sep 17 03:26:04.008603 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.008571 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-jdvdc"] Sep 17 03:26:04.008769 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.008724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.011741 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.011717 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 17 03:26:04.013076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.013054 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 17 03:26:04.013226 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.013058 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 17 03:26:04.013226 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.013060 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qs4t2\"" Sep 17 03:26:04.086846 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.086810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.087029 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.086876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-metrics-certs\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.087029 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.086946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmf2q\" (UniqueName: \"kubernetes.io/projected/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-kube-api-access-gmf2q\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.188147 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.188113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.188328 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.188181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-metrics-certs\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.188328 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.188232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmf2q\" (UniqueName: \"kubernetes.io/projected/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-kube-api-access-gmf2q\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.188328 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:26:04.188265 2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 17 03:26:04.188446 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:26:04.188345 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert podName:4a18c9fe-6384-4771-9ed9-d0b83a3398ef nodeName:}" failed. No retries permitted until 2026-09-17 03:26:04.688322938 +0000 UTC m=+803.551584019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert") pod "maas-controller-75dc6cbdf-jdvdc" (UID: "4a18c9fe-6384-4771-9ed9-d0b83a3398ef") : secret "maas-controller-webhook-cert" not found Sep 17 03:26:04.190758 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.190734 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-metrics-certs\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.197081 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.197053 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmf2q\" (UniqueName: \"kubernetes.io/projected/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-kube-api-access-gmf2q\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.692682 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.692617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.695408 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.695378 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert\") pod \"maas-controller-75dc6cbdf-jdvdc\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:04.920791 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:04.920751 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:05.193231 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:05.193205 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-jdvdc"] Sep 17 03:26:05.194875 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:26:05.194848 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a18c9fe_6384_4771_9ed9_d0b83a3398ef.slice/crio-0ce173f6b66412d7a5ceb9fb01a4ad489010ec9ac4903da18fb4d8c2101fff89 WatchSource:0}: Error finding container 0ce173f6b66412d7a5ceb9fb01a4ad489010ec9ac4903da18fb4d8c2101fff89: Status 404 returned error can't find the container with id 0ce173f6b66412d7a5ceb9fb01a4ad489010ec9ac4903da18fb4d8c2101fff89 Sep 17 03:26:06.192075 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:06.192034 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" event={"ID":"4a18c9fe-6384-4771-9ed9-d0b83a3398ef","Type":"ContainerStarted","Data":"0ce173f6b66412d7a5ceb9fb01a4ad489010ec9ac4903da18fb4d8c2101fff89"} Sep 17 03:26:08.207352 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:08.207280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" event={"ID":"4a18c9fe-6384-4771-9ed9-d0b83a3398ef","Type":"ContainerStarted","Data":"8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d"} Sep 17 03:26:08.207352 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:08.207359 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:08.229129 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:08.229067 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" podStartSLOduration=3.009103632 podStartE2EDuration="5.229046139s" totalImagesPullingTime="2.219942507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:26:08.224612402 +0000 UTC m=+807.087873501" watchObservedRunningTime="2026-09-17 03:26:08.229046139 +0000 UTC m=+807.092307239" Sep 17 03:26:18.889679 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:18.889620 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-jdvdc"] Sep 17 03:26:18.890004 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:18.889909 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" podUID="4a18c9fe-6384-4771-9ed9-d0b83a3398ef" containerName="manager" containerID="cri-o://8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d" gracePeriod=30 Sep 17 03:26:18.891703 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:18.891680 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:19.155266 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.155205 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:19.278686 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.278650 2562 generic.go:356] "Generic (PLEG): container finished" podID="4a18c9fe-6384-4771-9ed9-d0b83a3398ef" containerID="8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d" exitCode=0 Sep 17 03:26:19.278849 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.278699 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" Sep 17 03:26:19.278849 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.278731 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" event={"ID":"4a18c9fe-6384-4771-9ed9-d0b83a3398ef","Type":"ContainerDied","Data":"8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d"} Sep 17 03:26:19.278849 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.278789 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-jdvdc" event={"ID":"4a18c9fe-6384-4771-9ed9-d0b83a3398ef","Type":"ContainerDied","Data":"0ce173f6b66412d7a5ceb9fb01a4ad489010ec9ac4903da18fb4d8c2101fff89"} Sep 17 03:26:19.278849 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.278814 2562 scope.go:117] "RemoveContainer" containerID="8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d" Sep 17 03:26:19.287899 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.287881 2562 scope.go:117] "RemoveContainer" containerID="8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d" Sep 17 03:26:19.288158 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:26:19.288141 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d\": container with ID starting with 8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d not found: ID does not exist" containerID="8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d" Sep 17 03:26:19.288216 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.288165 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d"} err="failed to get container status \"8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d\": rpc error: code = NotFound desc = could not find container \"8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d\": container with ID starting with 8b7e56c1a547ea61e5ad50bee1b6692b56d7c991b3d46d937ee997ca5272bf1d not found: ID does not exist" Sep 17 03:26:19.332138 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.332111 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert\") pod \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " Sep 17 03:26:19.332259 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.332161 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmf2q\" (UniqueName: \"kubernetes.io/projected/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-kube-api-access-gmf2q\") pod \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " Sep 17 03:26:19.332259 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.332234 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-metrics-certs\") pod \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\" (UID: \"4a18c9fe-6384-4771-9ed9-d0b83a3398ef\") " Sep 17 03:26:19.334293 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.334259 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4a18c9fe-6384-4771-9ed9-d0b83a3398ef" (UID: "4a18c9fe-6384-4771-9ed9-d0b83a3398ef"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:26:19.334409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.334310 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4a18c9fe-6384-4771-9ed9-d0b83a3398ef" (UID: "4a18c9fe-6384-4771-9ed9-d0b83a3398ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:26:19.334409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.334362 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-kube-api-access-gmf2q" (OuterVolumeSpecName: "kube-api-access-gmf2q") pod "4a18c9fe-6384-4771-9ed9-d0b83a3398ef" (UID: "4a18c9fe-6384-4771-9ed9-d0b83a3398ef"). InnerVolumeSpecName "kube-api-access-gmf2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:26:19.433283 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.433204 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-webhook-cert\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:26:19.433283 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.433233 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmf2q\" (UniqueName: \"kubernetes.io/projected/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-kube-api-access-gmf2q\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:26:19.433283 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.433243 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a18c9fe-6384-4771-9ed9-d0b83a3398ef-metrics-certs\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:26:19.601796 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.601765 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-jdvdc"] Sep 17 03:26:19.608493 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:19.608471 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-jdvdc"] Sep 17 03:26:21.609160 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:21.609125 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a18c9fe-6384-4771-9ed9-d0b83a3398ef" path="/var/lib/kubelet/pods/4a18c9fe-6384-4771-9ed9-d0b83a3398ef/volumes" Sep 17 03:26:40.618798 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.618760 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9"] Sep 17 03:26:40.619377 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.619199 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a18c9fe-6384-4771-9ed9-d0b83a3398ef" containerName="manager" Sep 17 03:26:40.619377 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.619216 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a18c9fe-6384-4771-9ed9-d0b83a3398ef" containerName="manager" Sep 17 03:26:40.619377 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.619282 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a18c9fe-6384-4771-9ed9-d0b83a3398ef" containerName="manager" Sep 17 03:26:40.622314 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.622292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:40.625025 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.625005 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fxf9f\"" Sep 17 03:26:40.625203 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.625182 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 17 03:26:40.634109 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.634086 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9"] Sep 17 03:26:40.658399 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.658373 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57mwp"] Sep 17 03:26:40.662455 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.662432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:40.673670 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.673644 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57mwp"] Sep 17 03:26:40.709000 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.708965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/382ff2ba-b486-48f6-95c5-fe377143bc42-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-grfp9\" (UID: \"382ff2ba-b486-48f6-95c5-fe377143bc42\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:40.709181 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.709079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtj92\" (UniqueName: \"kubernetes.io/projected/50f2fd2d-cabf-4a4c-9473-242e30a6b319-kube-api-access-vtj92\") pod \"payload-processing-5b54b7fbb7-57mwp\" (UID: \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:40.709181 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.709123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50f2fd2d-cabf-4a4c-9473-242e30a6b319-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-57mwp\" (UID: \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:40.709181 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.709149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6txjf\" (UniqueName: \"kubernetes.io/projected/382ff2ba-b486-48f6-95c5-fe377143bc42-kube-api-access-6txjf\") pod \"payload-pre-processing-59fbc47bf8-grfp9\" (UID: \"382ff2ba-b486-48f6-95c5-fe377143bc42\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:40.809688 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.809651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/382ff2ba-b486-48f6-95c5-fe377143bc42-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-grfp9\" (UID: \"382ff2ba-b486-48f6-95c5-fe377143bc42\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:40.809887 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.809735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtj92\" (UniqueName: \"kubernetes.io/projected/50f2fd2d-cabf-4a4c-9473-242e30a6b319-kube-api-access-vtj92\") pod \"payload-processing-5b54b7fbb7-57mwp\" (UID: \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:40.809887 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.809765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50f2fd2d-cabf-4a4c-9473-242e30a6b319-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-57mwp\" (UID: \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:40.809887 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.809789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txjf\" (UniqueName: \"kubernetes.io/projected/382ff2ba-b486-48f6-95c5-fe377143bc42-kube-api-access-6txjf\") pod \"payload-pre-processing-59fbc47bf8-grfp9\" (UID: \"382ff2ba-b486-48f6-95c5-fe377143bc42\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:40.810625 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.810600 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50f2fd2d-cabf-4a4c-9473-242e30a6b319-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-57mwp\" (UID: \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:40.810709 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.810600 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/382ff2ba-b486-48f6-95c5-fe377143bc42-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-grfp9\" (UID: \"382ff2ba-b486-48f6-95c5-fe377143bc42\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:40.821368 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.821328 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6txjf\" (UniqueName: \"kubernetes.io/projected/382ff2ba-b486-48f6-95c5-fe377143bc42-kube-api-access-6txjf\") pod \"payload-pre-processing-59fbc47bf8-grfp9\" (UID: \"382ff2ba-b486-48f6-95c5-fe377143bc42\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:40.829705 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.829674 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtj92\" (UniqueName: \"kubernetes.io/projected/50f2fd2d-cabf-4a4c-9473-242e30a6b319-kube-api-access-vtj92\") pod \"payload-processing-5b54b7fbb7-57mwp\" (UID: \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:40.936729 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.936645 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:40.974409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:40.974378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:41.213773 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:41.213746 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9"] Sep 17 03:26:41.215242 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:26:41.215219 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382ff2ba_b486_48f6_95c5_fe377143bc42.slice/crio-6e786d6dc52194e23e124b1c442e27e27dd6d5dddad7566095242154f82df864 WatchSource:0}: Error finding container 6e786d6dc52194e23e124b1c442e27e27dd6d5dddad7566095242154f82df864: Status 404 returned error can't find the container with id 6e786d6dc52194e23e124b1c442e27e27dd6d5dddad7566095242154f82df864 Sep 17 03:26:41.266553 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:41.266523 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57mwp"] Sep 17 03:26:41.267453 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:26:41.267426 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f2fd2d_cabf_4a4c_9473_242e30a6b319.slice/crio-69445c2945e81cfa844f3ddc42ed192b06b7390486f42ce065082d4fa2471036 WatchSource:0}: Error finding container 69445c2945e81cfa844f3ddc42ed192b06b7390486f42ce065082d4fa2471036: Status 404 returned error can't find the container with id 69445c2945e81cfa844f3ddc42ed192b06b7390486f42ce065082d4fa2471036 Sep 17 03:26:41.402759 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:41.402727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" event={"ID":"50f2fd2d-cabf-4a4c-9473-242e30a6b319","Type":"ContainerStarted","Data":"69445c2945e81cfa844f3ddc42ed192b06b7390486f42ce065082d4fa2471036"} Sep 17 03:26:41.403962 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:41.403933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" event={"ID":"382ff2ba-b486-48f6-95c5-fe377143bc42","Type":"ContainerStarted","Data":"6e786d6dc52194e23e124b1c442e27e27dd6d5dddad7566095242154f82df864"} Sep 17 03:26:43.419353 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:43.419305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" event={"ID":"50f2fd2d-cabf-4a4c-9473-242e30a6b319","Type":"ContainerStarted","Data":"2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85"} Sep 17 03:26:43.419851 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:43.419683 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:43.421068 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:43.421043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" event={"ID":"382ff2ba-b486-48f6-95c5-fe377143bc42","Type":"ContainerStarted","Data":"4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a"} Sep 17 03:26:43.421136 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:43.421087 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:43.437734 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:43.437679 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" podStartSLOduration=1.942555716 podStartE2EDuration="3.43766007s" totalImagesPullingTime="1.495104354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:26:43.436453186 +0000 UTC m=+842.299714298" watchObservedRunningTime="2026-09-17 03:26:43.43766007 +0000 UTC m=+842.300921171" Sep 17 03:26:43.454390 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:43.454344 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" podStartSLOduration=1.904413103 podStartE2EDuration="3.454331779s" totalImagesPullingTime="1.549918676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:26:43.451939715 +0000 UTC m=+842.315200815" watchObservedRunningTime="2026-09-17 03:26:43.454331779 +0000 UTC m=+842.317592878" Sep 17 03:26:50.463098 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:50.463061 2562 generic.go:356] "Generic (PLEG): container finished" podID="098edb2d-882e-45b6-aa9a-8d8dbd9fb729" containerID="75fb67c85dd4b588417428581d447ff55edd3b1dc4c54cec5caaa737752427a5" exitCode=0 Sep 17 03:26:50.463501 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:50.463136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" event={"ID":"098edb2d-882e-45b6-aa9a-8d8dbd9fb729","Type":"ContainerDied","Data":"75fb67c85dd4b588417428581d447ff55edd3b1dc4c54cec5caaa737752427a5"} Sep 17 03:26:50.463544 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:50.463523 2562 scope.go:117] "RemoveContainer" containerID="75fb67c85dd4b588417428581d447ff55edd3b1dc4c54cec5caaa737752427a5" Sep 17 03:26:50.470914 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:50.470875 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:26:50.471067 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:50.470957 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:26:50.471067 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:50.470993 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 17 03:26:51.471060 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:51.471025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" event={"ID":"098edb2d-882e-45b6-aa9a-8d8dbd9fb729","Type":"ContainerStarted","Data":"e871b47d22ed63eb434c6436100629f37c0dbbc70deebddaa6fa7d97112cadc6"} Sep 17 03:26:51.585017 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:51.584973 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:26:51.585237 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:51.585114 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-n2b85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Sep 17 03:26:51.585237 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:51.585161 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" podUID="098edb2d-882e-45b6-aa9a-8d8dbd9fb729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Sep 17 03:26:52.585210 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:52.585160 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-n2b85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Sep 17 03:26:52.585749 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:52.585237 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" podUID="098edb2d-882e-45b6-aa9a-8d8dbd9fb729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Sep 17 03:26:53.584376 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:53.584329 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-n2b85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Sep 17 03:26:53.584594 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:53.584397 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" podUID="098edb2d-882e-45b6-aa9a-8d8dbd9fb729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Sep 17 03:26:54.429662 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:54.429615 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:26:54.430030 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:54.429701 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:26:54.589053 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:54.589010 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-n2b85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Sep 17 03:26:54.589343 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:54.589315 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" podUID="098edb2d-882e-45b6-aa9a-8d8dbd9fb729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Sep 17 03:26:55.599821 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:55.599779 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-n2b85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Sep 17 03:26:55.600436 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:55.600398 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" podUID="098edb2d-882e-45b6-aa9a-8d8dbd9fb729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Sep 17 03:26:56.588198 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:56.588166 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:26:56.588467 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:56.588443 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:26:56.589151 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:26:56.589131 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-n2b85" Sep 17 03:27:21.316314 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.316243 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g"] Sep 17 03:27:21.321954 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.321932 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.326475 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.326451 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tvzh7\"" Sep 17 03:27:21.326616 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.326457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 17 03:27:21.326616 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.326490 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 17 03:27:21.326616 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.326507 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 17 03:27:21.331260 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.331235 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g"] Sep 17 03:27:21.382727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.382690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.382727 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.382727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.382975 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.382759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgr9r\" (UniqueName: \"kubernetes.io/projected/047f44b6-a114-4069-af96-f8beb475e8df-kube-api-access-kgr9r\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.382975 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.382913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/047f44b6-a114-4069-af96-f8beb475e8df-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.382975 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.382953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.383101 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.382976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/047f44b6-a114-4069-af96-f8beb475e8df-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484235 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484481 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484481 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484481 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484481 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgr9r\" (UniqueName: \"kubernetes.io/projected/047f44b6-a114-4069-af96-f8beb475e8df-kube-api-access-kgr9r\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484788 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484753 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484867 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484801 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.484919 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.484902 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.486749 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.486723 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/047f44b6-a114-4069-af96-f8beb475e8df-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.486851 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.486824 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/047f44b6-a114-4069-af96-f8beb475e8df-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.493267 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.493239 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgr9r\" (UniqueName: \"kubernetes.io/projected/047f44b6-a114-4069-af96-f8beb475e8df-kube-api-access-kgr9r\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g\" (UID: \"047f44b6-a114-4069-af96-f8beb475e8df\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.635209 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.635135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:21.921997 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:21.921969 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g"] Sep 17 03:27:21.924408 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:27:21.924374 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047f44b6_a114_4069_af96_f8beb475e8df.slice/crio-59b022771b86bdfe494db5f08012ce2a63c65f493c6bb979d3975d5002482f2b WatchSource:0}: Error finding container 59b022771b86bdfe494db5f08012ce2a63c65f493c6bb979d3975d5002482f2b: Status 404 returned error can't find the container with id 59b022771b86bdfe494db5f08012ce2a63c65f493c6bb979d3975d5002482f2b Sep 17 03:27:22.661581 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:22.661541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" event={"ID":"047f44b6-a114-4069-af96-f8beb475e8df","Type":"ContainerStarted","Data":"59b022771b86bdfe494db5f08012ce2a63c65f493c6bb979d3975d5002482f2b"} Sep 17 03:27:23.668475 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:23.668441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" event={"ID":"047f44b6-a114-4069-af96-f8beb475e8df","Type":"ContainerStarted","Data":"ca184006ac7fc4a5a245c83810526009fda14cdc0a2730cc8ae77aa8ae36ebad"} Sep 17 03:27:23.689365 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:23.689306 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" podStartSLOduration=1.549080684 podStartE2EDuration="2.689288945s" totalImagesPullingTime="1.140208261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:27:23.686582976 +0000 UTC m=+882.549844076" watchObservedRunningTime="2026-09-17 03:27:23.689288945 +0000 UTC m=+882.552550045" Sep 17 03:27:31.636263 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:31.636226 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:31.636778 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:31.636301 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:31.649174 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:31.649150 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:31.728826 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:31.728803 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mt94g" Sep 17 03:27:41.559382 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:41.559302 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:27:41.559942 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:27:41.559459 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:28:13.028510 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.028471 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz"] Sep 17 03:28:13.032805 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.032782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.035841 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.035818 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 17 03:28:13.043030 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.043002 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz"] Sep 17 03:28:13.142930 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.142898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.143108 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.142936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.143108 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.142956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.143108 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.142985 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.143108 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.143056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zt6w\" (UniqueName: \"kubernetes.io/projected/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-kube-api-access-9zt6w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.143108 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.143107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244028 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.243988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.244044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zt6w\" (UniqueName: \"kubernetes.io/projected/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-kube-api-access-9zt6w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.244091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.244166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244217 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.244198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244424 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.244223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244662 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.244606 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244662 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.244658 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.244809 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.244698 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.246420 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.246390 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.246587 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.246571 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.252321 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.252296 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zt6w\" (UniqueName: \"kubernetes.io/projected/0a27d6ea-a8ab-450d-8283-fca8aabd1a88-kube-api-access-9zt6w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhdjz\" (UID: \"0a27d6ea-a8ab-450d-8283-fca8aabd1a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.345724 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.345647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:13.622040 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.622005 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz"] Sep 17 03:28:13.622751 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:28:13.622719 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a27d6ea_a8ab_450d_8283_fca8aabd1a88.slice/crio-880832577d9ecd3de62b9c3fa511f0a271e11465b396c73a71d7ea7f60fd81ec WatchSource:0}: Error finding container 880832577d9ecd3de62b9c3fa511f0a271e11465b396c73a71d7ea7f60fd81ec: Status 404 returned error can't find the container with id 880832577d9ecd3de62b9c3fa511f0a271e11465b396c73a71d7ea7f60fd81ec Sep 17 03:28:13.624025 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.624005 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:28:13.955055 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.955021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" event={"ID":"0a27d6ea-a8ab-450d-8283-fca8aabd1a88","Type":"ContainerStarted","Data":"db1649d03eeb4c7c4a98d9acb944f30cfe374f697c0c9462b295c31d2fa9e26d"} Sep 17 03:28:13.955212 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.955077 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" event={"ID":"0a27d6ea-a8ab-450d-8283-fca8aabd1a88","Type":"ContainerStarted","Data":"880832577d9ecd3de62b9c3fa511f0a271e11465b396c73a71d7ea7f60fd81ec"} Sep 17 03:28:13.974491 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:13.974434 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" podStartSLOduration=0.7820015 podStartE2EDuration="974.41452ms" totalImagesPullingTime="192.41302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:28:13.972242706 +0000 UTC m=+932.835503806" watchObservedRunningTime="2026-09-17 03:28:13.97441452 +0000 UTC m=+932.837675620" Sep 17 03:28:23.345996 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:23.345962 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:23.346369 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:23.346020 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:23.358805 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:23.358771 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:28:24.025944 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:28:24.025914 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhdjz" Sep 17 03:30:00.147534 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:00.147498 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7"] Sep 17 03:30:00.151025 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:00.151008 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7" Sep 17 03:30:00.153956 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:00.153927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2kn2t\"" Sep 17 03:30:00.158404 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:00.158381 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7"] Sep 17 03:30:00.162433 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:00.162415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7" Sep 17 03:30:00.441829 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:00.441799 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7"] Sep 17 03:30:00.442801 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:30:00.442772 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fba80b8_d5f8_47bd_882d_12e3820e02dd.slice/crio-ed20270713eee0dd54b82a1f64d848de082f24a99aea4b4f48b2ffdbda38a31b WatchSource:0}: Error finding container ed20270713eee0dd54b82a1f64d848de082f24a99aea4b4f48b2ffdbda38a31b: Status 404 returned error can't find the container with id ed20270713eee0dd54b82a1f64d848de082f24a99aea4b4f48b2ffdbda38a31b Sep 17 03:30:00.584223 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:00.584185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7" event={"ID":"8fba80b8-d5f8-47bd-882d-12e3820e02dd","Type":"ContainerStarted","Data":"ed20270713eee0dd54b82a1f64d848de082f24a99aea4b4f48b2ffdbda38a31b"} Sep 17 03:30:03.603970 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:03.603934 2562 generic.go:356] "Generic (PLEG): container finished" podID="8fba80b8-d5f8-47bd-882d-12e3820e02dd" containerID="aaf4d73ce463e2c122a6b9997d5a4e773900038161e640470cd4f70a775e04f5" exitCode=0 Sep 17 03:30:03.611509 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:03.611479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7" event={"ID":"8fba80b8-d5f8-47bd-882d-12e3820e02dd","Type":"ContainerDied","Data":"aaf4d73ce463e2c122a6b9997d5a4e773900038161e640470cd4f70a775e04f5"} Sep 17 03:30:04.747183 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:04.747156 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7" Sep 17 03:30:05.617331 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:05.617130 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7" Sep 17 03:30:05.617331 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:05.617131 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826930-bqxh7" event={"ID":"8fba80b8-d5f8-47bd-882d-12e3820e02dd","Type":"ContainerDied","Data":"ed20270713eee0dd54b82a1f64d848de082f24a99aea4b4f48b2ffdbda38a31b"} Sep 17 03:30:05.617331 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:05.617297 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed20270713eee0dd54b82a1f64d848de082f24a99aea4b4f48b2ffdbda38a31b" Sep 17 03:30:22.675956 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:22.675918 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57mwp"] Sep 17 03:30:22.676904 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:22.676188 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" podUID="50f2fd2d-cabf-4a4c-9473-242e30a6b319" containerName="payload-processing" containerID="cri-o://2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85" gracePeriod=30 Sep 17 03:30:22.700349 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:22.700323 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9"] Sep 17 03:30:22.700576 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:22.700546 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" podUID="382ff2ba-b486-48f6-95c5-fe377143bc42" containerName="payload-pre-processing" containerID="cri-o://4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a" gracePeriod=30 Sep 17 03:30:22.988728 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:22.988695 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:30:22.992882 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:22.992856 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:30:23.081933 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.081887 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/382ff2ba-b486-48f6-95c5-fe377143bc42-plugins-config-volume\") pod \"382ff2ba-b486-48f6-95c5-fe377143bc42\" (UID: \"382ff2ba-b486-48f6-95c5-fe377143bc42\") " Sep 17 03:30:23.082112 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.081990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50f2fd2d-cabf-4a4c-9473-242e30a6b319-plugins-config-volume\") pod \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\" (UID: \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\") " Sep 17 03:30:23.082201 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.082160 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtj92\" (UniqueName: \"kubernetes.io/projected/50f2fd2d-cabf-4a4c-9473-242e30a6b319-kube-api-access-vtj92\") pod \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\" (UID: \"50f2fd2d-cabf-4a4c-9473-242e30a6b319\") " Sep 17 03:30:23.082201 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.082193 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6txjf\" (UniqueName: \"kubernetes.io/projected/382ff2ba-b486-48f6-95c5-fe377143bc42-kube-api-access-6txjf\") pod \"382ff2ba-b486-48f6-95c5-fe377143bc42\" (UID: \"382ff2ba-b486-48f6-95c5-fe377143bc42\") " Sep 17 03:30:23.082338 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.082298 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f2fd2d-cabf-4a4c-9473-242e30a6b319-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "50f2fd2d-cabf-4a4c-9473-242e30a6b319" (UID: "50f2fd2d-cabf-4a4c-9473-242e30a6b319"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:30:23.082399 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.082338 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382ff2ba-b486-48f6-95c5-fe377143bc42-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "382ff2ba-b486-48f6-95c5-fe377143bc42" (UID: "382ff2ba-b486-48f6-95c5-fe377143bc42"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:30:23.082498 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.082477 2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/382ff2ba-b486-48f6-95c5-fe377143bc42-plugins-config-volume\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:30:23.082549 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.082503 2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50f2fd2d-cabf-4a4c-9473-242e30a6b319-plugins-config-volume\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:30:23.084203 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.084180 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f2fd2d-cabf-4a4c-9473-242e30a6b319-kube-api-access-vtj92" (OuterVolumeSpecName: "kube-api-access-vtj92") pod "50f2fd2d-cabf-4a4c-9473-242e30a6b319" (UID: "50f2fd2d-cabf-4a4c-9473-242e30a6b319"). InnerVolumeSpecName "kube-api-access-vtj92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:30:23.084298 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.084237 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382ff2ba-b486-48f6-95c5-fe377143bc42-kube-api-access-6txjf" (OuterVolumeSpecName: "kube-api-access-6txjf") pod "382ff2ba-b486-48f6-95c5-fe377143bc42" (UID: "382ff2ba-b486-48f6-95c5-fe377143bc42"). InnerVolumeSpecName "kube-api-access-6txjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:30:23.183309 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.183273 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtj92\" (UniqueName: \"kubernetes.io/projected/50f2fd2d-cabf-4a4c-9473-242e30a6b319-kube-api-access-vtj92\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:30:23.183309 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.183299 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6txjf\" (UniqueName: \"kubernetes.io/projected/382ff2ba-b486-48f6-95c5-fe377143bc42-kube-api-access-6txjf\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:30:23.730755 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.730720 2562 generic.go:356] "Generic (PLEG): container finished" podID="50f2fd2d-cabf-4a4c-9473-242e30a6b319" containerID="2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85" exitCode=0 Sep 17 03:30:23.731191 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.730833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" event={"ID":"50f2fd2d-cabf-4a4c-9473-242e30a6b319","Type":"ContainerDied","Data":"2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85"} Sep 17 03:30:23.731191 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.730857 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" Sep 17 03:30:23.731191 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.730918 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-57mwp" event={"ID":"50f2fd2d-cabf-4a4c-9473-242e30a6b319","Type":"ContainerDied","Data":"69445c2945e81cfa844f3ddc42ed192b06b7390486f42ce065082d4fa2471036"} Sep 17 03:30:23.731191 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.730950 2562 scope.go:117] "RemoveContainer" containerID="2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85" Sep 17 03:30:23.732550 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.732526 2562 generic.go:356] "Generic (PLEG): container finished" podID="382ff2ba-b486-48f6-95c5-fe377143bc42" containerID="4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a" exitCode=0 Sep 17 03:30:23.732662 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.732582 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" Sep 17 03:30:23.732662 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.732601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" event={"ID":"382ff2ba-b486-48f6-95c5-fe377143bc42","Type":"ContainerDied","Data":"4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a"} Sep 17 03:30:23.732795 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.732669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9" event={"ID":"382ff2ba-b486-48f6-95c5-fe377143bc42","Type":"ContainerDied","Data":"6e786d6dc52194e23e124b1c442e27e27dd6d5dddad7566095242154f82df864"} Sep 17 03:30:23.741571 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.741553 2562 scope.go:117] "RemoveContainer" containerID="2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85" Sep 17 03:30:23.741880 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:30:23.741857 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85\": container with ID starting with 2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85 not found: ID does not exist" containerID="2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85" Sep 17 03:30:23.741939 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.741892 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85"} err="failed to get container status \"2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85\": rpc error: code = NotFound desc = could not find container \"2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85\": container with ID starting with 2df19929a353e59a0ff193e9fdb6c0b14018acbe1dc2b494d5c89223f5e06d85 not found: ID does not exist" Sep 17 03:30:23.741939 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.741914 2562 scope.go:117] "RemoveContainer" containerID="4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a" Sep 17 03:30:23.751382 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.751365 2562 scope.go:117] "RemoveContainer" containerID="4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a" Sep 17 03:30:23.751686 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:30:23.751668 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a\": container with ID starting with 4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a not found: ID does not exist" containerID="4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a" Sep 17 03:30:23.751767 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.751693 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a"} err="failed to get container status \"4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a\": rpc error: code = NotFound desc = could not find container \"4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a\": container with ID starting with 4502786342d9cb63ca198328f97ebbbf2260ccc2b9a03007fde56a7ea0a8098a not found: ID does not exist" Sep 17 03:30:23.752755 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.752732 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57mwp"] Sep 17 03:30:23.757355 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.757334 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-57mwp"] Sep 17 03:30:23.771526 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.771502 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9"] Sep 17 03:30:23.775491 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.775465 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-grfp9"] Sep 17 03:30:23.860186 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860148 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-gl9m8"] Sep 17 03:30:23.860605 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860588 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f2fd2d-cabf-4a4c-9473-242e30a6b319" containerName="payload-processing" Sep 17 03:30:23.860605 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860607 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f2fd2d-cabf-4a4c-9473-242e30a6b319" containerName="payload-processing" Sep 17 03:30:23.860766 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860615 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382ff2ba-b486-48f6-95c5-fe377143bc42" containerName="payload-pre-processing" Sep 17 03:30:23.860766 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860621 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="382ff2ba-b486-48f6-95c5-fe377143bc42" containerName="payload-pre-processing" Sep 17 03:30:23.860766 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860645 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fba80b8-d5f8-47bd-882d-12e3820e02dd" containerName="cleanup" Sep 17 03:30:23.860766 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860651 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fba80b8-d5f8-47bd-882d-12e3820e02dd" containerName="cleanup" Sep 17 03:30:23.860766 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860713 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="382ff2ba-b486-48f6-95c5-fe377143bc42" containerName="payload-pre-processing" Sep 17 03:30:23.860766 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860721 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f2fd2d-cabf-4a4c-9473-242e30a6b319" containerName="payload-processing" Sep 17 03:30:23.860766 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.860729 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fba80b8-d5f8-47bd-882d-12e3820e02dd" containerName="cleanup" Sep 17 03:30:23.865175 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.865149 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.868079 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.868010 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 17 03:30:23.868234 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.868031 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 17 03:30:23.868327 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.868031 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qs4t2\"" Sep 17 03:30:23.868327 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.868132 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 17 03:30:23.875740 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.875708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-gl9m8"] Sep 17 03:30:23.888149 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.888122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pwtf\" (UniqueName: \"kubernetes.io/projected/a217dedb-dad4-4235-b20c-8017fab1374a-kube-api-access-4pwtf\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.888284 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.888161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a217dedb-dad4-4235-b20c-8017fab1374a-metrics-certs\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.888284 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.888216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a217dedb-dad4-4235-b20c-8017fab1374a-webhook-cert\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.989561 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.989526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pwtf\" (UniqueName: \"kubernetes.io/projected/a217dedb-dad4-4235-b20c-8017fab1374a-kube-api-access-4pwtf\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.989561 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.989566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a217dedb-dad4-4235-b20c-8017fab1374a-metrics-certs\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.989805 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.989594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a217dedb-dad4-4235-b20c-8017fab1374a-webhook-cert\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.992089 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.992068 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a217dedb-dad4-4235-b20c-8017fab1374a-webhook-cert\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.992157 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.992104 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a217dedb-dad4-4235-b20c-8017fab1374a-metrics-certs\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:23.997944 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:23.997917 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pwtf\" (UniqueName: \"kubernetes.io/projected/a217dedb-dad4-4235-b20c-8017fab1374a-kube-api-access-4pwtf\") pod \"maas-controller-659dc8cbc8-gl9m8\" (UID: \"a217dedb-dad4-4235-b20c-8017fab1374a\") " pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:24.180590 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:24.180498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:24.455869 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:24.455841 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-gl9m8"] Sep 17 03:30:24.457484 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:30:24.457457 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda217dedb_dad4_4235_b20c_8017fab1374a.slice/crio-052a13b8ee8df0ed08451c71edfe34b66eafbca4ffdea8d28c188ad159d00e65 WatchSource:0}: Error finding container 052a13b8ee8df0ed08451c71edfe34b66eafbca4ffdea8d28c188ad159d00e65: Status 404 returned error can't find the container with id 052a13b8ee8df0ed08451c71edfe34b66eafbca4ffdea8d28c188ad159d00e65 Sep 17 03:30:24.741789 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:24.741753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" event={"ID":"a217dedb-dad4-4235-b20c-8017fab1374a","Type":"ContainerStarted","Data":"052a13b8ee8df0ed08451c71edfe34b66eafbca4ffdea8d28c188ad159d00e65"} Sep 17 03:30:25.610126 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:25.610093 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382ff2ba-b486-48f6-95c5-fe377143bc42" path="/var/lib/kubelet/pods/382ff2ba-b486-48f6-95c5-fe377143bc42/volumes" Sep 17 03:30:25.610477 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:25.610463 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50f2fd2d-cabf-4a4c-9473-242e30a6b319" path="/var/lib/kubelet/pods/50f2fd2d-cabf-4a4c-9473-242e30a6b319/volumes" Sep 17 03:30:25.749046 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:25.749008 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" event={"ID":"a217dedb-dad4-4235-b20c-8017fab1374a","Type":"ContainerStarted","Data":"05497ec75915f8cf9de67be3bf0c70e161408b4938645f5bfcdc76722ee88240"} Sep 17 03:30:25.749437 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:25.749074 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:25.771452 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:25.771405 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" podStartSLOduration=2.369412654 podStartE2EDuration="2.771388189s" totalImagesPullingTime="401.975535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:30:25.768214999 +0000 UTC m=+1064.631476099" watchObservedRunningTime="2026-09-17 03:30:25.771388189 +0000 UTC m=+1064.634649287" Sep 17 03:30:36.758538 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:36.758447 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659dc8cbc8-gl9m8" Sep 17 03:30:37.013885 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.013803 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-58c959db4c-mw9k6"] Sep 17 03:30:37.023000 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.022974 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:30:37.024857 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.024830 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-58c959db4c-mw9k6"] Sep 17 03:30:37.025573 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.025556 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 17 03:30:37.025690 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.025560 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-vxvv7\"" Sep 17 03:30:37.119855 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.119811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5z8k\" (UniqueName: \"kubernetes.io/projected/afb77612-dc3f-41ab-97c3-aa8eafc8e731-kube-api-access-s5z8k\") pod \"ai-gateway-controller-58c959db4c-mw9k6\" (UID: \"afb77612-dc3f-41ab-97c3-aa8eafc8e731\") " pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:30:37.220868 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.220838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5z8k\" (UniqueName: \"kubernetes.io/projected/afb77612-dc3f-41ab-97c3-aa8eafc8e731-kube-api-access-s5z8k\") pod \"ai-gateway-controller-58c959db4c-mw9k6\" (UID: \"afb77612-dc3f-41ab-97c3-aa8eafc8e731\") " pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:30:37.229185 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.229161 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5z8k\" (UniqueName: \"kubernetes.io/projected/afb77612-dc3f-41ab-97c3-aa8eafc8e731-kube-api-access-s5z8k\") pod \"ai-gateway-controller-58c959db4c-mw9k6\" (UID: \"afb77612-dc3f-41ab-97c3-aa8eafc8e731\") " pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:30:37.334214 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.334127 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:30:37.608573 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:30:37.608541 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb77612_dc3f_41ab_97c3_aa8eafc8e731.slice/crio-1b6486e5564dabdcd8f55197c7fa29a389dd1f5eaa697af1d78d8fd76ba62036 WatchSource:0}: Error finding container 1b6486e5564dabdcd8f55197c7fa29a389dd1f5eaa697af1d78d8fd76ba62036: Status 404 returned error can't find the container with id 1b6486e5564dabdcd8f55197c7fa29a389dd1f5eaa697af1d78d8fd76ba62036 Sep 17 03:30:37.611098 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.611073 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-58c959db4c-mw9k6"] Sep 17 03:30:37.819954 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:37.819898 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" event={"ID":"afb77612-dc3f-41ab-97c3-aa8eafc8e731","Type":"ContainerStarted","Data":"1b6486e5564dabdcd8f55197c7fa29a389dd1f5eaa697af1d78d8fd76ba62036"} Sep 17 03:30:39.786560 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.786526 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-rgqb8"] Sep 17 03:30:39.790397 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.790366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:39.793361 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.793335 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 17 03:30:39.793483 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.793344 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8jpc8\"" Sep 17 03:30:39.802586 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.802565 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-gq82p"] Sep 17 03:30:39.806163 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.806144 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-rgqb8"] Sep 17 03:30:39.806266 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.806223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:39.820871 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.820849 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-gq82p"] Sep 17 03:30:39.835953 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.835918 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" event={"ID":"afb77612-dc3f-41ab-97c3-aa8eafc8e731","Type":"ContainerStarted","Data":"bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78"} Sep 17 03:30:39.836084 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.835974 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:30:39.847933 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.847905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2mrg\" (UniqueName: \"kubernetes.io/projected/862f264b-24c7-4bb5-b2bc-395f83665035-kube-api-access-f2mrg\") pod \"payload-processing-5d7dbbd56b-rgqb8\" (UID: \"862f264b-24c7-4bb5-b2bc-395f83665035\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:39.848047 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.848025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/862f264b-24c7-4bb5-b2bc-395f83665035-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-rgqb8\" (UID: \"862f264b-24c7-4bb5-b2bc-395f83665035\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:39.853989 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.853948 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" podStartSLOduration=2.180301504 podStartE2EDuration="3.853935762s" totalImagesPullingTime="1.673634258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:30:39.851613103 +0000 UTC m=+1078.714874214" watchObservedRunningTime="2026-09-17 03:30:39.853935762 +0000 UTC m=+1078.717197030" Sep 17 03:30:39.948936 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.948893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2mrg\" (UniqueName: \"kubernetes.io/projected/862f264b-24c7-4bb5-b2bc-395f83665035-kube-api-access-f2mrg\") pod \"payload-processing-5d7dbbd56b-rgqb8\" (UID: \"862f264b-24c7-4bb5-b2bc-395f83665035\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:39.948936 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.948942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtkfq\" (UniqueName: \"kubernetes.io/projected/245e4a03-1a08-4c9a-b50a-5ea179d93078-kube-api-access-jtkfq\") pod \"payload-pre-processing-6cd864bc95-gq82p\" (UID: \"245e4a03-1a08-4c9a-b50a-5ea179d93078\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:39.949177 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.949033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/245e4a03-1a08-4c9a-b50a-5ea179d93078-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-gq82p\" (UID: \"245e4a03-1a08-4c9a-b50a-5ea179d93078\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:39.949177 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.949064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/862f264b-24c7-4bb5-b2bc-395f83665035-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-rgqb8\" (UID: \"862f264b-24c7-4bb5-b2bc-395f83665035\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:39.949976 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.949950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/862f264b-24c7-4bb5-b2bc-395f83665035-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-rgqb8\" (UID: \"862f264b-24c7-4bb5-b2bc-395f83665035\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:39.957210 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:39.957184 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2mrg\" (UniqueName: \"kubernetes.io/projected/862f264b-24c7-4bb5-b2bc-395f83665035-kube-api-access-f2mrg\") pod \"payload-processing-5d7dbbd56b-rgqb8\" (UID: \"862f264b-24c7-4bb5-b2bc-395f83665035\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:40.050438 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.050335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtkfq\" (UniqueName: \"kubernetes.io/projected/245e4a03-1a08-4c9a-b50a-5ea179d93078-kube-api-access-jtkfq\") pod \"payload-pre-processing-6cd864bc95-gq82p\" (UID: \"245e4a03-1a08-4c9a-b50a-5ea179d93078\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:40.050438 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.050432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/245e4a03-1a08-4c9a-b50a-5ea179d93078-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-gq82p\" (UID: \"245e4a03-1a08-4c9a-b50a-5ea179d93078\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:40.051413 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.051392 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/245e4a03-1a08-4c9a-b50a-5ea179d93078-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-gq82p\" (UID: \"245e4a03-1a08-4c9a-b50a-5ea179d93078\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:40.059295 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.059274 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtkfq\" (UniqueName: \"kubernetes.io/projected/245e4a03-1a08-4c9a-b50a-5ea179d93078-kube-api-access-jtkfq\") pod \"payload-pre-processing-6cd864bc95-gq82p\" (UID: \"245e4a03-1a08-4c9a-b50a-5ea179d93078\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:40.102316 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.102283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:40.118591 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.118563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:40.379307 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.379279 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-rgqb8"] Sep 17 03:30:40.380769 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:30:40.380739 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862f264b_24c7_4bb5_b2bc_395f83665035.slice/crio-7e6fd42841a43eccfb1075111ff60227d0f6bd5947fa59c72c438d74ba988031 WatchSource:0}: Error finding container 7e6fd42841a43eccfb1075111ff60227d0f6bd5947fa59c72c438d74ba988031: Status 404 returned error can't find the container with id 7e6fd42841a43eccfb1075111ff60227d0f6bd5947fa59c72c438d74ba988031 Sep 17 03:30:40.403015 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.402989 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-gq82p"] Sep 17 03:30:40.404162 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:30:40.404138 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245e4a03_1a08_4c9a_b50a_5ea179d93078.slice/crio-d834796e9c009be49b6c740fbc2b165c5507053023c643d2f1d90052f5d08460 WatchSource:0}: Error finding container d834796e9c009be49b6c740fbc2b165c5507053023c643d2f1d90052f5d08460: Status 404 returned error can't find the container with id d834796e9c009be49b6c740fbc2b165c5507053023c643d2f1d90052f5d08460 Sep 17 03:30:40.843383 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.843345 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" event={"ID":"245e4a03-1a08-4c9a-b50a-5ea179d93078","Type":"ContainerStarted","Data":"d834796e9c009be49b6c740fbc2b165c5507053023c643d2f1d90052f5d08460"} Sep 17 03:30:40.844650 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:40.844603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" event={"ID":"862f264b-24c7-4bb5-b2bc-395f83665035","Type":"ContainerStarted","Data":"7e6fd42841a43eccfb1075111ff60227d0f6bd5947fa59c72c438d74ba988031"} Sep 17 03:30:41.851565 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:41.851470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" event={"ID":"245e4a03-1a08-4c9a-b50a-5ea179d93078","Type":"ContainerStarted","Data":"7e73507e8c51ab72fd347ec4e8331d0a07a1962573c55d18dbe96c6873a18024"} Sep 17 03:30:41.851565 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:41.851533 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:41.853084 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:41.853059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" event={"ID":"862f264b-24c7-4bb5-b2bc-395f83665035","Type":"ContainerStarted","Data":"b2f5f9ce4719be9b4b82c38df796378472c31d6fe17182365361013e6e4089b8"} Sep 17 03:30:41.853210 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:41.853133 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:41.883041 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:41.883001 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" podStartSLOduration=1.747294082 podStartE2EDuration="2.882985698s" totalImagesPullingTime="1.135691616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:30:41.882227907 +0000 UTC m=+1080.745489017" watchObservedRunningTime="2026-09-17 03:30:41.882985698 +0000 UTC m=+1080.746246796" Sep 17 03:30:41.902202 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:41.902159 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" podStartSLOduration=1.731055996 podStartE2EDuration="2.902145726s" totalImagesPullingTime="1.17108973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:30:41.901849898 +0000 UTC m=+1080.765110997" watchObservedRunningTime="2026-09-17 03:30:41.902145726 +0000 UTC m=+1080.765406825" Sep 17 03:30:50.847735 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:50.847704 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:30:51.039341 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.039308 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-679d87cbdf-5pp7m"] Sep 17 03:30:51.044290 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.044266 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" Sep 17 03:30:51.051607 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.051582 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-679d87cbdf-5pp7m"] Sep 17 03:30:51.150828 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.150742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcn8k\" (UniqueName: \"kubernetes.io/projected/45b03a17-de06-4c28-83fc-f57e7db1f5b5-kube-api-access-vcn8k\") pod \"ai-gateway-controller-679d87cbdf-5pp7m\" (UID: \"45b03a17-de06-4c28-83fc-f57e7db1f5b5\") " pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" Sep 17 03:30:51.252079 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.252040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcn8k\" (UniqueName: \"kubernetes.io/projected/45b03a17-de06-4c28-83fc-f57e7db1f5b5-kube-api-access-vcn8k\") pod \"ai-gateway-controller-679d87cbdf-5pp7m\" (UID: \"45b03a17-de06-4c28-83fc-f57e7db1f5b5\") " pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" Sep 17 03:30:51.261321 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.261283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcn8k\" (UniqueName: \"kubernetes.io/projected/45b03a17-de06-4c28-83fc-f57e7db1f5b5-kube-api-access-vcn8k\") pod \"ai-gateway-controller-679d87cbdf-5pp7m\" (UID: \"45b03a17-de06-4c28-83fc-f57e7db1f5b5\") " pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" Sep 17 03:30:51.356427 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.356394 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" Sep 17 03:30:51.633846 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.633815 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-679d87cbdf-5pp7m"] Sep 17 03:30:51.635074 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:30:51.635048 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b03a17_de06_4c28_83fc_f57e7db1f5b5.slice/crio-1ae9ccab3289e9ca60d95d53e1f174343dba5d209dc1ae394fd620d775b3076d WatchSource:0}: Error finding container 1ae9ccab3289e9ca60d95d53e1f174343dba5d209dc1ae394fd620d775b3076d: Status 404 returned error can't find the container with id 1ae9ccab3289e9ca60d95d53e1f174343dba5d209dc1ae394fd620d775b3076d Sep 17 03:30:51.915657 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:51.915600 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" event={"ID":"45b03a17-de06-4c28-83fc-f57e7db1f5b5","Type":"ContainerStarted","Data":"1ae9ccab3289e9ca60d95d53e1f174343dba5d209dc1ae394fd620d775b3076d"} Sep 17 03:30:52.862729 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:52.862695 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5d7dbbd56b-rgqb8" Sep 17 03:30:52.862896 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:52.862853 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-6cd864bc95-gq82p" Sep 17 03:30:52.923750 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:52.923705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" event={"ID":"45b03a17-de06-4c28-83fc-f57e7db1f5b5","Type":"ContainerStarted","Data":"6014ecc64002a571febbad4ff19429ad9bb91d80d52444c71c2b6dd94886f17c"} Sep 17 03:30:52.924171 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:52.923879 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" Sep 17 03:30:52.944128 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:30:52.944077 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" podStartSLOduration=1.577296015 podStartE2EDuration="1.944060706s" totalImagesPullingTime="366.764691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:30:52.943521431 +0000 UTC m=+1091.806782531" watchObservedRunningTime="2026-09-17 03:30:52.944060706 +0000 UTC m=+1091.807321853" Sep 17 03:31:03.931653 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:03.931611 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-679d87cbdf-5pp7m" Sep 17 03:31:03.973768 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:03.973738 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-58c959db4c-mw9k6"] Sep 17 03:31:03.973987 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:03.973937 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" podUID="afb77612-dc3f-41ab-97c3-aa8eafc8e731" containerName="manager" containerID="cri-o://bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78" gracePeriod=30 Sep 17 03:31:04.234686 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:04.234658 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:31:04.257622 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:04.257592 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5z8k\" (UniqueName: \"kubernetes.io/projected/afb77612-dc3f-41ab-97c3-aa8eafc8e731-kube-api-access-s5z8k\") pod \"afb77612-dc3f-41ab-97c3-aa8eafc8e731\" (UID: \"afb77612-dc3f-41ab-97c3-aa8eafc8e731\") " Sep 17 03:31:04.259607 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:04.259575 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afb77612-dc3f-41ab-97c3-aa8eafc8e731-kube-api-access-s5z8k" (OuterVolumeSpecName: "kube-api-access-s5z8k") pod "afb77612-dc3f-41ab-97c3-aa8eafc8e731" (UID: "afb77612-dc3f-41ab-97c3-aa8eafc8e731"). InnerVolumeSpecName "kube-api-access-s5z8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:31:04.358293 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:04.358262 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5z8k\" (UniqueName: \"kubernetes.io/projected/afb77612-dc3f-41ab-97c3-aa8eafc8e731-kube-api-access-s5z8k\") on node \"ip-10-0-141-44.ec2.internal\" DevicePath \"\"" Sep 17 03:31:05.006308 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.006270 2562 generic.go:356] "Generic (PLEG): container finished" podID="afb77612-dc3f-41ab-97c3-aa8eafc8e731" containerID="bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78" exitCode=0 Sep 17 03:31:05.006827 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.006330 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" Sep 17 03:31:05.006827 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.006352 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" event={"ID":"afb77612-dc3f-41ab-97c3-aa8eafc8e731","Type":"ContainerDied","Data":"bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78"} Sep 17 03:31:05.006827 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.006406 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-58c959db4c-mw9k6" event={"ID":"afb77612-dc3f-41ab-97c3-aa8eafc8e731","Type":"ContainerDied","Data":"1b6486e5564dabdcd8f55197c7fa29a389dd1f5eaa697af1d78d8fd76ba62036"} Sep 17 03:31:05.006827 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.006431 2562 scope.go:117] "RemoveContainer" containerID="bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78" Sep 17 03:31:05.015966 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.015949 2562 scope.go:117] "RemoveContainer" containerID="bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78" Sep 17 03:31:05.016249 ip-10-0-141-44 kubenswrapper[2562]: E0917 03:31:05.016229 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78\": container with ID starting with bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78 not found: ID does not exist" containerID="bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78" Sep 17 03:31:05.016300 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.016261 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78"} err="failed to get container status \"bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78\": rpc error: code = NotFound desc = could not find container \"bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78\": container with ID starting with bcf6ce7f3c0d0f4e8b80ba4bcd639490394a6ff85d2688c9998439aab784ac78 not found: ID does not exist" Sep 17 03:31:05.031702 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.031676 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-58c959db4c-mw9k6"] Sep 17 03:31:05.039091 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.039064 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-58c959db4c-mw9k6"] Sep 17 03:31:05.608870 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:05.608838 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afb77612-dc3f-41ab-97c3-aa8eafc8e731" path="/var/lib/kubelet/pods/afb77612-dc3f-41ab-97c3-aa8eafc8e731/volumes" Sep 17 03:31:19.184880 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.184843 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dnnlt/must-gather-tqqqh"] Sep 17 03:31:19.185357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.185321 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afb77612-dc3f-41ab-97c3-aa8eafc8e731" containerName="manager" Sep 17 03:31:19.185357 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.185335 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="afb77612-dc3f-41ab-97c3-aa8eafc8e731" containerName="manager" Sep 17 03:31:19.185475 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.185425 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="afb77612-dc3f-41ab-97c3-aa8eafc8e731" containerName="manager" Sep 17 03:31:19.191275 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.191253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnnlt/must-gather-tqqqh" Sep 17 03:31:19.194413 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.194380 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dnnlt\"/\"default-dockercfg-v2wjg\"" Sep 17 03:31:19.194557 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.194385 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnnlt\"/\"openshift-service-ca.crt\"" Sep 17 03:31:19.196015 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.195979 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnnlt\"/\"kube-root-ca.crt\"" Sep 17 03:31:19.200076 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.200054 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnnlt/must-gather-tqqqh"] Sep 17 03:31:19.283064 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.283026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d6e117c-5526-434e-85ab-b978e05b2cbc-must-gather-output\") pod \"must-gather-tqqqh\" (UID: \"9d6e117c-5526-434e-85ab-b978e05b2cbc\") " pod="openshift-must-gather-dnnlt/must-gather-tqqqh" Sep 17 03:31:19.283064 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.283068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg4ch\" (UniqueName: \"kubernetes.io/projected/9d6e117c-5526-434e-85ab-b978e05b2cbc-kube-api-access-hg4ch\") pod \"must-gather-tqqqh\" (UID: \"9d6e117c-5526-434e-85ab-b978e05b2cbc\") " pod="openshift-must-gather-dnnlt/must-gather-tqqqh" Sep 17 03:31:19.383762 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.383726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d6e117c-5526-434e-85ab-b978e05b2cbc-must-gather-output\") pod \"must-gather-tqqqh\" (UID: \"9d6e117c-5526-434e-85ab-b978e05b2cbc\") " pod="openshift-must-gather-dnnlt/must-gather-tqqqh" Sep 17 03:31:19.383762 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.383764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg4ch\" (UniqueName: \"kubernetes.io/projected/9d6e117c-5526-434e-85ab-b978e05b2cbc-kube-api-access-hg4ch\") pod \"must-gather-tqqqh\" (UID: \"9d6e117c-5526-434e-85ab-b978e05b2cbc\") " pod="openshift-must-gather-dnnlt/must-gather-tqqqh" Sep 17 03:31:19.384122 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.384101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d6e117c-5526-434e-85ab-b978e05b2cbc-must-gather-output\") pod \"must-gather-tqqqh\" (UID: \"9d6e117c-5526-434e-85ab-b978e05b2cbc\") " pod="openshift-must-gather-dnnlt/must-gather-tqqqh" Sep 17 03:31:19.392513 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.392483 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg4ch\" (UniqueName: \"kubernetes.io/projected/9d6e117c-5526-434e-85ab-b978e05b2cbc-kube-api-access-hg4ch\") pod \"must-gather-tqqqh\" (UID: \"9d6e117c-5526-434e-85ab-b978e05b2cbc\") " pod="openshift-must-gather-dnnlt/must-gather-tqqqh" Sep 17 03:31:19.501719 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.501605 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnnlt/must-gather-tqqqh" Sep 17 03:31:19.776699 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:19.776672 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnnlt/must-gather-tqqqh"] Sep 17 03:31:19.777204 ip-10-0-141-44 kubenswrapper[2562]: W0917 03:31:19.777182 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d6e117c_5526_434e_85ab_b978e05b2cbc.slice/crio-8eb4e2a2111c0aff5f1f5d8a74a5c5930d799f67d7c3591e3c6bac2a5bff4adb WatchSource:0}: Error finding container 8eb4e2a2111c0aff5f1f5d8a74a5c5930d799f67d7c3591e3c6bac2a5bff4adb: Status 404 returned error can't find the container with id 8eb4e2a2111c0aff5f1f5d8a74a5c5930d799f67d7c3591e3c6bac2a5bff4adb Sep 17 03:31:20.093624 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:20.093540 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/must-gather-tqqqh" event={"ID":"9d6e117c-5526-434e-85ab-b978e05b2cbc","Type":"ContainerStarted","Data":"8eb4e2a2111c0aff5f1f5d8a74a5c5930d799f67d7c3591e3c6bac2a5bff4adb"} Sep 17 03:31:21.107396 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:21.106598 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/must-gather-tqqqh" event={"ID":"9d6e117c-5526-434e-85ab-b978e05b2cbc","Type":"ContainerStarted","Data":"5a65e0f82a239c8b9f806828c7436f6f8f2f88f533bc7b6f75914d4eac168d91"} Sep 17 03:31:21.107396 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:21.106718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/must-gather-tqqqh" event={"ID":"9d6e117c-5526-434e-85ab-b978e05b2cbc","Type":"ContainerStarted","Data":"a835a762efa66b52b1832bfb25124ca793fd4003da79bd731adea95db41c7f9d"} Sep 17 03:31:21.124055 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:21.124005 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dnnlt/must-gather-tqqqh" podStartSLOduration=1.304958374 podStartE2EDuration="2.123988859s" totalImagesPullingTime="819.030485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:21.121936579 +0000 UTC m=+1119.985197688" watchObservedRunningTime="2026-09-17 03:31:21.123988859 +0000 UTC m=+1119.987249958" Sep 17 03:31:22.131944 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:22.131912 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7f78c_9a1e6a4a-ef43-4043-93fa-ce7b90d1bfcc/global-pull-secret-syncer/0.log" Sep 17 03:31:22.327660 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:22.327606 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s6k82_910e82f1-c23b-4aac-bcc9-d5c6c2fc931f/konnectivity-agent/0.log" Sep 17 03:31:22.395243 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:22.395159 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-44.ec2.internal_c6a0ddb2d746c4b2daf268b391c6bd11/haproxy/0.log" Sep 17 03:31:26.574798 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:26.574755 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-2sggm_d517f58d-77ce-4ebd-bf74-af0870241bf2/manager/0.log" Sep 17 03:31:26.602590 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:26.602555 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6qrmk_ffb8f32c-83a1-4a82-b25e-5a2da6ad6c0a/kuadrant-console-plugin/0.log" Sep 17 03:31:26.686350 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:26.686300 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-d6kq2_2db7ccc5-9144-441d-bf95-d228d3137720/manager/0.log" Sep 17 03:31:26.767743 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:26.767705 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-vplcs_daaf4c6d-3339-40d8-b72f-6deea7036546/manager/0.log" Sep 17 03:31:28.607167 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:28.607118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-vbd4l_c68900ba-1cde-4473-903c-8feb28c63708/monitoring-plugin/0.log" Sep 17 03:31:28.725369 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:28.725334 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fslsd_8b0c1d49-d805-4024-a30a-79e5cccee7b3/node-exporter/0.log" Sep 17 03:31:28.744961 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:28.744887 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fslsd_8b0c1d49-d805-4024-a30a-79e5cccee7b3/kube-rbac-proxy/0.log" Sep 17 03:31:28.769494 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:28.769448 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fslsd_8b0c1d49-d805-4024-a30a-79e5cccee7b3/init-textfile/0.log" Sep 17 03:31:28.884526 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:28.884445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-6lx2x_01d0b864-230e-4407-9b44-99db90f9a929/kube-rbac-proxy-main/0.log" Sep 17 03:31:28.908478 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:28.908425 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-6lx2x_01d0b864-230e-4407-9b44-99db90f9a929/kube-rbac-proxy-self/0.log" Sep 17 03:31:28.929417 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:28.929383 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-6lx2x_01d0b864-230e-4407-9b44-99db90f9a929/openshift-state-metrics/0.log" Sep 17 03:31:29.274395 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:29.274337 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857fb9bdb7-w85sf_462e8fda-2d5c-490c-afef-c06f747e0a2c/thanos-query/0.log" Sep 17 03:31:29.300652 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:29.300609 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857fb9bdb7-w85sf_462e8fda-2d5c-490c-afef-c06f747e0a2c/kube-rbac-proxy-web/0.log" Sep 17 03:31:29.323796 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:29.323769 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857fb9bdb7-w85sf_462e8fda-2d5c-490c-afef-c06f747e0a2c/kube-rbac-proxy/0.log" Sep 17 03:31:29.344549 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:29.344511 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857fb9bdb7-w85sf_462e8fda-2d5c-490c-afef-c06f747e0a2c/prom-label-proxy/0.log" Sep 17 03:31:29.368036 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:29.367982 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857fb9bdb7-w85sf_462e8fda-2d5c-490c-afef-c06f747e0a2c/kube-rbac-proxy-rules/0.log" Sep 17 03:31:29.390266 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:29.390224 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857fb9bdb7-w85sf_462e8fda-2d5c-490c-afef-c06f747e0a2c/kube-rbac-proxy-metrics/0.log" Sep 17 03:31:31.155134 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:31.155105 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-xlq5x_eda1aac9-88e6-4505-a041-b3d9a47fd0ea/networking-console-plugin/0.log" Sep 17 03:31:31.812888 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:31.812846 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/2.log" Sep 17 03:31:31.819717 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:31.819691 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-fwdt9_ccaf6521-3a7b-4992-a879-461eac6a48c2/console-operator/3.log" Sep 17 03:31:32.399680 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:32.399649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-759854578-kppd6_dc7a7d0b-7384-46e9-bfe6-1475601f68f9/console/0.log" Sep 17 03:31:32.430656 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:32.430593 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-7pcnz_d2714123-e557-41b7-b044-f97d09266d3c/download-server/0.log" Sep 17 03:31:33.258516 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.258454 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz"] Sep 17 03:31:33.266782 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.266753 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.271613 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.271565 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz"] Sep 17 03:31:33.363256 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.363216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-lib-modules\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.363542 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.363522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-sys\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.363698 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.363664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-podres\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.363909 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.363879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-proc\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.364034 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.364018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkfs8\" (UniqueName: \"kubernetes.io/projected/0746f4dc-049a-4b01-ad5b-237d060920ac-kube-api-access-gkfs8\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465036 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-lib-modules\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465036 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-sys\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-podres\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-proc\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkfs8\" (UniqueName: \"kubernetes.io/projected/0746f4dc-049a-4b01-ad5b-237d060920ac-kube-api-access-gkfs8\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465152 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-sys\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-proc\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465193 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-lib-modules\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.465543 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.465253 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0746f4dc-049a-4b01-ad5b-237d060920ac-podres\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.476561 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.476525 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkfs8\" (UniqueName: \"kubernetes.io/projected/0746f4dc-049a-4b01-ad5b-237d060920ac-kube-api-access-gkfs8\") pod \"perf-node-gather-daemonset-mgctz\" (UID: \"0746f4dc-049a-4b01-ad5b-237d060920ac\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.581867 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.581782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:33.886223 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:33.885686 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz"] Sep 17 03:31:34.236983 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:34.236939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" event={"ID":"0746f4dc-049a-4b01-ad5b-237d060920ac","Type":"ContainerStarted","Data":"887462cb47452e593fdc6453757e21451f1ad1a37c3a44cf3c28b8bec6c44e10"} Sep 17 03:31:34.237182 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:34.237010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" event={"ID":"0746f4dc-049a-4b01-ad5b-237d060920ac","Type":"ContainerStarted","Data":"cec79f70a02c9657a14d85e25b68878e4248cd8ffd1da9269177a5919885ea60"} Sep 17 03:31:34.237182 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:34.237042 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:34.254421 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:34.254362 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" podStartSLOduration=1.2543409699999999 podStartE2EDuration="1.25434097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:34.253787623 +0000 UTC m=+1133.117048724" watchObservedRunningTime="2026-09-17 03:31:34.25434097 +0000 UTC m=+1133.117602068" Sep 17 03:31:34.308350 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:34.308321 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87nwc_d5230005-8666-4201-9a9b-5c85bb4dd5dc/dns/0.log" Sep 17 03:31:34.330436 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:34.330411 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87nwc_d5230005-8666-4201-9a9b-5c85bb4dd5dc/kube-rbac-proxy/0.log" Sep 17 03:31:34.424820 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:34.424786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8xw5_0532d583-5a56-4b5c-84d6-41813e578c36/dns-node-resolver/0.log" Sep 17 03:31:35.047085 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:35.047056 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ccc4b_eb6b281c-57cb-4f14-bd80-5bb14259031b/node-ca/0.log" Sep 17 03:31:35.955607 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:35.955578 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2_2322d045-e70f-4f77-9f82-50f7b6ef24a3/istio-proxy/0.log" Sep 17 03:31:36.018363 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:36.018335 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b6489b-7wm7t_4e215289-b133-49d8-8375-6ab6818651bd/kube-auth-proxy/0.log" Sep 17 03:31:36.070538 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:36.070510 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-n2b85_098edb2d-882e-45b6-aa9a-8d8dbd9fb729/istio-proxy/0.log" Sep 17 03:31:36.071661 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:36.071609 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-n2b85_098edb2d-882e-45b6-aa9a-8d8dbd9fb729/istio-proxy/1.log" Sep 17 03:31:36.089246 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:36.089218 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-gq82p_245e4a03-1a08-4c9a-b50a-5ea179d93078/payload-pre-processing/0.log" Sep 17 03:31:36.113297 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:36.113272 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-rgqb8_862f264b-24c7-4bb5-b2bc-395f83665035/payload-processing/0.log" Sep 17 03:31:36.139057 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:36.139031 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59c4bb7d84-8vnzp_fcefc92a-f05c-4f98-8dda-cb44f1f759fd/router/0.log" Sep 17 03:31:36.771755 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:36.771720 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-chj7k_f5b8b3cc-e169-4545-be8b-70ffd126acf6/serve-healthcheck-canary/0.log" Sep 17 03:31:37.373136 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:37.373109 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8q4h_d3f2eaf7-f107-468b-8cfc-14e1683bc0e4/kube-rbac-proxy/0.log" Sep 17 03:31:37.393050 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:37.393019 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8q4h_d3f2eaf7-f107-468b-8cfc-14e1683bc0e4/exporter/0.log" Sep 17 03:31:37.413246 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:37.413218 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8q4h_d3f2eaf7-f107-468b-8cfc-14e1683bc0e4/extractor/0.log" Sep 17 03:31:39.503135 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:39.503108 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-679d87cbdf-5pp7m_45b03a17-de06-4c28-83fc-f57e7db1f5b5/manager/0.log" Sep 17 03:31:39.528785 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:39.528758 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pdvcr_2583d194-8988-4526-9650-94f60de2609b/manager/0.log" Sep 17 03:31:39.565391 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:39.565365 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wrqgx_5d6ce20a-da83-4883-8d6e-04634409dc76/manager/0.log" Sep 17 03:31:39.587343 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:39.587314 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-659dc8cbc8-gl9m8_a217dedb-dad4-4235-b20c-8017fab1374a/manager/0.log" Sep 17 03:31:39.723422 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:39.723379 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9b769b77-m8746_26ca10ff-7525-4c39-af18-af12f642c4db/manager/0.log" Sep 17 03:31:39.739325 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:39.739301 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9b769b77-m8746_26ca10ff-7525-4c39-af18-af12f642c4db/copy-manifests/0.log" Sep 17 03:31:40.256393 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:40.256330 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-mgctz" Sep 17 03:31:41.028605 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:41.028575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lxvzp_77e80a48-7c17-4fed-b8c5-a9b14c820305/openshift-lws-operator/0.log" Sep 17 03:31:42.456452 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:42.456421 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2_2322d045-e70f-4f77-9f82-50f7b6ef24a3/istio-proxy/0.log" Sep 17 03:31:42.506409 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:42.506374 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b6489b-7wm7t_4e215289-b133-49d8-8375-6ab6818651bd/kube-auth-proxy/0.log" Sep 17 03:31:42.549148 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:42.549068 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-n2b85_098edb2d-882e-45b6-aa9a-8d8dbd9fb729/istio-proxy/0.log" Sep 17 03:31:42.552226 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:42.552170 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-n2b85_098edb2d-882e-45b6-aa9a-8d8dbd9fb729/istio-proxy/1.log" Sep 17 03:31:42.573597 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:42.573537 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-gq82p_245e4a03-1a08-4c9a-b50a-5ea179d93078/payload-pre-processing/0.log" Sep 17 03:31:42.593671 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:42.593585 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-rgqb8_862f264b-24c7-4bb5-b2bc-395f83665035/payload-processing/0.log" Sep 17 03:31:42.626089 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:42.626054 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59c4bb7d84-8vnzp_fcefc92a-f05c-4f98-8dda-cb44f1f759fd/router/0.log" Sep 17 03:31:43.794953 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:43.794917 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dz5g2_2322d045-e70f-4f77-9f82-50f7b6ef24a3/istio-proxy/0.log" Sep 17 03:31:43.845037 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:43.845005 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b6489b-7wm7t_4e215289-b133-49d8-8375-6ab6818651bd/kube-auth-proxy/0.log" Sep 17 03:31:43.882558 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:43.882507 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-n2b85_098edb2d-882e-45b6-aa9a-8d8dbd9fb729/istio-proxy/1.log" Sep 17 03:31:43.884089 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:43.884047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-n2b85_098edb2d-882e-45b6-aa9a-8d8dbd9fb729/istio-proxy/0.log" Sep 17 03:31:43.897017 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:43.896984 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-gq82p_245e4a03-1a08-4c9a-b50a-5ea179d93078/payload-pre-processing/0.log" Sep 17 03:31:43.915726 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:43.915700 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-rgqb8_862f264b-24c7-4bb5-b2bc-395f83665035/payload-processing/0.log" Sep 17 03:31:43.932228 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:43.932200 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59c4bb7d84-8vnzp_fcefc92a-f05c-4f98-8dda-cb44f1f759fd/router/0.log" Sep 17 03:31:48.087835 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.087805 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh6t2_c5ef68f6-bc19-4935-a47f-32cf61ecb480/kube-multus-additional-cni-plugins/0.log" Sep 17 03:31:48.107371 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.107340 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh6t2_c5ef68f6-bc19-4935-a47f-32cf61ecb480/egress-router-binary-copy/0.log" Sep 17 03:31:48.126103 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.126078 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh6t2_c5ef68f6-bc19-4935-a47f-32cf61ecb480/cni-plugins/0.log" Sep 17 03:31:48.145085 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.145062 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh6t2_c5ef68f6-bc19-4935-a47f-32cf61ecb480/bond-cni-plugin/0.log" Sep 17 03:31:48.167329 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.167307 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh6t2_c5ef68f6-bc19-4935-a47f-32cf61ecb480/routeoverride-cni/0.log" Sep 17 03:31:48.186593 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.186568 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh6t2_c5ef68f6-bc19-4935-a47f-32cf61ecb480/whereabouts-cni-bincopy/0.log" Sep 17 03:31:48.205051 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.205032 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sh6t2_c5ef68f6-bc19-4935-a47f-32cf61ecb480/whereabouts-cni/0.log" Sep 17 03:31:48.269993 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.269966 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-m9lkk_7650d0ed-b945-4f0e-9388-02dd48fdca9b/kube-multus/0.log" Sep 17 03:31:48.363590 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.363503 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fc2sm_e543faf0-188b-4617-91a4-2c86fc7a2f29/network-metrics-daemon/0.log" Sep 17 03:31:48.382802 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:48.382762 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fc2sm_e543faf0-188b-4617-91a4-2c86fc7a2f29/kube-rbac-proxy/0.log" Sep 17 03:31:49.229344 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:49.229270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9p46_b8c931ac-1fa1-402f-a2ab-805cc98932e9/ovn-controller/0.log" Sep 17 03:31:49.245205 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:49.245182 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9p46_b8c931ac-1fa1-402f-a2ab-805cc98932e9/ovn-acl-logging/0.log" Sep 17 03:31:49.268683 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:49.268657 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9p46_b8c931ac-1fa1-402f-a2ab-805cc98932e9/kube-rbac-proxy-node/0.log" Sep 17 03:31:49.288904 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:49.288868 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9p46_b8c931ac-1fa1-402f-a2ab-805cc98932e9/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 03:31:49.303548 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:49.303526 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9p46_b8c931ac-1fa1-402f-a2ab-805cc98932e9/northd/0.log" Sep 17 03:31:49.322596 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:49.322564 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9p46_b8c931ac-1fa1-402f-a2ab-805cc98932e9/nbdb/0.log" Sep 17 03:31:49.341916 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:49.341899 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9p46_b8c931ac-1fa1-402f-a2ab-805cc98932e9/sbdb/0.log" Sep 17 03:31:49.384251 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:49.384226 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9p46_b8c931ac-1fa1-402f-a2ab-805cc98932e9/ovnkube-controller/0.log" Sep 17 03:31:50.798372 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:50.798339 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-b86zv_adbea728-f68a-45f4-9090-eacf3a7a4944/check-endpoints/0.log" Sep 17 03:31:50.873804 ip-10-0-141-44 kubenswrapper[2562]: I0917 03:31:50.873767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xp5z7_c699a707-ec90-468b-bb43-f7fee8be33b7/network-check-target-container/0.log"