Sep 10 03:46:03.138103 ip-10-0-130-114 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 03:46:03.138116 ip-10-0-130-114 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 03:46:03.138125 ip-10-0-130-114 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 03:46:03.138433 ip-10-0-130-114 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 03:46:13.375937 ip-10-0-130-114 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 03:46:13.375954 ip-10-0-130-114 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8a9245917dce436ea59c06b310fcec05 -- Sep 10 03:48:05.796603 ip-10-0-130-114 systemd[1]: Starting Kubernetes Kubelet... Sep 10 03:48:06.217709 ip-10-0-130-114 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:48:06.217709 ip-10-0-130-114 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 03:48:06.217709 ip-10-0-130-114 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:48:06.217709 ip-10-0-130-114 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 03:48:06.217709 ip-10-0-130-114 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:48:06.219774 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.219685 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 03:48:06.224060 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224046 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:48:06.224060 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224060 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224064 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224068 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224071 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224074 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224077 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224080 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224083 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224085 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224089 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224092 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224095 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224097 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224100 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224103 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224105 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224108 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224110 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224113 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224117 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:48:06.224138 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224121 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224124 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224127 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224130 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224132 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224135 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224137 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224140 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224144 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224147 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224150 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224153 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224157 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224160 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224162 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224166 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224168 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224171 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224173 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224176 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:48:06.224678 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224179 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224181 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224184 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224186 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224189 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224191 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224194 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224197 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224199 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224202 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224204 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224207 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224209 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224213 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224216 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224218 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224221 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224224 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224226 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224229 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:48:06.225445 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224231 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224234 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224236 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224239 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224241 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224247 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224251 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224254 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224257 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224260 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224263 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224266 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224268 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224271 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224273 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224276 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224292 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224296 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224300 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:48:06.226198 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224303 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224306 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224309 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224312 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224315 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224317 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224321 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224324 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224326 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224329 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224332 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224334 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224337 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224339 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224342 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224345 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224347 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224350 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.224359 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226811 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:48:06.226989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226828 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226834 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226839 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226846 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226853 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226858 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226862 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226866 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226870 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226875 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226879 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226883 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226887 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226891 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226895 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226900 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226904 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226907 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226911 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226915 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:48:06.227930 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226920 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226924 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226928 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226932 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226936 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226940 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226944 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226948 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226953 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226957 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226962 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226967 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226971 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226976 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226980 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226984 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226988 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226992 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226995 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.226999 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:48:06.228837 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227003 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227007 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227010 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227015 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227020 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227024 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227029 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227033 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227037 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227043 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227047 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227052 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227056 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227060 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227064 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227068 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227072 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227077 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227081 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:48:06.229721 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227085 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227089 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227093 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227098 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227102 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227106 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227110 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227114 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227119 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227123 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227127 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227131 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227135 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227141 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227148 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227152 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227157 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227161 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227166 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:48:06.230413 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227170 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227174 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227178 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227183 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227189 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227193 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227198 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227201 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227205 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227210 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227214 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227218 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227222 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227227 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227231 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227235 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227240 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227244 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227248 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227252 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:48:06.230897 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227901 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227912 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227917 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227921 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227926 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227931 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227935 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227939 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227945 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227949 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227954 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227958 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227962 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227966 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227970 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227974 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227980 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227984 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227988 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227992 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:48:06.231406 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.227997 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228001 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228006 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228010 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228014 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228018 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228023 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228027 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228031 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228036 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228040 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228044 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228048 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228053 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228057 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228061 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228065 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228070 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228074 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228078 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:48:06.232087 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228082 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228086 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228090 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228094 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228100 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228104 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228108 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228112 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228119 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228126 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228132 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228138 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228143 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228149 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228154 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228158 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228162 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228166 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228171 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228175 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:48:06.232610 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228179 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228183 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228187 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228192 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228196 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228200 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228204 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228208 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228212 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228217 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228220 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228225 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228229 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228233 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228237 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228241 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228245 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228250 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228254 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228258 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:48:06.233187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228262 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228266 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228272 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228296 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228301 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228305 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228311 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228316 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228320 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228327 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228332 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228336 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228340 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228344 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228348 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228362 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228368 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228372 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.228376 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228485 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 03:48:06.233723 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228535 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228545 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228552 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228558 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228564 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228570 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228577 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228582 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228586 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228593 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228599 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228604 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228609 2581 flags.go:64] FLAG: --cgroup-root="" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228614 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228618 2581 flags.go:64] FLAG: --client-ca-file="" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228624 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228629 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228635 2581 flags.go:64] FLAG: --cluster-domain="" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228640 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228645 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228650 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228658 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228664 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 03:48:06.234225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228669 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228674 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228680 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228685 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228690 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228694 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228699 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228704 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228710 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228717 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228722 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228727 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228731 2581 flags.go:64] FLAG: --enable-server="true" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228736 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228743 2581 flags.go:64] FLAG: --event-burst="100" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228748 2581 flags.go:64] FLAG: --event-qps="50" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228752 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228757 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228762 2581 flags.go:64] FLAG: --eviction-hard="" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228768 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228772 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228778 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228783 2581 flags.go:64] FLAG: --eviction-soft="" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228788 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228792 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 03:48:06.234804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228798 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228803 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228807 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228812 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228816 2581 flags.go:64] FLAG: --feature-gates="" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228824 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228829 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228833 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228838 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228843 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228848 2581 flags.go:64] FLAG: --help="false" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228852 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228857 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228862 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228867 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228872 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228878 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228883 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228887 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228892 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228897 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228901 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228907 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228912 2581 flags.go:64] FLAG: --kube-reserved="" Sep 10 03:48:06.235439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228917 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228922 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228927 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228931 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228936 2581 flags.go:64] FLAG: --lock-file="" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228941 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228945 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228950 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228959 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228966 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228970 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228975 2581 flags.go:64] FLAG: --logging-format="text" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228980 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228987 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228991 2581 flags.go:64] FLAG: --manifest-url="" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.228995 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229002 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229007 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229013 2581 flags.go:64] FLAG: --max-pods="110" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229017 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229022 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229027 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229032 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229037 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229042 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 03:48:06.236029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229047 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229057 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229063 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229067 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229072 2581 flags.go:64] FLAG: --pod-cidr="" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229077 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229085 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229090 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229094 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229099 2581 flags.go:64] FLAG: --port="10250" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229104 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229108 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-028bcbb2f5cd47b3f" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229114 2581 flags.go:64] FLAG: --qos-reserved="" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229118 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229123 2581 flags.go:64] FLAG: --register-node="true" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229128 2581 flags.go:64] FLAG: --register-with-taints="" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229134 2581 flags.go:64] FLAG: --registry-burst="10" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229139 2581 flags.go:64] FLAG: --registry-qps="5" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229144 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229149 2581 flags.go:64] FLAG: --reserved-memory="" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229154 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229161 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229166 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229170 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229175 2581 flags.go:64] FLAG: --runonce="false" Sep 10 03:48:06.236764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229180 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229185 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229190 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229194 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229199 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229205 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229210 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229215 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229220 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229224 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229229 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229234 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229238 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229243 2581 flags.go:64] FLAG: --system-cgroups="" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229248 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229256 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229261 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229265 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229272 2581 flags.go:64] FLAG: --tls-min-version="" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229294 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229300 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229304 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229309 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229314 2581 flags.go:64] FLAG: --v="2" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229320 2581 flags.go:64] FLAG: --version="false" Sep 10 03:48:06.237460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229327 2581 flags.go:64] FLAG: --vmodule="" Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229333 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.229338 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229545 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229553 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229558 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229563 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229567 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229571 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229576 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229580 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229585 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229589 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229594 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229598 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229602 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229606 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229611 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229615 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229619 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:48:06.238073 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229624 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229628 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229632 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229639 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229645 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229650 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229654 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229659 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229663 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229668 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229672 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229676 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229680 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229686 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229690 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229696 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229700 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229704 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229710 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:48:06.238586 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229716 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229720 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229724 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229727 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229733 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229739 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229745 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229749 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229754 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229758 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229762 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229767 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229771 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229775 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229779 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229783 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229787 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229792 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229796 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:48:06.239041 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229800 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229804 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229808 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229812 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229816 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229820 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229824 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229828 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229834 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229840 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229844 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229848 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229852 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229857 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229861 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229865 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229869 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229874 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229878 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229882 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:48:06.239529 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229886 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229891 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229895 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229899 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229903 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229907 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229912 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229916 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229920 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229924 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229928 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229933 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229937 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229941 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229945 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229949 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229953 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229957 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229961 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229965 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:48:06.240018 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229969 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229984 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229988 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.229992 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.230000 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.238417 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.238433 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.238451 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.238461 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238516 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238521 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238524 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238527 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238530 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238532 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:48:06.240637 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238535 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238538 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238541 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238544 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238547 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238549 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238552 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238555 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238557 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238560 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238562 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238565 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238567 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238570 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238572 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238575 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238578 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238580 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238583 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238585 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:48:06.241017 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238588 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238591 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238594 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238598 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238601 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238603 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238606 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238608 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238611 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238613 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238617 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238621 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238624 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238627 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238629 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238632 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238635 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238637 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238640 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:48:06.241527 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238642 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238645 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238648 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238650 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238653 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238656 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238658 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238661 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238664 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238666 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238669 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238672 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238674 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238677 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238680 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238682 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238685 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238688 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238691 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:48:06.241989 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238694 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238696 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238699 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238702 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238705 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238709 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238713 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238716 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238719 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238722 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238725 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238728 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238731 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238734 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238736 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238739 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238743 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238745 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238748 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:48:06.242472 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238751 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238753 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238756 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238758 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238761 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238763 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238766 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238769 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238772 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238774 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238777 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238780 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238783 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238786 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238788 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:48:06.242934 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238791 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.238796 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238933 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238938 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238944 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238947 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238950 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238953 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238956 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238958 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238963 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238966 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238970 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238973 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238976 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:48:06.243315 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238978 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238981 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238984 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238987 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238989 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238992 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238996 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.238999 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239002 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239005 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239008 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239010 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239013 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239016 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239018 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239022 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239025 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239027 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239030 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239032 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:48:06.243683 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239035 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239038 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239041 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239043 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239046 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239048 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239051 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239054 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239056 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239059 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239061 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239064 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239066 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239069 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239071 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239074 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239077 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239079 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239082 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239084 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:48:06.244164 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239087 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239089 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239092 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239094 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239097 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239100 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239102 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239104 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239108 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239110 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239113 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239115 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239117 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239120 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239122 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239125 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239127 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239130 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239132 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:48:06.244725 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239134 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239137 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239140 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239142 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239145 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239147 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239150 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239152 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239155 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239158 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239160 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239163 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239165 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239167 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239170 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239172 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239175 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239177 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239180 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:48:06.245187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239182 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239185 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239187 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239190 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239193 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239196 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239199 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:06.239202 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.239206 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.239338 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.241673 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.242655 2581 server.go:1019] "Starting client certificate rotation" Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.242749 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 03:48:06.245676 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.243499 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 03:48:06.246033 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.245388 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 03:48:06.248819 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.248802 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 03:48:06.258593 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.258570 2581 log.go:25] "Validated CRI v1 runtime API" Sep 10 03:48:06.261735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.261720 2581 log.go:25] "Validated CRI v1 image API" Sep 10 03:48:06.263360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.263346 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 03:48:06.267137 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.267110 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85c9b9a8-ddf8-4dd6-bf4e-29776cabd57a:/dev/nvme0n1p3 b3d3aaea-ed84-459e-9a4f-13cb6465d309:/dev/nvme0n1p4] Sep 10 03:48:06.267220 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.267135 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 03:48:06.268855 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.268833 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 03:48:06.273373 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.273244 2581 manager.go:216] Machine: {Timestamp:2026-09-10 03:48:06.271914627 +0000 UTC m=+0.358659181 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100403 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d6e2c802039a07fc9a2774765e543 SystemUUID:ec2d6e2c-8020-39a0-7fc9-a2774765e543 BootID:8a924591-7dce-436e-a59c-06b310fcec05 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4d:d3:b7:56:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4d:d3:b7:56:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:c6:b7:63:62:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 03:48:06.273373 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.273366 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 03:48:06.273527 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.273480 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 03:48:06.276768 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.276739 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 03:48:06.276939 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.276771 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 03:48:06.277655 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.277643 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 03:48:06.277707 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.277661 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 03:48:06.277707 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.277672 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 03:48:06.278608 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.278596 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 03:48:06.280343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.280332 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 03:48:06.284791 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.284777 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 10 03:48:06.284932 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.284921 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 03:48:06.284986 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.284962 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 10 03:48:06.285031 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.284986 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 03:48:06.285031 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.285002 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 03:48:06.285031 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.285018 2581 kubelet.go:398] "Adding apiserver pod source" Sep 10 03:48:06.285031 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.285030 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 03:48:06.285414 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.285401 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 03:48:06.285476 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.285424 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 03:48:06.287877 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.287858 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 03:48:06.291339 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.291316 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 03:48:06.291457 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.291346 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 03:48:06.291526 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.291516 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 03:48:06.291564 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.291532 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 03:48:06.291564 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.291538 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 03:48:06.291564 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.291543 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 03:48:06.291564 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.291552 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 03:48:06.291564 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.291560 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 03:48:06.292570 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.292546 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 03:48:06.292570 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.292568 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 03:48:06.292693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.292581 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 03:48:06.292693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.292591 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 03:48:06.292693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.292605 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 03:48:06.292693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.292617 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 03:48:06.293412 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.293397 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 03:48:06.293412 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.293412 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 03:48:06.293983 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.293956 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rthvt" Sep 10 03:48:06.295174 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.295128 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 03:48:06.295174 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.295127 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 03:48:06.296614 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.296596 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 03:48:06.298440 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.298426 2581 server.go:1268] "Started kubelet" Sep 10 03:48:06.298534 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.298503 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 03:48:06.298571 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.298509 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 03:48:06.298571 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.298562 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 03:48:06.299505 ip-10-0-130-114 systemd[1]: Started Kubernetes Kubelet. Sep 10 03:48:06.300525 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.299898 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 03:48:06.300525 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.300094 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rthvt" Sep 10 03:48:06.301392 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.301375 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 10 03:48:06.304749 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.304729 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 03:48:06.305511 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.304420 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-114.ec2.internal.18d3d9038eb24979 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-114.ec2.internal,UID:ip-10-0-130-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-114.ec2.internal,},FirstTimestamp:2026-09-10 03:48:06.298397049 +0000 UTC m=+0.385141602,LastTimestamp:2026-09-10 03:48:06.298397049 +0000 UTC m=+0.385141602,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-114.ec2.internal,}" Sep 10 03:48:06.308326 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.308306 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 03:48:06.308326 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.308314 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 03:48:06.308484 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.308401 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:06.309010 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.308994 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 03:48:06.309179 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309059 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 03:48:06.309245 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309231 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 03:48:06.309319 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309192 2581 factory.go:55] Registering systemd factory Sep 10 03:48:06.309319 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309266 2581 factory.go:223] Registration of the systemd container factory successfully Sep 10 03:48:06.309429 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309387 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 10 03:48:06.309429 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309397 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 10 03:48:06.309517 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309486 2581 factory.go:153] Registering CRI-O factory Sep 10 03:48:06.309517 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309500 2581 factory.go:223] Registration of the crio container factory successfully Sep 10 03:48:06.309583 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309548 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 03:48:06.309583 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309568 2581 factory.go:103] Registering Raw factory Sep 10 03:48:06.309653 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309587 2581 manager.go:1196] Started watching for new ooms in manager Sep 10 03:48:06.309962 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.309948 2581 manager.go:349] Starting recovery of all containers Sep 10 03:48:06.310255 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.310235 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 03:48:06.310411 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.310392 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 03:48:06.322054 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.321879 2581 manager.go:354] Recovery completed Sep 10 03:48:06.326658 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.326644 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:48:06.328418 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.328400 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:48:06.328484 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.328432 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:48:06.328484 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.328446 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:48:06.329030 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.329012 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 03:48:06.329030 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.329027 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 03:48:06.329145 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.329042 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 10 03:48:06.329145 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.329054 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:48:06.329722 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.329706 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:48:06.329766 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.329737 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:48:06.329766 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.329751 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:48:06.331035 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.331022 2581 policy_none.go:49] "None policy: Start" Sep 10 03:48:06.331080 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.331038 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 03:48:06.331080 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.331048 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 03:48:06.332970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.332952 2581 policy_none.go:47] "Start" Sep 10 03:48:06.365885 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.365869 2581 manager.go:337] "Starting Device Plugin manager" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.365911 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.365924 2581 server.go:87] "Starting device plugin registration server" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.366237 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.366247 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.366416 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.366516 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.366525 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.366999 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 03:48:06.387195 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.367052 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:06.408486 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.408442 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 03:48:06.409627 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.409607 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 03:48:06.409735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.409656 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 03:48:06.409735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.409683 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 03:48:06.409824 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.409781 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 03:48:06.411722 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.411701 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:48:06.466358 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.466319 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:48:06.468209 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.468128 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:48:06.468209 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.468164 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:48:06.468209 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.468177 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:48:06.468209 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.468202 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.475338 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.475324 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.475404 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.475347 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-114.ec2.internal\": node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:06.484546 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.484523 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:06.510893 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.510868 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal"] Sep 10 03:48:06.510994 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.510947 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:48:06.512405 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.512390 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:48:06.512474 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.512420 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:48:06.512474 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.512430 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:48:06.514613 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.514601 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:48:06.514744 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.514727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.514798 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.514758 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:48:06.515318 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.515305 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:48:06.515386 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.515326 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:48:06.515386 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.515341 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:48:06.515386 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.515354 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:48:06.515386 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.515375 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:48:06.515386 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.515389 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:48:06.517700 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.517688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.517772 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.517708 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:48:06.520092 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.520075 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:48:06.520171 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.520103 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:48:06.520171 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.520114 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:48:06.532836 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.532817 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-114.ec2.internal\" not found" node="ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.537545 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.537530 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-114.ec2.internal\" not found" node="ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.584733 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.584703 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:06.609898 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.609868 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9d2cc66555243be47c137309efc2491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal\" (UID: \"c9d2cc66555243be47c137309efc2491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.609898 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.609901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9d2cc66555243be47c137309efc2491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal\" (UID: \"c9d2cc66555243be47c137309efc2491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.610070 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.609924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9806b07f29bbc4ff6eec20e03f82108e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-114.ec2.internal\" (UID: \"9806b07f29bbc4ff6eec20e03f82108e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.685044 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.685003 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:06.710312 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.710291 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9d2cc66555243be47c137309efc2491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal\" (UID: \"c9d2cc66555243be47c137309efc2491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.710399 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.710315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9d2cc66555243be47c137309efc2491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal\" (UID: \"c9d2cc66555243be47c137309efc2491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.710399 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.710332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9806b07f29bbc4ff6eec20e03f82108e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-114.ec2.internal\" (UID: \"9806b07f29bbc4ff6eec20e03f82108e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.710399 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.710359 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9806b07f29bbc4ff6eec20e03f82108e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-114.ec2.internal\" (UID: \"9806b07f29bbc4ff6eec20e03f82108e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.710487 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.710394 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9d2cc66555243be47c137309efc2491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal\" (UID: \"c9d2cc66555243be47c137309efc2491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.710487 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.710399 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9d2cc66555243be47c137309efc2491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal\" (UID: \"c9d2cc66555243be47c137309efc2491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.785654 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.785570 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:06.836136 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.836109 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.841025 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:06.841008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" Sep 10 03:48:06.885966 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.885934 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:06.986476 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:06.986436 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:07.092031 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:07.091961 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:07.159201 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.159177 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:48:07.193674 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:07.193644 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:07.243883 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.243858 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 03:48:07.244399 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.243997 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 03:48:07.244399 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.244057 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 03:48:07.293733 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:07.293699 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:07.310447 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.310397 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 03:43:06 +0000 UTC" deadline="2028-02-28 09:03:19.842427891 +0000 UTC" Sep 10 03:48:07.310447 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.310440 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12869h15m12.531990363s" Sep 10 03:48:07.394696 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:07.394625 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:07.453133 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:07.453095 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9806b07f29bbc4ff6eec20e03f82108e.slice/crio-ea6511b26501b41ec2eb2bbbd9efa3dee4d5381f2d7660ac508d4882d5bca9f9 WatchSource:0}: Error finding container ea6511b26501b41ec2eb2bbbd9efa3dee4d5381f2d7660ac508d4882d5bca9f9: Status 404 returned error can't find the container with id ea6511b26501b41ec2eb2bbbd9efa3dee4d5381f2d7660ac508d4882d5bca9f9 Sep 10 03:48:07.457895 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.457873 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:48:07.463603 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:07.463574 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d2cc66555243be47c137309efc2491.slice/crio-62f6b808fed033053a39328a8a15e9e988c3ba8f67b48be7b5564e2f9351ec7d WatchSource:0}: Error finding container 62f6b808fed033053a39328a8a15e9e988c3ba8f67b48be7b5564e2f9351ec7d: Status 404 returned error can't find the container with id 62f6b808fed033053a39328a8a15e9e988c3ba8f67b48be7b5564e2f9351ec7d Sep 10 03:48:07.473359 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.473336 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:48:07.495585 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:07.495548 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:07.601604 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:07.601564 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-114.ec2.internal\" not found" Sep 10 03:48:07.685882 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.685802 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:48:07.708826 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.708800 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" Sep 10 03:48:07.720407 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.720389 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 03:48:07.722031 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.722016 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" Sep 10 03:48:07.730606 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:07.730588 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 03:48:08.285485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.285447 2581 apiserver.go:52] "Watching apiserver" Sep 10 03:48:08.291902 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.291877 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 03:48:08.292509 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.292482 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-qbqrq","openshift-network-operator/iptables-alerter-sswwj","kube-system/konnectivity-agent-jlhcl","kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls","openshift-cluster-node-tuning-operator/tuned-g9xpf","openshift-image-registry/node-ca-jthcf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal","openshift-network-diagnostics/network-check-target-zb7qm","openshift-ovn-kubernetes/ovnkube-node-rcv2r","kube-system/global-pull-secret-syncer-jmwqm","openshift-dns/node-resolver-5j58k","openshift-multus/multus-additional-cni-plugins-cl45v","openshift-multus/multus-dkzjx"] Sep 10 03:48:08.295484 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.295319 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.298479 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.297685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.298479 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.297856 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 03:48:08.298479 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.298324 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 03:48:08.298693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.298521 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pjs29\"" Sep 10 03:48:08.298693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.298555 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 03:48:08.298693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.298522 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 03:48:08.298693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.298590 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 03:48:08.298693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.298522 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 03:48:08.299654 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.299633 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-db8gj\"" Sep 10 03:48:08.300085 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.300034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:08.300925 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.300905 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 03:48:08.301140 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.301125 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 03:48:08.301211 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.301168 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 03:48:08.301553 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.301408 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 03:48:08.301553 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.301481 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 03:48:08.302591 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.302248 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 03:48:08.304193 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.302743 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jwtgd\"" Sep 10 03:48:08.304193 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.302765 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 03:48:08.304570 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.304546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.307823 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.307545 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 03:48:08.307823 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.307559 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c28mh\"" Sep 10 03:48:08.307823 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.307643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.308945 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.308910 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 03:48:08.310256 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.310222 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5qcs5\"" Sep 10 03:48:08.310430 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.310413 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 03:48:08.310815 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.310509 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 03:48:08.310815 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.310623 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 03:48:08.310943 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.310874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.312554 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.312530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:08.312670 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.312591 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:08.313498 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.313083 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 03:48:08.313498 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.313370 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-72khx\"" Sep 10 03:48:08.313498 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.313474 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:48:08.315790 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.315670 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.318527 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.317809 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nvfb8\"" Sep 10 03:48:08.318527 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.317995 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 03:48:08.318527 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.318159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.318527 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.318192 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 03:48:08.318527 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.318412 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 03:48:08.319430 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.319410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-system-cni-dir\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.319595 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.319580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-slash\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.319762 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.319745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovn-node-metrics-cert\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.319882 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.319867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-hostroot\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.322291 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.320672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:48:08.322291 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.320744 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:08.322291 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.321534 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:08.322291 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.320979 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dwkww\"" Sep 10 03:48:08.322291 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.321648 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 03:48:08.322291 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.321897 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 03:48:08.322291 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322281 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-kubelet\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-log-socket\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-cni-netd\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1462abc-77ef-4c23-a61d-1608ebe5e587-cni-binary-copy\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-netns\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-lib-modules\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-cni-bin\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-env-overrides\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovnkube-script-lib\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rp45\" (UniqueName: \"kubernetes.io/projected/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-kube-api-access-5rp45\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj2mq\" (UniqueName: \"kubernetes.io/projected/c1462abc-77ef-4c23-a61d-1608ebe5e587-kube-api-access-wj2mq\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-host\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-var-lib-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-cnibin\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-cni-multus\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.322757 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-ovn\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322803 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c477870-a33b-4127-ae85-853dd8e11e71-konnectivity-ca\") pod \"konnectivity-agent-jlhcl\" (UID: \"2c477870-a33b-4127-ae85-853dd8e11e71\") " pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-multus-certs\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-socket-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-etc-kubernetes\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysctl-conf\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-run\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.322998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-sys\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-tmp\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c477870-a33b-4127-ae85-853dd8e11e71-agent-certs\") pod \"konnectivity-agent-jlhcl\" (UID: \"2c477870-a33b-4127-ae85-853dd8e11e71\") " pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-cni-bin\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovnkube-config\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xtgz\" (UniqueName: \"kubernetes.io/projected/9e808c01-d8f7-4a4e-a515-139306ee349a-kube-api-access-8xtgz\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-var-lib-kubelet\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-node-log\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.323579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-systemd-units\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-cni-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-systemd\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-cni-binary-copy\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-systemd\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-cnibin\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-system-cni-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-daemon-config\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysctl-d\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-conf-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-sys-fs\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-kubernetes\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-tuned\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.324343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qvq4\" (UniqueName: \"kubernetes.io/projected/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-kube-api-access-2qvq4\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-socket-dir-parent\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-k8s-cni-cncf-io\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-kubelet\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-etc-selinux\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323806 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-run-netns\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-etc-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-modprobe-d\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysconfig\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-registration-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-device-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.325121 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.323955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jpps\" (UniqueName: \"kubernetes.io/projected/5f40f003-ea31-4103-bdf0-7ac2de43b91b-kube-api-access-2jpps\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.326192 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.326174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.326286 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.326240 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:08.329163 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.328654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.331321 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.331165 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2n9gp\"" Sep 10 03:48:08.331321 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.331172 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 03:48:08.331321 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.331207 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 03:48:08.347682 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.347658 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c8qrh" Sep 10 03:48:08.356483 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.356453 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c8qrh" Sep 10 03:48:08.410179 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.410152 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 03:48:08.416120 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.416069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" event={"ID":"c9d2cc66555243be47c137309efc2491","Type":"ContainerStarted","Data":"62f6b808fed033053a39328a8a15e9e988c3ba8f67b48be7b5564e2f9351ec7d"} Sep 10 03:48:08.418209 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.418179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" event={"ID":"9806b07f29bbc4ff6eec20e03f82108e","Type":"ContainerStarted","Data":"ea6511b26501b41ec2eb2bbbd9efa3dee4d5381f2d7660ac508d4882d5bca9f9"} Sep 10 03:48:08.424558 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-run-netns\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.424706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7904bd49-0bf4-408c-bd29-4122534b2ffe-hosts-file\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.424706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtt7h\" (UniqueName: \"kubernetes.io/projected/7904bd49-0bf4-408c-bd29-4122534b2ffe-kube-api-access-mtt7h\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.424706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-etc-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.424706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-run-netns\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.424706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-modprobe-d\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.424706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysconfig\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.424706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee209070-209c-4cf0-89dc-c75311b7511c-host-slash\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f4rh\" (UniqueName: \"kubernetes.io/projected/ee209070-209c-4cf0-89dc-c75311b7511c-kube-api-access-6f4rh\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-registration-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424802 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-modprobe-d\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-device-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jpps\" (UniqueName: \"kubernetes.io/projected/5f40f003-ea31-4103-bdf0-7ac2de43b91b-kube-api-access-2jpps\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424849 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-etc-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-system-cni-dir\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-slash\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysconfig\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovn-node-metrics-cert\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-hostroot\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.424985 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-registration-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-kubelet\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-log-socket\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-cni-netd\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1462abc-77ef-4c23-a61d-1608ebe5e587-cni-binary-copy\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-device-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-netns\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-lib-modules\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-netns\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gz9f\" (UniqueName: \"kubernetes.io/projected/3fef3c33-f7c3-4733-9d77-a4380a911689-kube-api-access-5gz9f\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425263 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-system-cni-dir\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-kubelet\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-slash\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-cni-bin\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-env-overrides\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovnkube-script-lib\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rp45\" (UniqueName: \"kubernetes.io/projected/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-kube-api-access-5rp45\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj2mq\" (UniqueName: \"kubernetes.io/projected/c1462abc-77ef-4c23-a61d-1608ebe5e587-kube-api-access-wj2mq\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-host\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.425944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-var-lib-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-cnibin\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-cni-multus\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425741 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-lib-modules\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-hostroot\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-log-socket\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-var-lib-openvswitch\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.425949 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-cni-netd\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426118 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-host\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426111 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1462abc-77ef-4c23-a61d-1608ebe5e587-cni-binary-copy\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426581 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-cnibin\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-env-overrides\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426633 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-cni-bin\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426631 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-cni-multus\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.426863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-ovn\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c477870-a33b-4127-ae85-853dd8e11e71-konnectivity-ca\") pod \"konnectivity-agent-jlhcl\" (UID: \"2c477870-a33b-4127-ae85-853dd8e11e71\") " pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-multus-certs\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-socket-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52vct\" (UniqueName: \"kubernetes.io/projected/c4de56fa-4cd4-4d54-84d5-393d7ef36599-kube-api-access-52vct\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-etc-kubernetes\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysctl-conf\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-run\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-sys\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-tmp\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c477870-a33b-4127-ae85-853dd8e11e71-agent-certs\") pod \"konnectivity-agent-jlhcl\" (UID: \"2c477870-a33b-4127-ae85-853dd8e11e71\") " pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-cni-bin\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovnkube-config\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426959 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-ovn\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.426974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xtgz\" (UniqueName: \"kubernetes.io/projected/9e808c01-d8f7-4a4e-a515-139306ee349a-kube-api-access-8xtgz\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-var-lib-kubelet\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427001 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovnkube-script-lib\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.427781 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f2981a-c311-4911-a567-44284bb8e026-dbus\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-node-log\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-systemd-units\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-multus-certs\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-cni-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-systemd\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427136 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-etc-kubernetes\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-cni-binary-copy\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f2981a-c311-4911-a567-44284bb8e026-kubelet-config\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7904bd49-0bf4-408c-bd29-4122534b2ffe-tmp-dir\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fef3c33-f7c3-4733-9d77-a4380a911689-host\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-systemd\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-cnibin\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-system-cni-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-daemon-config\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427281 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysctl-conf\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.428665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysctl-d\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-run\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-conf-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-sys-fs\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-kubernetes\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-tuned\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qvq4\" (UniqueName: \"kubernetes.io/projected/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-kube-api-access-2qvq4\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c477870-a33b-4127-ae85-853dd8e11e71-konnectivity-ca\") pod \"konnectivity-agent-jlhcl\" (UID: \"2c477870-a33b-4127-ae85-853dd8e11e71\") " pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee209070-209c-4cf0-89dc-c75311b7511c-iptables-alerter-script\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-socket-dir-parent\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-k8s-cni-cncf-io\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-kubelet\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-etc-selinux\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427642 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-socket-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.429575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fef3c33-f7c3-4733-9d77-a4380a911689-serviceca\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427805 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.428113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-sysctl-d\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.428358 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-var-lib-kubelet\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.428438 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-node-log\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.428489 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-systemd-units\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.428532 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.428594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-cni-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.428694 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-systemd\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427110 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-cni-bin\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.428842 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovnkube-config\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-socket-dir-parent\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429170 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-cni-binary-copy\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-var-lib-kubelet\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-etc-selinux\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.430485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429292 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-run-systemd\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429396 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-system-cni-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429462 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-conf-dir\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e808c01-d8f7-4a4e-a515-139306ee349a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e808c01-d8f7-4a4e-a515-139306ee349a-cnibin\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429545 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f40f003-ea31-4103-bdf0-7ac2de43b91b-sys-fs\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.427387 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-sys\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429172 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1462abc-77ef-4c23-a61d-1608ebe5e587-host-run-k8s-cni-cncf-io\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429545 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-kubernetes\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.429926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1462abc-77ef-4c23-a61d-1608ebe5e587-multus-daemon-config\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.430686 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-tmp\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.431400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.431126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-ovn-node-metrics-cert\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.431950 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.431930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-etc-tuned\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.434882 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.434178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c477870-a33b-4127-ae85-853dd8e11e71-agent-certs\") pod \"konnectivity-agent-jlhcl\" (UID: \"2c477870-a33b-4127-ae85-853dd8e11e71\") " pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:08.434882 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.434667 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rp45\" (UniqueName: \"kubernetes.io/projected/38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5-kube-api-access-5rp45\") pod \"ovnkube-node-rcv2r\" (UID: \"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.434882 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.434670 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj2mq\" (UniqueName: \"kubernetes.io/projected/c1462abc-77ef-4c23-a61d-1608ebe5e587-kube-api-access-wj2mq\") pod \"multus-dkzjx\" (UID: \"c1462abc-77ef-4c23-a61d-1608ebe5e587\") " pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.435339 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.435297 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jpps\" (UniqueName: \"kubernetes.io/projected/5f40f003-ea31-4103-bdf0-7ac2de43b91b-kube-api-access-2jpps\") pod \"aws-ebs-csi-driver-node-658ls\" (UID: \"5f40f003-ea31-4103-bdf0-7ac2de43b91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.436702 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.436679 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xtgz\" (UniqueName: \"kubernetes.io/projected/9e808c01-d8f7-4a4e-a515-139306ee349a-kube-api-access-8xtgz\") pod \"multus-additional-cni-plugins-cl45v\" (UID: \"9e808c01-d8f7-4a4e-a515-139306ee349a\") " pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.436979 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.436958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qvq4\" (UniqueName: \"kubernetes.io/projected/96ba800e-f7f5-4030-970e-5e0a72e3bc3c-kube-api-access-2qvq4\") pod \"tuned-g9xpf\" (UID: \"96ba800e-f7f5-4030-970e-5e0a72e3bc3c\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.525984 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.525951 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:48:08.528223 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52vct\" (UniqueName: \"kubernetes.io/projected/c4de56fa-4cd4-4d54-84d5-393d7ef36599-kube-api-access-52vct\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:08.528396 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f2981a-c311-4911-a567-44284bb8e026-dbus\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.528396 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528342 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f2981a-c311-4911-a567-44284bb8e026-dbus\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.528396 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f2981a-c311-4911-a567-44284bb8e026-kubelet-config\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.528560 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7904bd49-0bf4-408c-bd29-4122534b2ffe-tmp-dir\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.528560 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fef3c33-f7c3-4733-9d77-a4380a911689-host\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.528560 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f2981a-c311-4911-a567-44284bb8e026-kubelet-config\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.528720 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:08.528720 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3fef3c33-f7c3-4733-9d77-a4380a911689-host\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.528720 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee209070-209c-4cf0-89dc-c75311b7511c-iptables-alerter-script\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.528720 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fef3c33-f7c3-4733-9d77-a4380a911689-serviceca\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.528909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7904bd49-0bf4-408c-bd29-4122534b2ffe-hosts-file\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.528909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtt7h\" (UniqueName: \"kubernetes.io/projected/7904bd49-0bf4-408c-bd29-4122534b2ffe-kube-api-access-mtt7h\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.528909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee209070-209c-4cf0-89dc-c75311b7511c-host-slash\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.528909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f4rh\" (UniqueName: \"kubernetes.io/projected/ee209070-209c-4cf0-89dc-c75311b7511c-kube-api-access-6f4rh\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.528909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:08.528909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gz9f\" (UniqueName: \"kubernetes.io/projected/3fef3c33-f7c3-4733-9d77-a4380a911689-kube-api-access-5gz9f\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.529214 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.528927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:08.529214 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.529015 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7904bd49-0bf4-408c-bd29-4122534b2ffe-hosts-file\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.529214 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.529033 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:08.529214 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.529121 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:09.029104968 +0000 UTC m=+3.115849540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:08.529214 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.529141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7904bd49-0bf4-408c-bd29-4122534b2ffe-tmp-dir\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.529214 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.529176 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee209070-209c-4cf0-89dc-c75311b7511c-host-slash\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.529544 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.529225 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3fef3c33-f7c3-4733-9d77-a4380a911689-serviceca\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.529544 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.529236 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:08.529544 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.529316 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret podName:18f2981a-c311-4911-a567-44284bb8e026 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:09.029296169 +0000 UTC m=+3.116040726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret") pod "global-pull-secret-syncer-jmwqm" (UID: "18f2981a-c311-4911-a567-44284bb8e026") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:08.529544 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.529315 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee209070-209c-4cf0-89dc-c75311b7511c-iptables-alerter-script\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.536257 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.536197 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:48:08.536257 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.536227 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:48:08.536257 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.536241 2581 projected.go:196] Error preparing data for projected volume kube-api-access-f5jmf for pod openshift-network-diagnostics/network-check-target-zb7qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:08.536505 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:08.536297 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf podName:7d13a62c-bdde-4480-a8fc-4847a9167552 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:09.036280236 +0000 UTC m=+3.123024799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f5jmf" (UniqueName: "kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf") pod "network-check-target-zb7qm" (UID: "7d13a62c-bdde-4480-a8fc-4847a9167552") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:08.538474 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.538446 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gz9f\" (UniqueName: \"kubernetes.io/projected/3fef3c33-f7c3-4733-9d77-a4380a911689-kube-api-access-5gz9f\") pod \"node-ca-jthcf\" (UID: \"3fef3c33-f7c3-4733-9d77-a4380a911689\") " pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.539106 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.539045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52vct\" (UniqueName: \"kubernetes.io/projected/c4de56fa-4cd4-4d54-84d5-393d7ef36599-kube-api-access-52vct\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:08.539278 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.539216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtt7h\" (UniqueName: \"kubernetes.io/projected/7904bd49-0bf4-408c-bd29-4122534b2ffe-kube-api-access-mtt7h\") pod \"node-resolver-5j58k\" (UID: \"7904bd49-0bf4-408c-bd29-4122534b2ffe\") " pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:08.540432 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.540406 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f4rh\" (UniqueName: \"kubernetes.io/projected/ee209070-209c-4cf0-89dc-c75311b7511c-kube-api-access-6f4rh\") pod \"iptables-alerter-sswwj\" (UID: \"ee209070-209c-4cf0-89dc-c75311b7511c\") " pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.611277 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.611233 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:08.619470 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.619444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cl45v" Sep 10 03:48:08.632598 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.632575 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:08.637501 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.637481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dkzjx" Sep 10 03:48:08.646422 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.646400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" Sep 10 03:48:08.655388 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.655371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" Sep 10 03:48:08.664129 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.664107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jthcf" Sep 10 03:48:08.672994 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.672974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sswwj" Sep 10 03:48:08.679861 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:08.679837 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5j58k" Sep 10 03:48:09.033564 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:09.033483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:09.033564 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:09.033522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:09.033741 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.033641 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:09.033741 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.033643 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:09.033741 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.033698 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:10.033682553 +0000 UTC m=+4.120427115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:09.033741 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.033713 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret podName:18f2981a-c311-4911-a567-44284bb8e026 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:10.033706886 +0000 UTC m=+4.120451428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret") pod "global-pull-secret-syncer-jmwqm" (UID: "18f2981a-c311-4911-a567-44284bb8e026") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:09.133893 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:09.133863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:09.134091 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.134020 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:48:09.134091 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.134041 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:48:09.134091 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.134053 2581 projected.go:196] Error preparing data for projected volume kube-api-access-f5jmf for pod openshift-network-diagnostics/network-check-target-zb7qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:09.134258 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.134120 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf podName:7d13a62c-bdde-4480-a8fc-4847a9167552 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:10.134100841 +0000 UTC m=+4.220845402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5jmf" (UniqueName: "kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf") pod "network-check-target-zb7qm" (UID: "7d13a62c-bdde-4480-a8fc-4847a9167552") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:09.315027 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:09.314934 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:48:09.360276 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:09.360227 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 03:43:08 +0000 UTC" deadline="2028-06-23 12:37:54.154452858 +0000 UTC" Sep 10 03:48:09.360276 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:09.360272 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15656h49m44.794187155s" Sep 10 03:48:09.410735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:09.410693 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:09.410892 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:09.410812 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:09.443799 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.443374 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38386ca5_7c52_40e2_bdc9_7a2f33dcc2c5.slice/crio-8e8e0e585715354e785fdcced3a9ee5c8b92b553657571dba6f13e276b268958 WatchSource:0}: Error finding container 8e8e0e585715354e785fdcced3a9ee5c8b92b553657571dba6f13e276b268958: Status 404 returned error can't find the container with id 8e8e0e585715354e785fdcced3a9ee5c8b92b553657571dba6f13e276b268958 Sep 10 03:48:09.445417 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.445324 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f40f003_ea31_4103_bdf0_7ac2de43b91b.slice/crio-24bff4e37cfe04d0c4e88dbc6358847f8f5bb84613847376a5342ab6545320f0 WatchSource:0}: Error finding container 24bff4e37cfe04d0c4e88dbc6358847f8f5bb84613847376a5342ab6545320f0: Status 404 returned error can't find the container with id 24bff4e37cfe04d0c4e88dbc6358847f8f5bb84613847376a5342ab6545320f0 Sep 10 03:48:09.447014 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.446596 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fef3c33_f7c3_4733_9d77_a4380a911689.slice/crio-05f48b7852c6ffb70a156436e78d508abe7a0e5a50696ced71422356bccfd2f9 WatchSource:0}: Error finding container 05f48b7852c6ffb70a156436e78d508abe7a0e5a50696ced71422356bccfd2f9: Status 404 returned error can't find the container with id 05f48b7852c6ffb70a156436e78d508abe7a0e5a50696ced71422356bccfd2f9 Sep 10 03:48:09.448567 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.448540 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7904bd49_0bf4_408c_bd29_4122534b2ffe.slice/crio-b95e6c1594376b71f087ec5918b9f0ee87a4ea06ba1d66a93dc38e87a3d66550 WatchSource:0}: Error finding container b95e6c1594376b71f087ec5918b9f0ee87a4ea06ba1d66a93dc38e87a3d66550: Status 404 returned error can't find the container with id b95e6c1594376b71f087ec5918b9f0ee87a4ea06ba1d66a93dc38e87a3d66550 Sep 10 03:48:09.451202 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.451182 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e808c01_d8f7_4a4e_a515_139306ee349a.slice/crio-e9f29be3d80691b3776bd3108dcec7268072b72a1a011316cb9643a94e84f59d WatchSource:0}: Error finding container e9f29be3d80691b3776bd3108dcec7268072b72a1a011316cb9643a94e84f59d: Status 404 returned error can't find the container with id e9f29be3d80691b3776bd3108dcec7268072b72a1a011316cb9643a94e84f59d Sep 10 03:48:09.455213 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.455189 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1462abc_77ef_4c23_a61d_1608ebe5e587.slice/crio-f9362e1abfe680d57d2aa0ef424547ad5dda2b59e4434faac0246807fd4617dd WatchSource:0}: Error finding container f9362e1abfe680d57d2aa0ef424547ad5dda2b59e4434faac0246807fd4617dd: Status 404 returned error can't find the container with id f9362e1abfe680d57d2aa0ef424547ad5dda2b59e4434faac0246807fd4617dd Sep 10 03:48:09.458199 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.458157 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c477870_a33b_4127_ae85_853dd8e11e71.slice/crio-15bcceaba015ce15a8c3008c3ccb55f299f6daab8b52f9230b87b8b9e65b5234 WatchSource:0}: Error finding container 15bcceaba015ce15a8c3008c3ccb55f299f6daab8b52f9230b87b8b9e65b5234: Status 404 returned error can't find the container with id 15bcceaba015ce15a8c3008c3ccb55f299f6daab8b52f9230b87b8b9e65b5234 Sep 10 03:48:09.459063 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.459042 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee209070_209c_4cf0_89dc_c75311b7511c.slice/crio-429c71927f6695649154c3773c0e09d69c67774e21fe70b3503880c2dde29901 WatchSource:0}: Error finding container 429c71927f6695649154c3773c0e09d69c67774e21fe70b3503880c2dde29901: Status 404 returned error can't find the container with id 429c71927f6695649154c3773c0e09d69c67774e21fe70b3503880c2dde29901 Sep 10 03:48:09.460715 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:09.460492 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ba800e_f7f5_4030_970e_5e0a72e3bc3c.slice/crio-7d67146b734a05bf7c464cd8aa4ce8368984c4c2a4387cc6334b24df54eed1d3 WatchSource:0}: Error finding container 7d67146b734a05bf7c464cd8aa4ce8368984c4c2a4387cc6334b24df54eed1d3: Status 404 returned error can't find the container with id 7d67146b734a05bf7c464cd8aa4ce8368984c4c2a4387cc6334b24df54eed1d3 Sep 10 03:48:10.042701 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.041854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:10.042701 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.041912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:10.042701 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.042082 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:10.042701 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.042148 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:12.042128029 +0000 UTC m=+6.128872585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:10.042701 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.042214 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:10.042701 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.042247 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret podName:18f2981a-c311-4911-a567-44284bb8e026 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:12.042236272 +0000 UTC m=+6.128980830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret") pod "global-pull-secret-syncer-jmwqm" (UID: "18f2981a-c311-4911-a567-44284bb8e026") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:10.142991 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.142325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:10.142991 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.142552 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:48:10.142991 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.142570 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:48:10.142991 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.142582 2581 projected.go:196] Error preparing data for projected volume kube-api-access-f5jmf for pod openshift-network-diagnostics/network-check-target-zb7qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:10.142991 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.142641 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf podName:7d13a62c-bdde-4480-a8fc-4847a9167552 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:12.142624209 +0000 UTC m=+6.229368765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5jmf" (UniqueName: "kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf") pod "network-check-target-zb7qm" (UID: "7d13a62c-bdde-4480-a8fc-4847a9167552") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:10.360985 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.360868 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 03:43:08 +0000 UTC" deadline="2028-03-24 19:54:00.163727635 +0000 UTC" Sep 10 03:48:10.360985 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.360933 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13480h5m49.802798499s" Sep 10 03:48:10.413442 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.412747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:10.413442 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.412879 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:10.413442 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.413269 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:10.413442 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:10.413381 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:10.435950 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.435911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" event={"ID":"96ba800e-f7f5-4030-970e-5e0a72e3bc3c","Type":"ContainerStarted","Data":"7d67146b734a05bf7c464cd8aa4ce8368984c4c2a4387cc6334b24df54eed1d3"} Sep 10 03:48:10.451816 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.451736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sswwj" event={"ID":"ee209070-209c-4cf0-89dc-c75311b7511c","Type":"ContainerStarted","Data":"429c71927f6695649154c3773c0e09d69c67774e21fe70b3503880c2dde29901"} Sep 10 03:48:10.455585 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.455509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dkzjx" event={"ID":"c1462abc-77ef-4c23-a61d-1608ebe5e587","Type":"ContainerStarted","Data":"f9362e1abfe680d57d2aa0ef424547ad5dda2b59e4434faac0246807fd4617dd"} Sep 10 03:48:10.458331 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.458250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5j58k" event={"ID":"7904bd49-0bf4-408c-bd29-4122534b2ffe","Type":"ContainerStarted","Data":"b95e6c1594376b71f087ec5918b9f0ee87a4ea06ba1d66a93dc38e87a3d66550"} Sep 10 03:48:10.465338 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.465312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jthcf" event={"ID":"3fef3c33-f7c3-4733-9d77-a4380a911689","Type":"ContainerStarted","Data":"05f48b7852c6ffb70a156436e78d508abe7a0e5a50696ced71422356bccfd2f9"} Sep 10 03:48:10.472735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.472624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" event={"ID":"5f40f003-ea31-4103-bdf0-7ac2de43b91b","Type":"ContainerStarted","Data":"24bff4e37cfe04d0c4e88dbc6358847f8f5bb84613847376a5342ab6545320f0"} Sep 10 03:48:10.482959 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.482930 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"8e8e0e585715354e785fdcced3a9ee5c8b92b553657571dba6f13e276b268958"} Sep 10 03:48:10.494307 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.493997 2581 generic.go:356] "Generic (PLEG): container finished" podID="c9d2cc66555243be47c137309efc2491" containerID="d76cdc17165b41c9629dff340427d580100f95eabe65cce9c9de056f43b1aa05" exitCode=0 Sep 10 03:48:10.494307 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.494087 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" event={"ID":"c9d2cc66555243be47c137309efc2491","Type":"ContainerDied","Data":"d76cdc17165b41c9629dff340427d580100f95eabe65cce9c9de056f43b1aa05"} Sep 10 03:48:10.503321 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.503164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" event={"ID":"9806b07f29bbc4ff6eec20e03f82108e","Type":"ContainerStarted","Data":"66be3f8fe0e8c5575110962ba58a25a0f0c9e8359b4b49edefb7edb3496fce7b"} Sep 10 03:48:10.509611 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.509581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jlhcl" event={"ID":"2c477870-a33b-4127-ae85-853dd8e11e71","Type":"ContainerStarted","Data":"15bcceaba015ce15a8c3008c3ccb55f299f6daab8b52f9230b87b8b9e65b5234"} Sep 10 03:48:10.523498 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:10.523465 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerStarted","Data":"e9f29be3d80691b3776bd3108dcec7268072b72a1a011316cb9643a94e84f59d"} Sep 10 03:48:11.410773 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:11.410737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:11.411578 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:11.410875 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:11.534134 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:11.533923 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" event={"ID":"c9d2cc66555243be47c137309efc2491","Type":"ContainerStarted","Data":"8055c2027d470286260063024f16fae58d7f75275c11e0bef999a2582b86f7f0"} Sep 10 03:48:11.550114 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:11.549079 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-114.ec2.internal" podStartSLOduration=4.549055948 podStartE2EDuration="4.549055948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:10.522703731 +0000 UTC m=+4.609448292" watchObservedRunningTime="2026-09-10 03:48:11.549055948 +0000 UTC m=+5.635800515" Sep 10 03:48:12.061647 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:12.061605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:12.061836 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:12.061661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:12.061836 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.061819 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:12.061948 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.061878 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:16.061861151 +0000 UTC m=+10.148605697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:12.062399 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.062293 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:12.062399 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.062349 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret podName:18f2981a-c311-4911-a567-44284bb8e026 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:16.062333048 +0000 UTC m=+10.149077595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret") pod "global-pull-secret-syncer-jmwqm" (UID: "18f2981a-c311-4911-a567-44284bb8e026") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:12.162913 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:12.162311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:12.162913 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.162477 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:48:12.162913 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.162497 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:48:12.162913 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.162509 2581 projected.go:196] Error preparing data for projected volume kube-api-access-f5jmf for pod openshift-network-diagnostics/network-check-target-zb7qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:12.162913 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.162573 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf podName:7d13a62c-bdde-4480-a8fc-4847a9167552 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:16.162555123 +0000 UTC m=+10.249299678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5jmf" (UniqueName: "kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf") pod "network-check-target-zb7qm" (UID: "7d13a62c-bdde-4480-a8fc-4847a9167552") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:12.411573 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:12.411493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:12.411989 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:12.411502 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:12.411989 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.411620 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:12.411989 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:12.411705 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:13.410795 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:13.410761 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:13.410981 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:13.410894 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:14.412435 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:14.412402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:14.412866 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:14.412547 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:14.412866 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:14.412402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:14.412866 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:14.412755 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:15.410574 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:15.410489 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:15.410734 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:15.410592 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:16.100082 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:16.099374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:16.100082 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:16.099427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:16.100082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.099568 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:16.100082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.099631 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:24.099612531 +0000 UTC m=+18.186357091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:16.100082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.099697 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:16.100082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.099733 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret podName:18f2981a-c311-4911-a567-44284bb8e026 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:24.09972151 +0000 UTC m=+18.186466066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret") pod "global-pull-secret-syncer-jmwqm" (UID: "18f2981a-c311-4911-a567-44284bb8e026") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:16.200162 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:16.200124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:16.200434 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.200301 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:48:16.200434 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.200322 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:48:16.200434 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.200334 2581 projected.go:196] Error preparing data for projected volume kube-api-access-f5jmf for pod openshift-network-diagnostics/network-check-target-zb7qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:16.200434 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.200401 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf podName:7d13a62c-bdde-4480-a8fc-4847a9167552 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:24.200382115 +0000 UTC m=+18.287126658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5jmf" (UniqueName: "kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf") pod "network-check-target-zb7qm" (UID: "7d13a62c-bdde-4480-a8fc-4847a9167552") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:16.411033 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:16.410947 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:16.411197 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.411075 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:16.412554 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:16.412527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:16.412674 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:16.412631 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:17.410519 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:17.410484 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:17.410918 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:17.410623 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:18.410697 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:18.410478 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:18.411153 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:18.410788 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:18.411153 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:18.410478 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:18.411259 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:18.411195 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:19.410180 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:19.410148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:19.410347 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:19.410271 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:20.410403 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:20.410370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:20.410403 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:20.410404 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:20.410922 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:20.410515 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:20.410922 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:20.410649 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:21.410094 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:21.410057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:21.410248 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:21.410169 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:22.410447 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:22.410405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:22.410882 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:22.410405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:22.410882 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:22.410566 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:22.410882 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:22.410592 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:23.410871 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:23.410836 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:23.411301 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:23.410949 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:24.158809 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:24.158764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:24.158987 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:24.158865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:24.158987 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.158924 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:24.158987 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.158957 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:24.159159 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.158999 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:40.158979829 +0000 UTC m=+34.245724388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:24.159159 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.159020 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret podName:18f2981a-c311-4911-a567-44284bb8e026 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:40.159009971 +0000 UTC m=+34.245754518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret") pod "global-pull-secret-syncer-jmwqm" (UID: "18f2981a-c311-4911-a567-44284bb8e026") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:24.259813 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:24.259777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:24.260009 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.259978 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:48:24.260009 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.260008 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:48:24.260202 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.260021 2581 projected.go:196] Error preparing data for projected volume kube-api-access-f5jmf for pod openshift-network-diagnostics/network-check-target-zb7qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:24.260202 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.260075 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf podName:7d13a62c-bdde-4480-a8fc-4847a9167552 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:40.260062135 +0000 UTC m=+34.346806680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5jmf" (UniqueName: "kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf") pod "network-check-target-zb7qm" (UID: "7d13a62c-bdde-4480-a8fc-4847a9167552") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:24.413660 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:24.413591 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:24.413660 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:24.413624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:24.414070 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.413691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:24.414070 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:24.413823 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:25.410587 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:25.410550 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:25.410748 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:25.410690 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:26.411064 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:26.411009 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:26.411562 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:26.411152 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:26.411562 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:26.411494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:26.411666 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:26.411591 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:27.411183 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.410247 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:27.411183 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:27.410465 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:27.569425 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.569256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jlhcl" event={"ID":"2c477870-a33b-4127-ae85-853dd8e11e71","Type":"ContainerStarted","Data":"2f4c14b3d30155c61ec6afea8b96cf23ad59a2bb3c2b86c54f17f4f1d8f033fb"} Sep 10 03:48:27.573436 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.572090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerStarted","Data":"7f92d289ac406ff0079663e32e0e90ce0904e35ed64116203119b7f3f84af2ad"} Sep 10 03:48:27.577706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.577009 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" event={"ID":"96ba800e-f7f5-4030-970e-5e0a72e3bc3c","Type":"ContainerStarted","Data":"a907066d705615ec16cfc4d94a1b454423cb1ce77b63cb9c5e0903d49f171f03"} Sep 10 03:48:27.580303 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.580107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dkzjx" event={"ID":"c1462abc-77ef-4c23-a61d-1608ebe5e587","Type":"ContainerStarted","Data":"4eb01996623dd30e6e0d5636a8025471f9c5ae23f12cb07038ae61378f03ca74"} Sep 10 03:48:27.582361 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.582069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5j58k" event={"ID":"7904bd49-0bf4-408c-bd29-4122534b2ffe","Type":"ContainerStarted","Data":"073b59a0221c271bf722ee053f6dd11a2f0076d45bfd3ba9714627d8ee86af8f"} Sep 10 03:48:27.584730 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.584381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jthcf" event={"ID":"3fef3c33-f7c3-4733-9d77-a4380a911689","Type":"ContainerStarted","Data":"2729ca6e2e43045cd8aa3d95102128025cee3f94e77ef77d45f02077bcf4b678"} Sep 10 03:48:27.586206 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.585324 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-114.ec2.internal" podStartSLOduration=20.585306932 podStartE2EDuration="20.585306932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:11.550002016 +0000 UTC m=+5.636746579" watchObservedRunningTime="2026-09-10 03:48:27.585306932 +0000 UTC m=+21.672051498" Sep 10 03:48:27.587394 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.587367 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" event={"ID":"5f40f003-ea31-4103-bdf0-7ac2de43b91b","Type":"ContainerStarted","Data":"c3f6f6bfeff089ed4dcfd81f3122e22e7c8c86c7ee69d2b55599e531579558ae"} Sep 10 03:48:27.589237 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.589215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"284c9740879a87cfb36574c9c0fe2367905b3d376ff2af42ff00973a08da3c81"} Sep 10 03:48:27.606524 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.606463 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jlhcl" podStartSLOduration=7.364742115 podStartE2EDuration="21.60644399s" totalImagesPullingTime="14.241701875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:27.584855086 +0000 UTC m=+21.671599659" watchObservedRunningTime="2026-09-10 03:48:27.60644399 +0000 UTC m=+21.693188557" Sep 10 03:48:27.620714 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.620670 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g9xpf" podStartSLOduration=3.754455161 podStartE2EDuration="21.620654953s" totalImagesPullingTime="17.866199792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:27.605903769 +0000 UTC m=+21.692648333" watchObservedRunningTime="2026-09-10 03:48:27.620654953 +0000 UTC m=+21.707399498" Sep 10 03:48:27.620855 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.620793 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jthcf" podStartSLOduration=3.738798722 podStartE2EDuration="21.620788327s" totalImagesPullingTime="17.881989605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:27.620769169 +0000 UTC m=+21.707513732" watchObservedRunningTime="2026-09-10 03:48:27.620788327 +0000 UTC m=+21.707532891" Sep 10 03:48:27.633718 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.633674 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5j58k" podStartSLOduration=3.7563728579999998 podStartE2EDuration="21.633656186s" totalImagesPullingTime="17.877283328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:27.633556389 +0000 UTC m=+21.720300951" watchObservedRunningTime="2026-09-10 03:48:27.633656186 +0000 UTC m=+21.720400743" Sep 10 03:48:27.668108 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:27.668064 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dkzjx" podStartSLOduration=3.742585327 podStartE2EDuration="21.668048888s" totalImagesPullingTime="17.925463561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:27.667628224 +0000 UTC m=+21.754372789" watchObservedRunningTime="2026-09-10 03:48:27.668048888 +0000 UTC m=+21.754793451" Sep 10 03:48:28.413333 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.413301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:28.414054 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:28.413406 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:28.414054 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.413460 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:28.414054 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:28.413548 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:28.594324 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.594273 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"dc5627bfde7169fef488c5f93aa6bdabf9e5fa3fa08f4aa365819717dd84fa05"} Sep 10 03:48:28.594492 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.594366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"c48e465fb47c31263ca6e49bb08c2581eaa62945ee77190f70b0329046e35edc"} Sep 10 03:48:28.594492 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.594405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"43bb19b5aae47c00bb3b657e1a4832d9f5902c744161b0f1d331df27cecdd886"} Sep 10 03:48:28.594492 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.594444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"b469e8046df8f24ee225dd687e84b9107e41be17da06b3923bff52d1651f018d"} Sep 10 03:48:28.594492 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.594470 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"f610ec00381cd0b35a0c654ef02a694e996e486709c98071e8d2f1faf22a7135"} Sep 10 03:48:28.595702 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.595644 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e808c01-d8f7-4a4e-a515-139306ee349a" containerID="7f92d289ac406ff0079663e32e0e90ce0904e35ed64116203119b7f3f84af2ad" exitCode=0 Sep 10 03:48:28.595789 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.595737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerDied","Data":"7f92d289ac406ff0079663e32e0e90ce0904e35ed64116203119b7f3f84af2ad"} Sep 10 03:48:28.841193 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:28.841170 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 03:48:29.379522 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.379427 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T03:48:28.841186322Z","UUID":"5a47e8fe-31c2-4bfa-a296-e28056e775e2","Handler":null,"Name":"","Endpoint":""} Sep 10 03:48:29.380926 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.380903 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 03:48:29.381045 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.380936 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 03:48:29.410218 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.410181 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:29.410403 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:29.410321 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:29.599458 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.599422 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sswwj" event={"ID":"ee209070-209c-4cf0-89dc-c75311b7511c","Type":"ContainerStarted","Data":"dfc5f4e0c4d88a7c15121927c2f4cb37141683a770519faf83888bb6868e6629"} Sep 10 03:48:29.601235 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.601211 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" event={"ID":"5f40f003-ea31-4103-bdf0-7ac2de43b91b","Type":"ContainerStarted","Data":"82055acedbb51d6a069e906550a4e2c36af255f698ab4901f7c59ea4b4f7966b"} Sep 10 03:48:29.708676 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.708605 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:29.709351 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.709316 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:29.724194 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:29.724140 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sswwj" podStartSLOduration=5.87137835 podStartE2EDuration="23.724120015s" totalImagesPullingTime="17.852741665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:29.613220984 +0000 UTC m=+23.699965557" watchObservedRunningTime="2026-09-10 03:48:29.724120015 +0000 UTC m=+23.810864581" Sep 10 03:48:30.410204 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:30.410172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:30.410204 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:30.410199 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:30.410470 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:30.410270 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:30.410470 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:30.410414 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:30.606347 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:30.606310 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" event={"ID":"5f40f003-ea31-4103-bdf0-7ac2de43b91b","Type":"ContainerStarted","Data":"3e9eb186fb2c92b1533f2650023ae4b26cfed342845ad57fff8372a357692062"} Sep 10 03:48:30.610573 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:30.610526 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"df17b93f291e6584b840d6439cb47c87e159a686f968116c1ae41e7145f2aa6f"} Sep 10 03:48:30.623944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:30.623906 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-658ls" podStartSLOduration=4.379292279 podStartE2EDuration="24.623892142s" totalImagesPullingTime="20.244599863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:30.62382216 +0000 UTC m=+24.710566723" watchObservedRunningTime="2026-09-10 03:48:30.623892142 +0000 UTC m=+24.710636704" Sep 10 03:48:31.410732 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:31.410700 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:31.410916 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:31.410798 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:32.413637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:32.413567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:32.413637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:32.413584 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:32.414058 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:32.413687 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:32.414058 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:32.413765 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:33.410549 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:33.410509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:33.410816 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:33.410634 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:33.621765 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:33.621521 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" event={"ID":"38386ca5-7c52-40e2-bdc9-7a2f33dcc2c5","Type":"ContainerStarted","Data":"5f7e1f49ed50f4bb20c80e2815176f3fd3cecc26499da7edce34f20d8b09697d"} Sep 10 03:48:33.622165 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:33.621835 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:33.622165 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:33.621885 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:33.622165 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:33.621931 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:33.636592 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:33.636560 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:33.636692 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:33.636685 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:48:33.646468 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:33.646426 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" podStartSLOduration=9.700905802 podStartE2EDuration="27.646412754s" totalImagesPullingTime="17.945506952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:33.644856635 +0000 UTC m=+27.731601197" watchObservedRunningTime="2026-09-10 03:48:33.646412754 +0000 UTC m=+27.733157294" Sep 10 03:48:34.410509 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:34.410475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:34.410509 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:34.410513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:34.410797 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:34.410593 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:34.410797 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:34.410654 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:34.625892 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:34.625864 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e808c01-d8f7-4a4e-a515-139306ee349a" containerID="6d62658ae499941bdb701bfc470a9bca79555b0dc36e2c216df659aa5167fbec" exitCode=0 Sep 10 03:48:34.626526 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:34.625955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerDied","Data":"6d62658ae499941bdb701bfc470a9bca79555b0dc36e2c216df659aa5167fbec"} Sep 10 03:48:34.743331 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:34.743235 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:34.743485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:34.743400 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 03:48:34.743915 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:34.743850 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jlhcl" Sep 10 03:48:35.410139 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:35.410082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:35.410371 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:35.410235 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:35.441449 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:35.441208 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb7qm"] Sep 10 03:48:35.444291 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:35.444155 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qbqrq"] Sep 10 03:48:35.444416 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:35.444334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:35.444488 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:35.444461 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:35.452421 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:35.452383 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jmwqm"] Sep 10 03:48:35.452566 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:35.452512 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:35.452629 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:35.452613 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:35.628728 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:35.628677 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:35.629381 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:35.628864 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:36.633202 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:36.633173 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e808c01-d8f7-4a4e-a515-139306ee349a" containerID="2c3e1660be0bcbe593f3eaca9189d3a9a95040ad779140aeaa229b7550be9f16" exitCode=0 Sep 10 03:48:36.633577 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:36.633209 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerDied","Data":"2c3e1660be0bcbe593f3eaca9189d3a9a95040ad779140aeaa229b7550be9f16"} Sep 10 03:48:37.410038 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:37.409997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:37.410038 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:37.410032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:37.410303 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:37.410008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:37.410303 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:37.410123 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:37.410303 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:37.410184 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:37.410423 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:37.410302 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:38.640378 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:38.640346 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e808c01-d8f7-4a4e-a515-139306ee349a" containerID="0b32da8d9f6ad78db85fae43962f2956d7c658d03d5749d10478af124e92cf3d" exitCode=0 Sep 10 03:48:38.640704 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:38.640385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerDied","Data":"0b32da8d9f6ad78db85fae43962f2956d7c658d03d5749d10478af124e92cf3d"} Sep 10 03:48:39.410621 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:39.410584 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:39.410621 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:39.410624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:39.410872 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:39.410704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:39.410872 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:39.410722 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmwqm" podUID="18f2981a-c311-4911-a567-44284bb8e026" Sep 10 03:48:39.410872 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:39.410800 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:48:39.411009 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:39.410886 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb7qm" podUID="7d13a62c-bdde-4480-a8fc-4847a9167552" Sep 10 03:48:40.171047 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.171009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:40.171047 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.171056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:40.171632 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.171159 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:40.171632 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.171185 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:40.171632 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.171234 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret podName:18f2981a-c311-4911-a567-44284bb8e026 nodeName:}" failed. No retries permitted until 2026-09-10 03:49:12.171218061 +0000 UTC m=+66.257962620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret") pod "global-pull-secret-syncer-jmwqm" (UID: "18f2981a-c311-4911-a567-44284bb8e026") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:48:40.171632 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.171250 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:49:12.171243608 +0000 UTC m=+66.257988148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:48:40.253380 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.253351 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-114.ec2.internal" event="NodeReady" Sep 10 03:48:40.253541 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.253527 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 03:48:40.272332 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.272302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:40.272506 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.272457 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:48:40.272506 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.272480 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:48:40.272506 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.272494 2581 projected.go:196] Error preparing data for projected volume kube-api-access-f5jmf for pod openshift-network-diagnostics/network-check-target-zb7qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:40.272658 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.272554 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf podName:7d13a62c-bdde-4480-a8fc-4847a9167552 nodeName:}" failed. No retries permitted until 2026-09-10 03:49:12.272536745 +0000 UTC m=+66.359281300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5jmf" (UniqueName: "kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf") pod "network-check-target-zb7qm" (UID: "7d13a62c-bdde-4480-a8fc-4847a9167552") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:48:40.289729 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.289697 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58dd5c9f4b-dd77z"] Sep 10 03:48:40.294861 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.294826 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.297892 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.297867 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 03:48:40.297892 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.297888 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 03:48:40.298092 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.298053 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 03:48:40.298145 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.298111 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lfmcw\"" Sep 10 03:48:40.304631 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.304594 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hlft4"] Sep 10 03:48:40.307437 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.307413 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 03:48:40.309162 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.308457 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cwnls"] Sep 10 03:48:40.309162 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.309149 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.311470 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.311447 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bt2fn\"" Sep 10 03:48:40.311583 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.311567 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 03:48:40.311944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.311925 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 03:48:40.312908 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.312850 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58dd5c9f4b-dd77z"] Sep 10 03:48:40.313016 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.312950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cwnls" Sep 10 03:48:40.315407 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.315388 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 03:48:40.315599 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.315393 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 03:48:40.315657 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.315614 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 03:48:40.315880 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.315862 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cprh9\"" Sep 10 03:48:40.319848 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.319829 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cwnls"] Sep 10 03:48:40.325134 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.325111 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hlft4"] Sep 10 03:48:40.373394 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-image-registry-private-configuration\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373401 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb89-3716-41e8-b269-d7d2b64e1b13-ca-trust-extracted\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a930973d-eaaf-4e09-910f-6692ba283bd1-cert\") pod \"ingress-canary-cwnls\" (UID: \"a930973d-eaaf-4e09-910f-6692ba283bd1\") " pod="openshift-ingress-canary/ingress-canary-cwnls" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-tmp-dir\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373459 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdh4w\" (UniqueName: \"kubernetes.io/projected/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-kube-api-access-pdh4w\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-certificates\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r66w\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-kube-api-access-8r66w\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz2ws\" (UniqueName: \"kubernetes.io/projected/a930973d-eaaf-4e09-910f-6692ba283bd1-kube-api-access-hz2ws\") pod \"ingress-canary-cwnls\" (UID: \"a930973d-eaaf-4e09-910f-6692ba283bd1\") " pod="openshift-ingress-canary/ingress-canary-cwnls" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-config-volume\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.373575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-bound-sa-token\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.374074 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-installation-pull-secrets\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.374074 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.374074 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.373641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-trusted-ca\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.474765 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb89-3716-41e8-b269-d7d2b64e1b13-ca-trust-extracted\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.474765 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a930973d-eaaf-4e09-910f-6692ba283bd1-cert\") pod \"ingress-canary-cwnls\" (UID: \"a930973d-eaaf-4e09-910f-6692ba283bd1\") " pod="openshift-ingress-canary/ingress-canary-cwnls" Sep 10 03:48:40.474765 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-tmp-dir\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdh4w\" (UniqueName: \"kubernetes.io/projected/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-kube-api-access-pdh4w\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-certificates\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r66w\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-kube-api-access-8r66w\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz2ws\" (UniqueName: \"kubernetes.io/projected/a930973d-eaaf-4e09-910f-6692ba283bd1-kube-api-access-hz2ws\") pod \"ingress-canary-cwnls\" (UID: \"a930973d-eaaf-4e09-910f-6692ba283bd1\") " pod="openshift-ingress-canary/ingress-canary-cwnls" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-config-volume\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-bound-sa-token\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.474919 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.474940 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.474973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-installation-pull-secrets\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.475023 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.475013 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:40.974991824 +0000 UTC m=+35.061736388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:48:40.475567 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.475049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.475567 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.475079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-trusted-ca\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.475567 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.475156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-image-registry-private-configuration\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.475703 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.475407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-tmp-dir\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.475703 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.475420 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb89-3716-41e8-b269-d7d2b64e1b13-ca-trust-extracted\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.475703 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.475486 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:48:40.475703 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.475679 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:48:40.975660719 +0000 UTC m=+35.062405273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:48:40.476461 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.476294 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-certificates\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.476461 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.476420 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-config-volume\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.477053 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.477030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-trusted-ca\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.479357 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.479337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-installation-pull-secrets\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.479443 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.479380 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-image-registry-private-configuration\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.479443 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.479415 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a930973d-eaaf-4e09-910f-6692ba283bd1-cert\") pod \"ingress-canary-cwnls\" (UID: \"a930973d-eaaf-4e09-910f-6692ba283bd1\") " pod="openshift-ingress-canary/ingress-canary-cwnls" Sep 10 03:48:40.484747 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.484724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz2ws\" (UniqueName: \"kubernetes.io/projected/a930973d-eaaf-4e09-910f-6692ba283bd1-kube-api-access-hz2ws\") pod \"ingress-canary-cwnls\" (UID: \"a930973d-eaaf-4e09-910f-6692ba283bd1\") " pod="openshift-ingress-canary/ingress-canary-cwnls" Sep 10 03:48:40.484852 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.484750 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdh4w\" (UniqueName: \"kubernetes.io/projected/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-kube-api-access-pdh4w\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.484961 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.484921 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r66w\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-kube-api-access-8r66w\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.486244 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.486220 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-bound-sa-token\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.628413 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.628376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cwnls" Sep 10 03:48:40.916258 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.916227 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cwnls"] Sep 10 03:48:40.920143 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:48:40.920117 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda930973d_eaaf_4e09_910f_6692ba283bd1.slice/crio-17de02bb8afd017f57736fe7264e843acb9538718eec9a6807da42dded6b0e94 WatchSource:0}: Error finding container 17de02bb8afd017f57736fe7264e843acb9538718eec9a6807da42dded6b0e94: Status 404 returned error can't find the container with id 17de02bb8afd017f57736fe7264e843acb9538718eec9a6807da42dded6b0e94 Sep 10 03:48:40.980084 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.980050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:40.980253 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:40.980114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:40.980253 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.980221 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:48:40.980253 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.980237 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:48:40.980253 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.980248 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:48:40.980541 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.980323 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:48:41.980299778 +0000 UTC m=+36.067044373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:48:40.980541 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:40.980340 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:41.980334043 +0000 UTC m=+36.067078583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:48:41.410695 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.410661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:48:41.411473 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.410703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:48:41.411473 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.410756 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:48:41.413715 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.413692 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 03:48:41.418047 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.414985 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7r79s\"" Sep 10 03:48:41.418047 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.415033 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 03:48:41.418047 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.415066 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2jbt8\"" Sep 10 03:48:41.418047 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.415270 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 03:48:41.418047 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.415555 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 03:48:41.650579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.650542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cwnls" event={"ID":"a930973d-eaaf-4e09-910f-6692ba283bd1","Type":"ContainerStarted","Data":"17de02bb8afd017f57736fe7264e843acb9538718eec9a6807da42dded6b0e94"} Sep 10 03:48:41.989331 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.989276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:41.989512 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:41.989387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:41.989512 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:41.989454 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:48:41.989512 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:41.989494 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:48:41.989644 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:41.989514 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:48:41.989644 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:41.989544 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:48:43.989526013 +0000 UTC m=+38.076270558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:48:41.989644 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:41.989563 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:43.989554223 +0000 UTC m=+38.076298763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:48:42.657046 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:42.657003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerStarted","Data":"de37f2eff0377eeeb60f2ad887219cfeed75abbf4eb3791fe6cf6c8e8a613d29"} Sep 10 03:48:43.662323 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:43.662268 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e808c01-d8f7-4a4e-a515-139306ee349a" containerID="de37f2eff0377eeeb60f2ad887219cfeed75abbf4eb3791fe6cf6c8e8a613d29" exitCode=0 Sep 10 03:48:43.662714 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:43.662358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerDied","Data":"de37f2eff0377eeeb60f2ad887219cfeed75abbf4eb3791fe6cf6c8e8a613d29"} Sep 10 03:48:44.006665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:44.006575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:44.006665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:44.006661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:44.006887 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:44.006749 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:48:44.006887 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:44.006767 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:48:44.006887 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:44.006777 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:48:44.006887 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:44.006832 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:48:48.00681519 +0000 UTC m=+42.093559746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:48:44.006887 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:44.006848 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:48.006840206 +0000 UTC m=+42.093584747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:48:44.671795 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:44.671551 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e808c01-d8f7-4a4e-a515-139306ee349a" containerID="455d1ab37f5306dfe31c6b8f5270395cb4f96633f0dcfbfa5c4f04f63d4eb7aa" exitCode=0 Sep 10 03:48:44.672241 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:44.671621 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerDied","Data":"455d1ab37f5306dfe31c6b8f5270395cb4f96633f0dcfbfa5c4f04f63d4eb7aa"} Sep 10 03:48:44.673561 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:44.673534 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cwnls" event={"ID":"a930973d-eaaf-4e09-910f-6692ba283bd1","Type":"ContainerStarted","Data":"3311fa5190c26c064b198b0cc66134e977aaca1eb6dd9267cbdc03e91bf35347"} Sep 10 03:48:44.705909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:44.705850 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cwnls" podStartSLOduration=1.0949465840000001 podStartE2EDuration="4.705829138s" totalImagesPullingTime="3.610882554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:44.705307527 +0000 UTC m=+38.792052090" watchObservedRunningTime="2026-09-10 03:48:44.705829138 +0000 UTC m=+38.792573702" Sep 10 03:48:45.678969 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:45.678935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cl45v" event={"ID":"9e808c01-d8f7-4a4e-a515-139306ee349a","Type":"ContainerStarted","Data":"6d5d3b1bacbc36713f9ab9cb9788bb7b6d268164631185f8a1829abca89ce425"} Sep 10 03:48:45.698793 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:45.698751 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cl45v" podStartSLOduration=10.383404841 podStartE2EDuration="39.698735734s" totalImagesPullingTime="29.315330893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:45.697554078 +0000 UTC m=+39.784298641" watchObservedRunningTime="2026-09-10 03:48:45.698735734 +0000 UTC m=+39.785480291" Sep 10 03:48:48.033971 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:48.033927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:48.034428 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:48.033998 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:48.034428 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:48.034098 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:48:48.034428 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:48.034111 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:48:48.034428 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:48.034124 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:48:48.034428 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:48.034179 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:48:56.034157598 +0000 UTC m=+50.120902155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:48:48.034428 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:48.034201 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:56.034191108 +0000 UTC m=+50.120935680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:48:56.089277 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:56.089226 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:48:56.089715 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:48:56.089340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:48:56.089715 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:56.089394 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:48:56.089715 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:56.089441 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:48:56.089715 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:56.089453 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:48:56.089715 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:56.089468 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:49:12.08944768 +0000 UTC m=+66.176192237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:48:56.089715 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:48:56.089495 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:49:12.089484884 +0000 UTC m=+66.176229442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:49:05.641993 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:05.641963 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcv2r" Sep 10 03:49:12.105649 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.105613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:49:12.106063 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.105692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:49:12.106063 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:12.105765 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:49:12.106063 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:12.105830 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:49:44.105814406 +0000 UTC m=+98.192558966 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:49:12.106063 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:12.105778 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:49:12.106063 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:12.105862 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:49:12.106063 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:12.105906 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:49:44.105891595 +0000 UTC m=+98.192636158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:49:12.206758 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.206724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:49:12.206758 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.206762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:49:12.209034 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.209013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 03:49:12.209149 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.209084 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 03:49:12.217802 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:12.217782 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 03:49:12.217908 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:12.217842 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:50:16.217825715 +0000 UTC m=+130.304570257 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : secret "metrics-daemon-secret" not found Sep 10 03:49:12.220577 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.220553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f2981a-c311-4911-a567-44284bb8e026-original-pull-secret\") pod \"global-pull-secret-syncer-jmwqm\" (UID: \"18f2981a-c311-4911-a567-44284bb8e026\") " pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:49:12.307673 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.307633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:49:12.310945 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.310921 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 03:49:12.321091 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.321065 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 03:49:12.324931 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.324917 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmwqm" Sep 10 03:49:12.331363 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.331347 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5jmf\" (UniqueName: \"kubernetes.io/projected/7d13a62c-bdde-4480-a8fc-4847a9167552-kube-api-access-f5jmf\") pod \"network-check-target-zb7qm\" (UID: \"7d13a62c-bdde-4480-a8fc-4847a9167552\") " pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:49:12.339085 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.339070 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2jbt8\"" Sep 10 03:49:12.347883 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.347868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:49:12.625304 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.625191 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jmwqm"] Sep 10 03:49:12.628818 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:49:12.628792 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f2981a_c311_4911_a567_44284bb8e026.slice/crio-774358a7b90acf22e91fa75aede25d533b957572d6386b8e0d8cb369cd95326f WatchSource:0}: Error finding container 774358a7b90acf22e91fa75aede25d533b957572d6386b8e0d8cb369cd95326f: Status 404 returned error can't find the container with id 774358a7b90acf22e91fa75aede25d533b957572d6386b8e0d8cb369cd95326f Sep 10 03:49:12.645708 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.645681 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb7qm"] Sep 10 03:49:12.649594 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:49:12.649571 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d13a62c_bdde_4480_a8fc_4847a9167552.slice/crio-69435ad41f980ec7bf7bcfdf3c40eb6c005c9700db2992f1e9a847e0dcf8bac3 WatchSource:0}: Error finding container 69435ad41f980ec7bf7bcfdf3c40eb6c005c9700db2992f1e9a847e0dcf8bac3: Status 404 returned error can't find the container with id 69435ad41f980ec7bf7bcfdf3c40eb6c005c9700db2992f1e9a847e0dcf8bac3 Sep 10 03:49:12.747811 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.747766 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jmwqm" event={"ID":"18f2981a-c311-4911-a567-44284bb8e026","Type":"ContainerStarted","Data":"774358a7b90acf22e91fa75aede25d533b957572d6386b8e0d8cb369cd95326f"} Sep 10 03:49:12.748868 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:12.748844 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb7qm" event={"ID":"7d13a62c-bdde-4480-a8fc-4847a9167552","Type":"ContainerStarted","Data":"69435ad41f980ec7bf7bcfdf3c40eb6c005c9700db2992f1e9a847e0dcf8bac3"} Sep 10 03:49:17.764974 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:17.764933 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jmwqm" event={"ID":"18f2981a-c311-4911-a567-44284bb8e026","Type":"ContainerStarted","Data":"0bda6032ef569f54330262ff6ac688e17db059037ffbe40bbe03158a4a818f4f"} Sep 10 03:49:17.766452 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:17.766427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb7qm" event={"ID":"7d13a62c-bdde-4480-a8fc-4847a9167552","Type":"ContainerStarted","Data":"8cdee8b9c0cdbb158df26230a0d0674cbf31be5fabc4099b40fe95e39e604d9a"} Sep 10 03:49:17.766587 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:17.766568 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:49:17.779439 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:17.779396 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jmwqm" podStartSLOduration=67.223958322 podStartE2EDuration="1m11.779379078s" totalImagesPullingTime="4.555420756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:49:17.778804823 +0000 UTC m=+71.865549404" watchObservedRunningTime="2026-09-10 03:49:17.779379078 +0000 UTC m=+71.866123642" Sep 10 03:49:17.791973 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:17.791923 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zb7qm" podStartSLOduration=67.260198756 podStartE2EDuration="1m11.791911448s" totalImagesPullingTime="4.531712692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:49:17.791737129 +0000 UTC m=+71.878481695" watchObservedRunningTime="2026-09-10 03:49:17.791911448 +0000 UTC m=+71.878656013" Sep 10 03:49:40.876626 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.876500 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988"] Sep 10 03:49:40.878740 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.878702 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" Sep 10 03:49:40.882009 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.881992 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 03:49:40.882113 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.882016 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 03:49:40.882113 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.882003 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-d6mqk\"" Sep 10 03:49:40.882113 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.882035 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 03:49:40.882113 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.882043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 03:49:40.889341 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.889322 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988"] Sep 10 03:49:40.903110 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.903090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v927q\" (UniqueName: \"kubernetes.io/projected/70d44fe6-c492-4f36-9da2-e226cfb78a4e-kube-api-access-v927q\") pod \"managed-serviceaccount-addon-agent-6f59cc8c48-kh988\" (UID: \"70d44fe6-c492-4f36-9da2-e226cfb78a4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" Sep 10 03:49:40.903227 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:40.903155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d44fe6-c492-4f36-9da2-e226cfb78a4e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f59cc8c48-kh988\" (UID: \"70d44fe6-c492-4f36-9da2-e226cfb78a4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" Sep 10 03:49:41.003908 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:41.003866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d44fe6-c492-4f36-9da2-e226cfb78a4e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f59cc8c48-kh988\" (UID: \"70d44fe6-c492-4f36-9da2-e226cfb78a4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" Sep 10 03:49:41.004084 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:41.003918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v927q\" (UniqueName: \"kubernetes.io/projected/70d44fe6-c492-4f36-9da2-e226cfb78a4e-kube-api-access-v927q\") pod \"managed-serviceaccount-addon-agent-6f59cc8c48-kh988\" (UID: \"70d44fe6-c492-4f36-9da2-e226cfb78a4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" Sep 10 03:49:41.006496 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:41.006468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d44fe6-c492-4f36-9da2-e226cfb78a4e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f59cc8c48-kh988\" (UID: \"70d44fe6-c492-4f36-9da2-e226cfb78a4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" Sep 10 03:49:41.011046 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:41.011021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v927q\" (UniqueName: \"kubernetes.io/projected/70d44fe6-c492-4f36-9da2-e226cfb78a4e-kube-api-access-v927q\") pod \"managed-serviceaccount-addon-agent-6f59cc8c48-kh988\" (UID: \"70d44fe6-c492-4f36-9da2-e226cfb78a4e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" Sep 10 03:49:41.199460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:41.199424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" Sep 10 03:49:41.463267 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:41.463179 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988"] Sep 10 03:49:41.468346 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:49:41.468315 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70d44fe6_c492_4f36_9da2_e226cfb78a4e.slice/crio-5ddd1bcc0579de988578b42e4af928bd293189268dc4788669601f1ab5899be0 WatchSource:0}: Error finding container 5ddd1bcc0579de988578b42e4af928bd293189268dc4788669601f1ab5899be0: Status 404 returned error can't find the container with id 5ddd1bcc0579de988578b42e4af928bd293189268dc4788669601f1ab5899be0 Sep 10 03:49:41.824987 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:41.824894 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" event={"ID":"70d44fe6-c492-4f36-9da2-e226cfb78a4e","Type":"ContainerStarted","Data":"5ddd1bcc0579de988578b42e4af928bd293189268dc4788669601f1ab5899be0"} Sep 10 03:49:44.125758 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:44.125651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:49:44.125758 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:44.125729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:49:44.126157 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:44.125809 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:49:44.126157 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:44.125836 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:49:44.126157 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:44.125846 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:49:44.126157 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:44.125877 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:50:48.12586092 +0000 UTC m=+162.212605474 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:49:44.126157 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:49:44.125892 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:50:48.125885847 +0000 UTC m=+162.212630388 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:49:44.835031 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:44.834994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" event={"ID":"70d44fe6-c492-4f36-9da2-e226cfb78a4e","Type":"ContainerStarted","Data":"fb010e9c5dca285dde645683ea49a49a7ffda69096bffa45c1b724ac4c5dfa0a"} Sep 10 03:49:44.849721 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:44.849673 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" podStartSLOduration=2.4711206 podStartE2EDuration="4.849659736s" totalImagesPullingTime="2.378539136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:49:44.848617179 +0000 UTC m=+98.935361743" watchObservedRunningTime="2026-09-10 03:49:44.849659736 +0000 UTC m=+98.936404299" Sep 10 03:49:48.771224 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:49:48.771193 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zb7qm" Sep 10 03:50:16.248019 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:50:16.247976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:50:16.248455 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:16.248095 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 03:50:16.248455 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:16.248161 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:18.248146331 +0000 UTC m=+252.334890872 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : secret "metrics-daemon-secret" not found Sep 10 03:50:43.307878 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:43.307832 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" podUID="bafdcb89-3716-41e8-b269-d7d2b64e1b13" Sep 10 03:50:43.320983 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:43.320951 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hlft4" podUID="cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b" Sep 10 03:50:43.979820 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:50:43.979788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:50:43.979983 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:50:43.979793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlft4" Sep 10 03:50:44.432117 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:44.432074 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:50:48.174625 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:50:48.174577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:50:48.175082 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:50:48.174646 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:50:48.175082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:48.174748 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 03:50:48.175082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:48.174767 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 03:50:48.175082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:48.174783 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58dd5c9f4b-dd77z: secret "image-registry-tls" not found Sep 10 03:50:48.175082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:48.174840 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls podName:cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b nodeName:}" failed. No retries permitted until 2026-09-10 03:52:50.174823168 +0000 UTC m=+284.261567713 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls") pod "dns-default-hlft4" (UID: "cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b") : secret "dns-default-metrics-tls" not found Sep 10 03:50:48.175082 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:50:48.174855 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls podName:bafdcb89-3716-41e8-b269-d7d2b64e1b13 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:50.174848917 +0000 UTC m=+284.261593458 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls") pod "image-registry-58dd5c9f4b-dd77z" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13") : secret "image-registry-tls" not found Sep 10 03:50:58.410116 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:50:58.410077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:51:44.123923 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:51:44.123886 2581 generic.go:356] "Generic (PLEG): container finished" podID="70d44fe6-c492-4f36-9da2-e226cfb78a4e" containerID="fb010e9c5dca285dde645683ea49a49a7ffda69096bffa45c1b724ac4c5dfa0a" exitCode=255 Sep 10 03:51:44.123923 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:51:44.123927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" event={"ID":"70d44fe6-c492-4f36-9da2-e226cfb78a4e","Type":"ContainerDied","Data":"fb010e9c5dca285dde645683ea49a49a7ffda69096bffa45c1b724ac4c5dfa0a"} Sep 10 03:51:44.129225 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:51:44.129204 2581 scope.go:117] "RemoveContainer" containerID="fb010e9c5dca285dde645683ea49a49a7ffda69096bffa45c1b724ac4c5dfa0a" Sep 10 03:51:45.128118 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:51:45.128086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f59cc8c48-kh988" event={"ID":"70d44fe6-c492-4f36-9da2-e226cfb78a4e","Type":"ContainerStarted","Data":"53b60fb2905ddc18eaf7d4dab39a9cce4c686e6bdaa8ea47c8e062833a2e9bba"} Sep 10 03:52:15.197526 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.197489 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-qdc2w"] Sep 10 03:52:15.200474 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.200451 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6784b6bdfb-p2vsx"] Sep 10 03:52:15.200611 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.200565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.203093 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.203060 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 03:52:15.203093 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.203085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.203293 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.203197 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 03:52:15.203594 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.203580 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 03:52:15.203691 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.203672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 03:52:15.204235 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.204220 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p25g5\"" Sep 10 03:52:15.206194 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.206165 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 03:52:15.206568 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.206550 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 03:52:15.206656 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.206608 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 03:52:15.206719 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.206652 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 03:52:15.206719 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.206653 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gbd59\"" Sep 10 03:52:15.206719 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.206686 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 03:52:15.206870 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.206769 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 03:52:15.210644 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.210624 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 03:52:15.219760 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.219738 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-qdc2w"] Sep 10 03:52:15.221878 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.221856 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6784b6bdfb-p2vsx"] Sep 10 03:52:15.256596 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzqb8\" (UniqueName: \"kubernetes.io/projected/fc13a35e-4c61-402a-a875-ec9e25d0b975-kube-api-access-qzqb8\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.256596 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc13a35e-4c61-402a-a875-ec9e25d0b975-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.256863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc13a35e-4c61-402a-a875-ec9e25d0b975-tmp\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.256863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc13a35e-4c61-402a-a875-ec9e25d0b975-snapshots\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.256863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc13a35e-4c61-402a-a875-ec9e25d0b975-serving-cert\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.256863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.256863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flkrb\" (UniqueName: \"kubernetes.io/projected/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-kube-api-access-flkrb\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.256863 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.257053 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc13a35e-4c61-402a-a875-ec9e25d0b975-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.257053 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-default-certificate\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.257053 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.256931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-stats-auth\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.288929 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.288891 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz"] Sep 10 03:52:15.295424 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.295380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.296575 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.296549 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf"] Sep 10 03:52:15.297829 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.297805 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 10 03:52:15.298077 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.298064 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 10 03:52:15.298168 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.298149 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fhlgj\"" Sep 10 03:52:15.298213 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.298150 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 10 03:52:15.298268 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.298150 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:52:15.299217 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.299199 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.301624 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.301602 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 03:52:15.301624 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.301623 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:52:15.301816 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.301649 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vmpqn\"" Sep 10 03:52:15.301816 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.301653 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 03:52:15.301946 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.301932 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 03:52:15.302343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.302325 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz"] Sep 10 03:52:15.305442 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.305403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf"] Sep 10 03:52:15.357779 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.357749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-default-certificate\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.357951 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.357786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc13a35e-4c61-402a-a875-ec9e25d0b975-snapshots\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.357951 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.357806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flkrb\" (UniqueName: \"kubernetes.io/projected/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-kube-api-access-flkrb\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.358169 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358142 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6xjj\" (UniqueName: \"kubernetes.io/projected/21d44376-0129-4670-a02f-069e1c10446e-kube-api-access-n6xjj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.358219 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-stats-auth\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.358257 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzqb8\" (UniqueName: \"kubernetes.io/projected/fc13a35e-4c61-402a-a875-ec9e25d0b975-kube-api-access-qzqb8\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.358353 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn772\" (UniqueName: \"kubernetes.io/projected/c126bdb5-4908-481b-9568-0b75eec62b9d-kube-api-access-hn772\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.358411 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc13a35e-4c61-402a-a875-ec9e25d0b975-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.358411 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21d44376-0129-4670-a02f-069e1c10446e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.358517 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc13a35e-4c61-402a-a875-ec9e25d0b975-snapshots\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.358517 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358449 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc13a35e-4c61-402a-a875-ec9e25d0b975-tmp\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.358517 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc13a35e-4c61-402a-a875-ec9e25d0b975-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.358653 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c126bdb5-4908-481b-9568-0b75eec62b9d-config\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.358653 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c126bdb5-4908-481b-9568-0b75eec62b9d-serving-cert\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.358653 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.358653 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.358840 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc13a35e-4c61-402a-a875-ec9e25d0b975-serving-cert\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.358840 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d44376-0129-4670-a02f-069e1c10446e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.358840 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.358727 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc13a35e-4c61-402a-a875-ec9e25d0b975-tmp\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.358840 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:15.358771 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:15.858747757 +0000 UTC m=+249.945492312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : configmap references non-existent config key: service-ca.crt Sep 10 03:52:15.358840 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:15.358816 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 03:52:15.359105 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:15.358870 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:15.858855013 +0000 UTC m=+249.945599568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : secret "router-metrics-certs-default" not found Sep 10 03:52:15.359105 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.359018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc13a35e-4c61-402a-a875-ec9e25d0b975-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.359321 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.359302 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc13a35e-4c61-402a-a875-ec9e25d0b975-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.360641 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.360612 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-default-certificate\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.360641 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.360638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-stats-auth\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.360776 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.360755 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc13a35e-4c61-402a-a875-ec9e25d0b975-serving-cert\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.365148 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.365122 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzqb8\" (UniqueName: \"kubernetes.io/projected/fc13a35e-4c61-402a-a875-ec9e25d0b975-kube-api-access-qzqb8\") pod \"insights-operator-76bcd6ccf5-qdc2w\" (UID: \"fc13a35e-4c61-402a-a875-ec9e25d0b975\") " pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.365263 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.365227 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flkrb\" (UniqueName: \"kubernetes.io/projected/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-kube-api-access-flkrb\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.459779 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.459687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn772\" (UniqueName: \"kubernetes.io/projected/c126bdb5-4908-481b-9568-0b75eec62b9d-kube-api-access-hn772\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.459779 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.459730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21d44376-0129-4670-a02f-069e1c10446e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.459779 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.459764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c126bdb5-4908-481b-9568-0b75eec62b9d-config\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.459779 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.459779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c126bdb5-4908-481b-9568-0b75eec62b9d-serving-cert\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.460094 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.459821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d44376-0129-4670-a02f-069e1c10446e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.460094 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.459882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6xjj\" (UniqueName: \"kubernetes.io/projected/21d44376-0129-4670-a02f-069e1c10446e-kube-api-access-n6xjj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.460472 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.460448 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c126bdb5-4908-481b-9568-0b75eec62b9d-config\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.460472 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.460463 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21d44376-0129-4670-a02f-069e1c10446e-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.462161 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.462140 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c126bdb5-4908-481b-9568-0b75eec62b9d-serving-cert\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.462229 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.462169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d44376-0129-4670-a02f-069e1c10446e-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.467544 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.467521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6xjj\" (UniqueName: \"kubernetes.io/projected/21d44376-0129-4670-a02f-069e1c10446e-kube-api-access-n6xjj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-92ltf\" (UID: \"21d44376-0129-4670-a02f-069e1c10446e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.467659 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.467635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn772\" (UniqueName: \"kubernetes.io/projected/c126bdb5-4908-481b-9568-0b75eec62b9d-kube-api-access-hn772\") pod \"service-ca-operator-859f94c4b-rdhqz\" (UID: \"c126bdb5-4908-481b-9568-0b75eec62b9d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.511927 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.511888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" Sep 10 03:52:15.607618 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.607586 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" Sep 10 03:52:15.612580 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.612560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" Sep 10 03:52:15.779166 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.779082 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-qdc2w"] Sep 10 03:52:15.781798 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:15.781774 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc13a35e_4c61_402a_a875_ec9e25d0b975.slice/crio-0c0495c63e585f8839f29a785c5bed3be361c216f6514bffe42e4054796fe746 WatchSource:0}: Error finding container 0c0495c63e585f8839f29a785c5bed3be361c216f6514bffe42e4054796fe746: Status 404 returned error can't find the container with id 0c0495c63e585f8839f29a785c5bed3be361c216f6514bffe42e4054796fe746 Sep 10 03:52:15.864107 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.864075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.864339 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.864125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:15.864339 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:15.864262 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:16.864243593 +0000 UTC m=+250.950988155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : configmap references non-existent config key: service-ca.crt Sep 10 03:52:15.864339 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:15.864309 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 03:52:15.864524 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:15.864367 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:16.864351515 +0000 UTC m=+250.951096077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : secret "router-metrics-certs-default" not found Sep 10 03:52:15.872188 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.872160 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz"] Sep 10 03:52:15.875088 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:15.875060 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc126bdb5_4908_481b_9568_0b75eec62b9d.slice/crio-152521124be1499fab1e3f89d6aae47ca73ffea0d0d77763b4b3e04d30e0eee1 WatchSource:0}: Error finding container 152521124be1499fab1e3f89d6aae47ca73ffea0d0d77763b4b3e04d30e0eee1: Status 404 returned error can't find the container with id 152521124be1499fab1e3f89d6aae47ca73ffea0d0d77763b4b3e04d30e0eee1 Sep 10 03:52:15.882250 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:15.882224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf"] Sep 10 03:52:15.886187 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:15.886165 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d44376_0129_4670_a02f_069e1c10446e.slice/crio-25e78aa2f8ba0fc1dd7ff5991344054c3e45887a98ec750fa2ac1c9d43627a7a WatchSource:0}: Error finding container 25e78aa2f8ba0fc1dd7ff5991344054c3e45887a98ec750fa2ac1c9d43627a7a: Status 404 returned error can't find the container with id 25e78aa2f8ba0fc1dd7ff5991344054c3e45887a98ec750fa2ac1c9d43627a7a Sep 10 03:52:16.208999 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:16.208959 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" event={"ID":"21d44376-0129-4670-a02f-069e1c10446e","Type":"ContainerStarted","Data":"25e78aa2f8ba0fc1dd7ff5991344054c3e45887a98ec750fa2ac1c9d43627a7a"} Sep 10 03:52:16.210028 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:16.210003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" event={"ID":"fc13a35e-4c61-402a-a875-ec9e25d0b975","Type":"ContainerStarted","Data":"0c0495c63e585f8839f29a785c5bed3be361c216f6514bffe42e4054796fe746"} Sep 10 03:52:16.210999 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:16.210978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" event={"ID":"c126bdb5-4908-481b-9568-0b75eec62b9d","Type":"ContainerStarted","Data":"152521124be1499fab1e3f89d6aae47ca73ffea0d0d77763b4b3e04d30e0eee1"} Sep 10 03:52:16.873196 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:16.873161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:16.873401 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:16.873223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:16.873401 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:16.873384 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 03:52:16.873518 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:16.873460 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:18.873437856 +0000 UTC m=+252.960182405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : secret "router-metrics-certs-default" not found Sep 10 03:52:16.873518 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:16.873480 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:18.873469538 +0000 UTC m=+252.960214081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : configmap references non-existent config key: service-ca.crt Sep 10 03:52:18.286124 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:18.286074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:52:18.286572 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:18.286225 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 03:52:18.286572 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:18.286318 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs podName:c4de56fa-4cd4-4d54-84d5-393d7ef36599 nodeName:}" failed. No retries permitted until 2026-09-10 03:54:20.286296985 +0000 UTC m=+374.373041527 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs") pod "network-metrics-daemon-qbqrq" (UID: "c4de56fa-4cd4-4d54-84d5-393d7ef36599") : secret "metrics-daemon-secret" not found Sep 10 03:52:18.891399 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:18.891366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:18.891540 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:18.891408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:18.891540 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:18.891502 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 03:52:18.891610 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:18.891535 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:22.891517788 +0000 UTC m=+256.978262330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : configmap references non-existent config key: service-ca.crt Sep 10 03:52:18.891610 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:18.891560 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:22.891552068 +0000 UTC m=+256.978296608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : secret "router-metrics-certs-default" not found Sep 10 03:52:19.220888 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:19.220792 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" event={"ID":"fc13a35e-4c61-402a-a875-ec9e25d0b975","Type":"ContainerStarted","Data":"c820e8091ad5ff0f2588e9cf861f6568e43499e8feb600a79397cceb55717235"} Sep 10 03:52:19.222416 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:19.222381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" event={"ID":"c126bdb5-4908-481b-9568-0b75eec62b9d","Type":"ContainerStarted","Data":"7f25483051375cc7b166750c85f03887f6e1ef9727ca38f751e515645216ce09"} Sep 10 03:52:19.223900 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:19.223875 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" event={"ID":"21d44376-0129-4670-a02f-069e1c10446e","Type":"ContainerStarted","Data":"4d7aefd896419e2914291bf6f86f10b683087bc3f2c90e03b262afd3295d5943"} Sep 10 03:52:19.238436 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:19.238388 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" podStartSLOduration=1.102294188 podStartE2EDuration="4.238373443s" totalImagesPullingTime="3.136079255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:52:19.236666686 +0000 UTC m=+253.323411249" watchObservedRunningTime="2026-09-10 03:52:19.238373443 +0000 UTC m=+253.325118006" Sep 10 03:52:19.251145 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:19.251093 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" podStartSLOduration=1.204821641 podStartE2EDuration="4.251073233s" totalImagesPullingTime="3.046251592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:52:19.250266507 +0000 UTC m=+253.337011073" watchObservedRunningTime="2026-09-10 03:52:19.251073233 +0000 UTC m=+253.337817799" Sep 10 03:52:19.263846 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:19.263789 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" podStartSLOduration=1.227307693 podStartE2EDuration="4.263767314s" totalImagesPullingTime="3.036459621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:52:19.263551308 +0000 UTC m=+253.350295870" watchObservedRunningTime="2026-09-10 03:52:19.263767314 +0000 UTC m=+253.350511878" Sep 10 03:52:20.247271 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.247239 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vlmgn"] Sep 10 03:52:20.251531 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.251512 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.253910 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.253884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nhqj9\"" Sep 10 03:52:20.254025 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.253926 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 03:52:20.254025 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.254018 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 03:52:20.263088 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.263062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlmgn"] Sep 10 03:52:20.303537 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.303503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-crio-socket\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.303727 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.303557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.303727 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.303602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.303727 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.303723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-data-volume\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.303902 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.303750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlq9t\" (UniqueName: \"kubernetes.io/projected/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-api-access-mlq9t\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.404846 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.404814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-crio-socket\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.404846 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.404855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.405088 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.404875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.405088 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.404920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-data-volume\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.405088 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.404936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlq9t\" (UniqueName: \"kubernetes.io/projected/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-api-access-mlq9t\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.405088 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:20.404948 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:52:20.405088 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:20.405014 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:20.904998116 +0000 UTC m=+254.991742661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : configmap "kube-rbac-proxy" not found Sep 10 03:52:20.405088 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:20.405042 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:52:20.405345 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:20.405103 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:20.905086156 +0000 UTC m=+254.991830701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : secret "insights-runtime-extractor-tls" not found Sep 10 03:52:20.405345 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.404954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-crio-socket\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.405345 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.405313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-data-volume\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.413804 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.413768 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlq9t\" (UniqueName: \"kubernetes.io/projected/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-api-access-mlq9t\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.908814 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.908775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.908814 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:20.908813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:20.909177 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:20.908911 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:52:20.909177 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:20.908974 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:52:20.909177 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:20.908999 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:21.908968928 +0000 UTC m=+255.995713482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : configmap "kube-rbac-proxy" not found Sep 10 03:52:20.909177 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:20.909018 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:21.909009245 +0000 UTC m=+255.995753786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : secret "insights-runtime-extractor-tls" not found Sep 10 03:52:21.918452 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:21.918410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:21.918452 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:21.918454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:21.918917 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:21.918544 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:52:21.918917 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:21.918614 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:23.918595862 +0000 UTC m=+258.005340403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : configmap "kube-rbac-proxy" not found Sep 10 03:52:21.918917 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:21.918645 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:52:21.918917 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:21.918694 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:23.91868189 +0000 UTC m=+258.005426437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : secret "insights-runtime-extractor-tls" not found Sep 10 03:52:22.002915 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:22.002890 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5j58k_7904bd49-0bf4-408c-bd29-4122534b2ffe/dns-node-resolver/0.log" Sep 10 03:52:22.927222 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:22.927172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:22.927627 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:22.927238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:22.927627 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:22.927376 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:30.927355832 +0000 UTC m=+265.014100395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : configmap references non-existent config key: service-ca.crt Sep 10 03:52:22.927627 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:22.927392 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 03:52:22.927627 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:22.927453 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:30.927439532 +0000 UTC m=+265.014184078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : secret "router-metrics-certs-default" not found Sep 10 03:52:23.009132 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:23.009107 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jthcf_3fef3c33-f7c3-4733-9d77-a4380a911689/node-ca/0.log" Sep 10 03:52:23.934599 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:23.934556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:23.934599 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:23.934603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:23.935031 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:23.934698 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:52:23.935031 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:23.934767 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:27.934749181 +0000 UTC m=+262.021493736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : configmap "kube-rbac-proxy" not found Sep 10 03:52:23.935031 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:23.934796 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:52:23.935031 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:23.934856 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:27.934841826 +0000 UTC m=+262.021586386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : secret "insights-runtime-extractor-tls" not found Sep 10 03:52:24.003251 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:24.003202 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cwnls_a930973d-eaaf-4e09-910f-6692ba283bd1/serve-healthcheck-canary/0.log" Sep 10 03:52:27.966859 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:27.966823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:27.966859 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:27.966859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:27.967257 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:27.966965 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 03:52:27.967257 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:27.966998 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:52:27.967257 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:27.967032 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:35.967015577 +0000 UTC m=+270.053760123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : configmap "kube-rbac-proxy" not found Sep 10 03:52:27.967257 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:27.967045 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:35.967039606 +0000 UTC m=+270.053784150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : secret "insights-runtime-extractor-tls" not found Sep 10 03:52:30.993823 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:30.993739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:30.993823 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:30.993790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:30.994188 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:30.993921 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle podName:d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:46.993895529 +0000 UTC m=+281.080640079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle") pod "router-default-6784b6bdfb-p2vsx" (UID: "d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61") : configmap references non-existent config key: service-ca.crt Sep 10 03:52:30.996192 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:30.996163 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-metrics-certs\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:36.038944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:36.038902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:36.038944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:36.038946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:36.039418 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:36.039116 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 03:52:36.039418 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:36.039179 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls podName:81d21465-4c2e-45c2-82d5-2dc0fbbe5604 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:52.039163187 +0000 UTC m=+286.125907727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlmgn" (UID: "81d21465-4c2e-45c2-82d5-2dc0fbbe5604") : secret "insights-runtime-extractor-tls" not found Sep 10 03:52:36.039931 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:36.039913 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:46.980885 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:46.980848 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" podUID="bafdcb89-3716-41e8-b269-d7d2b64e1b13" Sep 10 03:52:46.980885 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:46.980855 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hlft4" podUID="cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b" Sep 10 03:52:47.029576 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:47.029546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:47.030116 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:47.030097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61-service-ca-bundle\") pod \"router-default-6784b6bdfb-p2vsx\" (UID: \"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61\") " pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:47.310078 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:47.309997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:52:47.310078 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:47.310025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlft4" Sep 10 03:52:47.315918 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:47.315892 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:47.587125 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:47.587056 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6784b6bdfb-p2vsx"] Sep 10 03:52:47.589905 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:47.589880 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dcb7aa_e9d3_430c_86a0_5ed0dee78e61.slice/crio-415725d96901ff4a95777899d574b3da59360af79f8e1f5db8ae77f703b390d7 WatchSource:0}: Error finding container 415725d96901ff4a95777899d574b3da59360af79f8e1f5db8ae77f703b390d7: Status 404 returned error can't find the container with id 415725d96901ff4a95777899d574b3da59360af79f8e1f5db8ae77f703b390d7 Sep 10 03:52:48.313948 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:48.313908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" event={"ID":"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61","Type":"ContainerStarted","Data":"4ca8101fc938f913a1d6a42c8e6467538b75f11ef50c869fb3db6c24ef403eb9"} Sep 10 03:52:48.314440 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:48.313959 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" event={"ID":"d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61","Type":"ContainerStarted","Data":"415725d96901ff4a95777899d574b3da59360af79f8e1f5db8ae77f703b390d7"} Sep 10 03:52:48.316331 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:48.316314 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:48.318867 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:48.318851 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:48.347994 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:48.347949 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" podStartSLOduration=33.347930472 podStartE2EDuration="33.347930472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:52:48.331595456 +0000 UTC m=+282.418340019" watchObservedRunningTime="2026-09-10 03:52:48.347930472 +0000 UTC m=+282.434675037" Sep 10 03:52:49.316997 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:49.316958 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:49.318340 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:49.318317 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6784b6bdfb-p2vsx" Sep 10 03:52:50.255772 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.255734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:52:50.255961 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.255831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:52:50.258098 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.258069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b-metrics-tls\") pod \"dns-default-hlft4\" (UID: \"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b\") " pod="openshift-dns/dns-default-hlft4" Sep 10 03:52:50.258203 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.258120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"image-registry-58dd5c9f4b-dd77z\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:52:50.314568 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.314539 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bt2fn\"" Sep 10 03:52:50.314707 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.314541 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lfmcw\"" Sep 10 03:52:50.321943 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.321920 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hlft4" Sep 10 03:52:50.322271 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.322010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:52:50.598417 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.598340 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hlft4"] Sep 10 03:52:50.601492 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:50.601465 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58dd5c9f4b-dd77z"] Sep 10 03:52:50.601694 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:50.601623 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd86512_4fbf_4dbf_b6ed_7976dd3f5d8b.slice/crio-6ca38ce39b664bc05f36ad45a5be80aa5592a8b672fb80c801944eaccc0279ae WatchSource:0}: Error finding container 6ca38ce39b664bc05f36ad45a5be80aa5592a8b672fb80c801944eaccc0279ae: Status 404 returned error can't find the container with id 6ca38ce39b664bc05f36ad45a5be80aa5592a8b672fb80c801944eaccc0279ae Sep 10 03:52:50.603962 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:50.603940 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafdcb89_3716_41e8_b269_d7d2b64e1b13.slice/crio-6b8fd0d69f12a5eeb6abbfa6b0e04154ddca877ea6ad99148e2fcdec0e5baaae WatchSource:0}: Error finding container 6b8fd0d69f12a5eeb6abbfa6b0e04154ddca877ea6ad99148e2fcdec0e5baaae: Status 404 returned error can't find the container with id 6b8fd0d69f12a5eeb6abbfa6b0e04154ddca877ea6ad99148e2fcdec0e5baaae Sep 10 03:52:51.324880 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:51.324841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" event={"ID":"bafdcb89-3716-41e8-b269-d7d2b64e1b13","Type":"ContainerStarted","Data":"ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30"} Sep 10 03:52:51.325341 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:51.324890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" event={"ID":"bafdcb89-3716-41e8-b269-d7d2b64e1b13","Type":"ContainerStarted","Data":"6b8fd0d69f12a5eeb6abbfa6b0e04154ddca877ea6ad99148e2fcdec0e5baaae"} Sep 10 03:52:51.325341 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:51.324945 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:52:51.326089 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:51.326070 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlft4" event={"ID":"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b","Type":"ContainerStarted","Data":"6ca38ce39b664bc05f36ad45a5be80aa5592a8b672fb80c801944eaccc0279ae"} Sep 10 03:52:51.345330 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:51.345272 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" podStartSLOduration=295.345259346 podStartE2EDuration="4m55.345259346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:52:51.344003083 +0000 UTC m=+285.430747647" watchObservedRunningTime="2026-09-10 03:52:51.345259346 +0000 UTC m=+285.432003908" Sep 10 03:52:52.071332 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:52.071267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:52.073872 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:52.073838 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81d21465-4c2e-45c2-82d5-2dc0fbbe5604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlmgn\" (UID: \"81d21465-4c2e-45c2-82d5-2dc0fbbe5604\") " pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:52.361093 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:52.361016 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlmgn" Sep 10 03:52:52.677760 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:52.677527 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlmgn"] Sep 10 03:52:52.679965 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:52.679941 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d21465_4c2e_45c2_82d5_2dc0fbbe5604.slice/crio-1d7204ed57c3981c2de472b8649d7cc3ed1494067d8e45979b471340450cd1b5 WatchSource:0}: Error finding container 1d7204ed57c3981c2de472b8649d7cc3ed1494067d8e45979b471340450cd1b5: Status 404 returned error can't find the container with id 1d7204ed57c3981c2de472b8649d7cc3ed1494067d8e45979b471340450cd1b5 Sep 10 03:52:52.982803 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:52.982770 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9rgzm"] Sep 10 03:52:52.998295 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:52.998244 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9rgzm"] Sep 10 03:52:52.998459 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:52.998392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.000631 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.000593 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 03:52:53.000858 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.000843 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 03:52:53.001869 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.001672 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 03:52:53.001869 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.001728 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 03:52:53.001869 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.001743 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dklqb\"" Sep 10 03:52:53.001869 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.001680 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 03:52:53.081381 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.081342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t82lp\" (UniqueName: \"kubernetes.io/projected/f1b1cd0d-3367-48f0-b35e-e472bff32e91-kube-api-access-t82lp\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.081558 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.081399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b1cd0d-3367-48f0-b35e-e472bff32e91-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.081558 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.081436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.081558 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.081458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.182302 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.182254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b1cd0d-3367-48f0-b35e-e472bff32e91-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.182463 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.182327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.182463 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.182355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.182463 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.182383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t82lp\" (UniqueName: \"kubernetes.io/projected/f1b1cd0d-3367-48f0-b35e-e472bff32e91-kube-api-access-t82lp\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.182587 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:53.182481 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 10 03:52:53.182587 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:53.182561 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-tls podName:f1b1cd0d-3367-48f0-b35e-e472bff32e91 nodeName:}" failed. No retries permitted until 2026-09-10 03:52:53.682538263 +0000 UTC m=+287.769282821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-9rgzm" (UID: "f1b1cd0d-3367-48f0-b35e-e472bff32e91") : secret "prometheus-operator-tls" not found Sep 10 03:52:53.183018 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.182995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b1cd0d-3367-48f0-b35e-e472bff32e91-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.184639 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.184601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.190393 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.190374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t82lp\" (UniqueName: \"kubernetes.io/projected/f1b1cd0d-3367-48f0-b35e-e472bff32e91-kube-api-access-t82lp\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.334132 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.334089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlmgn" event={"ID":"81d21465-4c2e-45c2-82d5-2dc0fbbe5604","Type":"ContainerStarted","Data":"a4076e1f19620c2a8bc3cba0b0f8fc2e6e42e4104e4abbf03e4796fb2d80ba88"} Sep 10 03:52:53.334319 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.334150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlmgn" event={"ID":"81d21465-4c2e-45c2-82d5-2dc0fbbe5604","Type":"ContainerStarted","Data":"1d7204ed57c3981c2de472b8649d7cc3ed1494067d8e45979b471340450cd1b5"} Sep 10 03:52:53.335755 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.335731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlft4" event={"ID":"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b","Type":"ContainerStarted","Data":"a7a28b7bcc73bf31a9d629bd002a0ff6d018e8bd5f85885e4e24d3ae155c49e9"} Sep 10 03:52:53.335874 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.335768 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hlft4" event={"ID":"cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b","Type":"ContainerStarted","Data":"866e2f9f8a790383d806786591e3660072806bac08ac65cfd791570761380811"} Sep 10 03:52:53.335874 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.335849 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hlft4" Sep 10 03:52:53.353832 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.353779 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hlft4" podStartSLOduration=251.260201508 podStartE2EDuration="4m13.353763394s" totalImagesPullingTime="2.093561886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:52:53.352419742 +0000 UTC m=+287.439164304" watchObservedRunningTime="2026-09-10 03:52:53.353763394 +0000 UTC m=+287.440507953" Sep 10 03:52:53.687567 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.687542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.689724 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.689705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b1cd0d-3367-48f0-b35e-e472bff32e91-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-9rgzm\" (UID: \"f1b1cd0d-3367-48f0-b35e-e472bff32e91\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:53.908655 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:53.908623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" Sep 10 03:52:54.177546 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:54.177472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-9rgzm"] Sep 10 03:52:54.180212 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:54.180187 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b1cd0d_3367_48f0_b35e_e472bff32e91.slice/crio-f8b78fd96bd394cc3c2ceee33a8ea678231be9dd2d1948b49aff45fd69109469 WatchSource:0}: Error finding container f8b78fd96bd394cc3c2ceee33a8ea678231be9dd2d1948b49aff45fd69109469: Status 404 returned error can't find the container with id f8b78fd96bd394cc3c2ceee33a8ea678231be9dd2d1948b49aff45fd69109469 Sep 10 03:52:54.342014 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:54.341976 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlmgn" event={"ID":"81d21465-4c2e-45c2-82d5-2dc0fbbe5604","Type":"ContainerStarted","Data":"a18c22b920e0cc88285c5db7fbb4f9ad737f52cbab6c2aeb8f183bf22d77f263"} Sep 10 03:52:54.343385 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:54.343361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" event={"ID":"f1b1cd0d-3367-48f0-b35e-e472bff32e91","Type":"ContainerStarted","Data":"f8b78fd96bd394cc3c2ceee33a8ea678231be9dd2d1948b49aff45fd69109469"} Sep 10 03:52:55.349014 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:55.348943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlmgn" event={"ID":"81d21465-4c2e-45c2-82d5-2dc0fbbe5604","Type":"ContainerStarted","Data":"6daca1d230563930946695ac12356797bc3c9944d7febe5ed60caeb3dcc503cd"} Sep 10 03:52:55.365542 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:55.365485 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vlmgn" podStartSLOduration=33.280270917 podStartE2EDuration="35.36546699s" totalImagesPullingTime="2.085196073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:52:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:52:55.364969732 +0000 UTC m=+289.451714294" watchObservedRunningTime="2026-09-10 03:52:55.36546699 +0000 UTC m=+289.452211553" Sep 10 03:52:56.353353 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:56.353312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" event={"ID":"f1b1cd0d-3367-48f0-b35e-e472bff32e91","Type":"ContainerStarted","Data":"580b96d01a82212cf62db914e39aeb92551efa726ae9699e011b947c6c9eea74"} Sep 10 03:52:56.353793 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:56.353380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" event={"ID":"f1b1cd0d-3367-48f0-b35e-e472bff32e91","Type":"ContainerStarted","Data":"9d8f7c51422708479b09c1f2a3738b9f9b8247f92806f0637af1defe886d5804"} Sep 10 03:52:56.371507 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:56.371457 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-9rgzm" podStartSLOduration=3.18563746 podStartE2EDuration="4.371441842s" totalImagesPullingTime="1.185804382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:52:56.370825976 +0000 UTC m=+290.457570540" watchObservedRunningTime="2026-09-10 03:52:56.371441842 +0000 UTC m=+290.458186404" Sep 10 03:52:58.331407 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.331367 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq"] Sep 10 03:52:58.336388 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.336364 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.338001 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.337974 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qtb6b"] Sep 10 03:52:58.338632 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.338611 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 03:52:58.338726 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.338705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 03:52:58.338840 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.338826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vnn95\"" Sep 10 03:52:58.341441 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.341419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.342319 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.342294 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fvp48"] Sep 10 03:52:58.343366 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.343348 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 03:52:58.343732 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.343712 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 03:52:58.343874 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.343858 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 03:52:58.343954 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.343894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s6wbd\"" Sep 10 03:52:58.345696 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.345675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.346986 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.346964 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq"] Sep 10 03:52:58.348250 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.348231 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8xvdt\"" Sep 10 03:52:58.348250 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.348240 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 03:52:58.348427 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.348331 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 03:52:58.348479 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.348452 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 03:52:58.359229 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.359203 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fvp48"] Sep 10 03:52:58.426463 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4085e644-1593-428e-b3f2-662a960bf84e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.426642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.426642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vclrv\" (UniqueName: \"kubernetes.io/projected/4085e644-1593-428e-b3f2-662a960bf84e-kube-api-access-vclrv\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.426642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjkw7\" (UniqueName: \"kubernetes.io/projected/264049a8-55b8-4220-a3d9-6054a0bfa34d-kube-api-access-rjkw7\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.426642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.426642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-tls\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.426642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.426828 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426670 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4085e644-1593-428e-b3f2-662a960bf84e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.426828 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-wtmp\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.426828 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4085e644-1593-428e-b3f2-662a960bf84e-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.426828 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.426828 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-textfile\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.426828 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-root\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.427006 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.427006 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r96kg\" (UniqueName: \"kubernetes.io/projected/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-api-access-r96kg\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.427006 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-sys\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.427006 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.427006 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.427006 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.426982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/264049a8-55b8-4220-a3d9-6054a0bfa34d-metrics-client-ca\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.528428 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.528428 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-tls\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.528656 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.528656 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4085e644-1593-428e-b3f2-662a960bf84e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.528656 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-wtmp\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.528656 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4085e644-1593-428e-b3f2-662a960bf84e-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.528656 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:58.528550 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 03:52:58.528656 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:52:58.528622 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-tls podName:264049a8-55b8-4220-a3d9-6054a0bfa34d nodeName:}" failed. No retries permitted until 2026-09-10 03:52:59.028598432 +0000 UTC m=+293.115342990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-tls") pod "node-exporter-qtb6b" (UID: "264049a8-55b8-4220-a3d9-6054a0bfa34d") : secret "node-exporter-tls" not found Sep 10 03:52:58.528956 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.528956 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528723 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-wtmp\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.528956 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-textfile\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.528956 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.528868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-root\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529147 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529005 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-root\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529203 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529161 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.529259 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529193 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-textfile\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529327 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529260 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4085e644-1593-428e-b3f2-662a960bf84e-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.529385 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.529443 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96kg\" (UniqueName: \"kubernetes.io/projected/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-api-access-r96kg\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.529443 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-sys\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529545 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529545 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529492 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.529545 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529515 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.529545 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529520 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/264049a8-55b8-4220-a3d9-6054a0bfa34d-sys\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529545 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/264049a8-55b8-4220-a3d9-6054a0bfa34d-metrics-client-ca\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529773 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4085e644-1593-428e-b3f2-662a960bf84e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.529773 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529773 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vclrv\" (UniqueName: \"kubernetes.io/projected/4085e644-1593-428e-b3f2-662a960bf84e-kube-api-access-vclrv\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.529773 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjkw7\" (UniqueName: \"kubernetes.io/projected/264049a8-55b8-4220-a3d9-6054a0bfa34d-kube-api-access-rjkw7\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.529950 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.529829 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.530412 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.530364 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.530412 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.530364 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/264049a8-55b8-4220-a3d9-6054a0bfa34d-metrics-client-ca\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.531698 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.531677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4085e644-1593-428e-b3f2-662a960bf84e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.531835 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.531810 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.531998 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.531974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.532157 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.532141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4085e644-1593-428e-b3f2-662a960bf84e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.532300 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.532270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.537634 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.537608 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r96kg\" (UniqueName: \"kubernetes.io/projected/374b5d7d-e75c-4a9b-8301-eec1cf4a85fa-kube-api-access-r96kg\") pod \"kube-state-metrics-74cb57df7-fvp48\" (UID: \"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.537755 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.537709 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjkw7\" (UniqueName: \"kubernetes.io/projected/264049a8-55b8-4220-a3d9-6054a0bfa34d-kube-api-access-rjkw7\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:58.537948 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.537928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vclrv\" (UniqueName: \"kubernetes.io/projected/4085e644-1593-428e-b3f2-662a960bf84e-kube-api-access-vclrv\") pod \"openshift-state-metrics-657fd6c54-j6frq\" (UID: \"4085e644-1593-428e-b3f2-662a960bf84e\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.648574 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.648355 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" Sep 10 03:52:58.662207 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.662182 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" Sep 10 03:52:58.927134 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.927062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq"] Sep 10 03:52:58.930108 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:58.930079 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4085e644_1593_428e_b3f2_662a960bf84e.slice/crio-3c90b51bc520c2688b0a8b3047115974f459851545cb793ba1120b3d6eb6763b WatchSource:0}: Error finding container 3c90b51bc520c2688b0a8b3047115974f459851545cb793ba1120b3d6eb6763b: Status 404 returned error can't find the container with id 3c90b51bc520c2688b0a8b3047115974f459851545cb793ba1120b3d6eb6763b Sep 10 03:52:58.947479 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:58.947455 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fvp48"] Sep 10 03:52:58.955264 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:58.955236 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374b5d7d_e75c_4a9b_8301_eec1cf4a85fa.slice/crio-2f1d8ca389d4c91850f549d3e5a67ce26078cb0b6ff09961dda2e4546b8f0adc WatchSource:0}: Error finding container 2f1d8ca389d4c91850f549d3e5a67ce26078cb0b6ff09961dda2e4546b8f0adc: Status 404 returned error can't find the container with id 2f1d8ca389d4c91850f549d3e5a67ce26078cb0b6ff09961dda2e4546b8f0adc Sep 10 03:52:59.033551 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:59.033521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-tls\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:59.035776 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:59.035757 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/264049a8-55b8-4220-a3d9-6054a0bfa34d-node-exporter-tls\") pod \"node-exporter-qtb6b\" (UID: \"264049a8-55b8-4220-a3d9-6054a0bfa34d\") " pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:59.255451 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:59.255369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtb6b" Sep 10 03:52:59.266154 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:52:59.266123 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264049a8_55b8_4220_a3d9_6054a0bfa34d.slice/crio-5d189e9ec9807e1d8c092b1dd1ead3d0301ac4eada546e169226fda3e13d27ad WatchSource:0}: Error finding container 5d189e9ec9807e1d8c092b1dd1ead3d0301ac4eada546e169226fda3e13d27ad: Status 404 returned error can't find the container with id 5d189e9ec9807e1d8c092b1dd1ead3d0301ac4eada546e169226fda3e13d27ad Sep 10 03:52:59.368501 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:59.368468 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtb6b" event={"ID":"264049a8-55b8-4220-a3d9-6054a0bfa34d","Type":"ContainerStarted","Data":"5d189e9ec9807e1d8c092b1dd1ead3d0301ac4eada546e169226fda3e13d27ad"} Sep 10 03:52:59.369667 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:59.369642 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" event={"ID":"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa","Type":"ContainerStarted","Data":"2f1d8ca389d4c91850f549d3e5a67ce26078cb0b6ff09961dda2e4546b8f0adc"} Sep 10 03:52:59.371486 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:59.371466 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" event={"ID":"4085e644-1593-428e-b3f2-662a960bf84e","Type":"ContainerStarted","Data":"ffdf46b9aad91fda6debe8f841d9262b737bf2381fa5cb1b485f2e4c2b18c5e0"} Sep 10 03:52:59.371591 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:59.371505 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" event={"ID":"4085e644-1593-428e-b3f2-662a960bf84e","Type":"ContainerStarted","Data":"e9fd0afc6519e3e36c7f8109c016739e15b49a0831968f7d9e2f26fb79203955"} Sep 10 03:52:59.371591 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:52:59.371522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" event={"ID":"4085e644-1593-428e-b3f2-662a960bf84e","Type":"ContainerStarted","Data":"3c90b51bc520c2688b0a8b3047115974f459851545cb793ba1120b3d6eb6763b"} Sep 10 03:53:01.380180 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:01.380146 2581 generic.go:356] "Generic (PLEG): container finished" podID="264049a8-55b8-4220-a3d9-6054a0bfa34d" containerID="7576a5e244c07bf89f9f9622858b3f7795aa221e6d264392229de6c125a4f3dd" exitCode=0 Sep 10 03:53:01.380628 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:01.380224 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtb6b" event={"ID":"264049a8-55b8-4220-a3d9-6054a0bfa34d","Type":"ContainerDied","Data":"7576a5e244c07bf89f9f9622858b3f7795aa221e6d264392229de6c125a4f3dd"} Sep 10 03:53:01.382983 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:01.382944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" event={"ID":"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa","Type":"ContainerStarted","Data":"c266a5a3411056503dbdea63052b33b24a8fc459c0735c032aefb0b4e2c9146e"} Sep 10 03:53:01.383095 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:01.383001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" event={"ID":"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa","Type":"ContainerStarted","Data":"5f91662bc499848a2c4816df47b342eebb1f5d30fe916887fbc9bac808c12e34"} Sep 10 03:53:01.383095 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:01.383030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" event={"ID":"374b5d7d-e75c-4a9b-8301-eec1cf4a85fa","Type":"ContainerStarted","Data":"0c15ae18dd6281c1d68627bd5f31c0a094eae5bf08145713b59c1a4a85a8464b"} Sep 10 03:53:01.385380 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:01.385355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" event={"ID":"4085e644-1593-428e-b3f2-662a960bf84e","Type":"ContainerStarted","Data":"f1155e7d3c7a40f76e42f2b43f9b42ec1ed83b32182d7aee345717759b02e2d6"} Sep 10 03:53:01.411024 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:53:01.410992 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qbqrq" podUID="c4de56fa-4cd4-4d54-84d5-393d7ef36599" Sep 10 03:53:01.421022 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:01.420942 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fvp48" podStartSLOduration=1.643486923 podStartE2EDuration="3.420926436s" totalImagesPullingTime="1.777439513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:53:01.420319918 +0000 UTC m=+295.507064490" watchObservedRunningTime="2026-09-10 03:53:01.420926436 +0000 UTC m=+295.507670998" Sep 10 03:53:01.438968 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:01.438917 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-j6frq" podStartSLOduration=1.750262798 podStartE2EDuration="3.43889707s" totalImagesPullingTime="1.688634272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:53:01.437846208 +0000 UTC m=+295.524590783" watchObservedRunningTime="2026-09-10 03:53:01.43889707 +0000 UTC m=+295.525641633" Sep 10 03:53:02.390876 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.390836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtb6b" event={"ID":"264049a8-55b8-4220-a3d9-6054a0bfa34d","Type":"ContainerStarted","Data":"25587ab7e5a0b9a3c4b050f5d56bd5b1b1134c153fa4b97557654c5c59159b59"} Sep 10 03:53:02.391326 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.390919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtb6b" event={"ID":"264049a8-55b8-4220-a3d9-6054a0bfa34d","Type":"ContainerStarted","Data":"b0d520cf9a474ad6e11c25e0cbc4e729c328b68ffb1ebeb9ba2d7d39cc7d7c54"} Sep 10 03:53:02.413161 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.413112 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qtb6b" podStartSLOduration=2.868655515 podStartE2EDuration="4.413097604s" totalImagesPullingTime="1.463723167s" totalInitContainerRuntime="80.718922ms" isStatefulPod=true podCreationTimestamp="2026-09-10 03:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:53:02.411235293 +0000 UTC m=+296.497979858" watchObservedRunningTime="2026-09-10 03:53:02.413097604 +0000 UTC m=+296.499842167" Sep 10 03:53:02.819547 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.819464 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-858d5cb4b5-rj6qc"] Sep 10 03:53:02.822686 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.822666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.825038 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.825017 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 03:53:02.825293 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.825262 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 03:53:02.826090 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.826071 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 03:53:02.826306 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.826271 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 03:53:02.826397 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.826315 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tq54r\"" Sep 10 03:53:02.826397 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.826324 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-du7jv34eiei50\"" Sep 10 03:53:02.832605 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.832583 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-858d5cb4b5-rj6qc"] Sep 10 03:53:02.866800 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.866772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9js25\" (UniqueName: \"kubernetes.io/projected/f72de098-56a2-4f6e-9635-24982d6cfe3e-kube-api-access-9js25\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.866922 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.866811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f72de098-56a2-4f6e-9635-24982d6cfe3e-metrics-server-audit-profiles\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.866922 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.866856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-client-ca-bundle\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.866922 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.866880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f72de098-56a2-4f6e-9635-24982d6cfe3e-audit-log\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.866922 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.866909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72de098-56a2-4f6e-9635-24982d6cfe3e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.867095 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.867002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-secret-metrics-server-client-certs\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.867095 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.867032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-secret-metrics-server-tls\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.967769 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.967737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-secret-metrics-server-client-certs\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.967769 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.967773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-secret-metrics-server-tls\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.968099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.967803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9js25\" (UniqueName: \"kubernetes.io/projected/f72de098-56a2-4f6e-9635-24982d6cfe3e-kube-api-access-9js25\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.968099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.967819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f72de098-56a2-4f6e-9635-24982d6cfe3e-metrics-server-audit-profiles\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.968099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.967850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-client-ca-bundle\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.968099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.967875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f72de098-56a2-4f6e-9635-24982d6cfe3e-audit-log\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.968099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.968008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72de098-56a2-4f6e-9635-24982d6cfe3e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.968351 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.968265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f72de098-56a2-4f6e-9635-24982d6cfe3e-audit-log\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.968786 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.968762 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72de098-56a2-4f6e-9635-24982d6cfe3e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.968895 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.968872 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f72de098-56a2-4f6e-9635-24982d6cfe3e-metrics-server-audit-profiles\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.970323 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.970305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-secret-metrics-server-client-certs\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.970736 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.970716 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-client-ca-bundle\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.970812 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.970757 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f72de098-56a2-4f6e-9635-24982d6cfe3e-secret-metrics-server-tls\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:02.974834 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:02.974818 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9js25\" (UniqueName: \"kubernetes.io/projected/f72de098-56a2-4f6e-9635-24982d6cfe3e-kube-api-access-9js25\") pod \"metrics-server-858d5cb4b5-rj6qc\" (UID: \"f72de098-56a2-4f6e-9635-24982d6cfe3e\") " pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:03.132721 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.132688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:03.345970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.345939 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hlft4" Sep 10 03:53:03.403365 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.403231 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-858d5cb4b5-rj6qc"] Sep 10 03:53:03.405623 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:53:03.405596 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72de098_56a2_4f6e_9635_24982d6cfe3e.slice/crio-30893f57a33e6f82b17f8ca7bc19e0c7f731e6b6ea653c81cffee297d5ea7802 WatchSource:0}: Error finding container 30893f57a33e6f82b17f8ca7bc19e0c7f731e6b6ea653c81cffee297d5ea7802: Status 404 returned error can't find the container with id 30893f57a33e6f82b17f8ca7bc19e0c7f731e6b6ea653c81cffee297d5ea7802 Sep 10 03:53:03.546530 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.546497 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-765645f455-dt5gx"] Sep 10 03:53:03.551098 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.551075 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58dd5c9f4b-dd77z"] Sep 10 03:53:03.551223 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.551182 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.553398 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.553379 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 03:53:03.553589 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.553486 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 03:53:03.553854 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.553807 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 03:53:03.553854 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.553840 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9ctg2\"" Sep 10 03:53:03.554352 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.553850 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 03:53:03.554352 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.553840 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 03:53:03.559211 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.559187 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 03:53:03.563771 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.563750 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-765645f455-dt5gx"] Sep 10 03:53:03.674774 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.674684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-secret-telemeter-client\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.674774 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.674732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-telemeter-trusted-ca-bundle\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.674774 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.674758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-metrics-client-ca\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.674774 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.674778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.675072 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.674798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-federate-client-tls\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.675072 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.674837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-telemeter-client-tls\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.675072 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.674881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8797c\" (UniqueName: \"kubernetes.io/projected/94a2854a-b630-4786-a5db-f4f0d424a282-kube-api-access-8797c\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.675072 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.674957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-serving-certs-ca-bundle\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.776173 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-serving-certs-ca-bundle\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.776382 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-secret-telemeter-client\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.776382 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-telemeter-trusted-ca-bundle\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.776382 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776266 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-metrics-client-ca\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.776382 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.776382 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-federate-client-tls\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.776661 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-telemeter-client-tls\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.776661 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8797c\" (UniqueName: \"kubernetes.io/projected/94a2854a-b630-4786-a5db-f4f0d424a282-kube-api-access-8797c\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.777034 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.776996 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-serving-certs-ca-bundle\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.777034 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.777025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-metrics-client-ca\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.777226 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.777205 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a2854a-b630-4786-a5db-f4f0d424a282-telemeter-trusted-ca-bundle\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.778803 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.778782 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-secret-telemeter-client\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.779073 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.779053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.779073 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.779066 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-federate-client-tls\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.779191 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.779058 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/94a2854a-b630-4786-a5db-f4f0d424a282-telemeter-client-tls\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.783813 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.783794 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8797c\" (UniqueName: \"kubernetes.io/projected/94a2854a-b630-4786-a5db-f4f0d424a282-kube-api-access-8797c\") pod \"telemeter-client-765645f455-dt5gx\" (UID: \"94a2854a-b630-4786-a5db-f4f0d424a282\") " pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:03.862111 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:03.862077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" Sep 10 03:53:04.160795 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:04.160759 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-765645f455-dt5gx"] Sep 10 03:53:04.164150 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:53:04.164117 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a2854a_b630_4786_a5db_f4f0d424a282.slice/crio-df296d9d08f85ed28072eb55a0273f36055f951bf97649990869f4b77f6c248a WatchSource:0}: Error finding container df296d9d08f85ed28072eb55a0273f36055f951bf97649990869f4b77f6c248a: Status 404 returned error can't find the container with id df296d9d08f85ed28072eb55a0273f36055f951bf97649990869f4b77f6c248a Sep 10 03:53:04.400482 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:04.400440 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" event={"ID":"f72de098-56a2-4f6e-9635-24982d6cfe3e","Type":"ContainerStarted","Data":"30893f57a33e6f82b17f8ca7bc19e0c7f731e6b6ea653c81cffee297d5ea7802"} Sep 10 03:53:04.403723 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:04.403685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" event={"ID":"94a2854a-b630-4786-a5db-f4f0d424a282","Type":"ContainerStarted","Data":"df296d9d08f85ed28072eb55a0273f36055f951bf97649990869f4b77f6c248a"} Sep 10 03:53:05.409913 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:05.409866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" event={"ID":"f72de098-56a2-4f6e-9635-24982d6cfe3e","Type":"ContainerStarted","Data":"a0cf2d15701ff7d42f1172345d586ea591e243cb747578fcf3b2861cca322ddd"} Sep 10 03:53:05.426943 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:05.426892 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" podStartSLOduration=1.865626141 podStartE2EDuration="3.426873861s" totalImagesPullingTime="1.56124772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:53:05.425319211 +0000 UTC m=+299.512063776" watchObservedRunningTime="2026-09-10 03:53:05.426873861 +0000 UTC m=+299.513618428" Sep 10 03:53:06.340708 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:06.340676 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 03:53:06.422770 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:06.422729 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" event={"ID":"94a2854a-b630-4786-a5db-f4f0d424a282","Type":"ContainerStarted","Data":"fe9b058d4556a06c8ae7c8b4a8d19d2ec3731659af3312902d03b773037b6e7c"} Sep 10 03:53:07.428915 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:07.428873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" event={"ID":"94a2854a-b630-4786-a5db-f4f0d424a282","Type":"ContainerStarted","Data":"a707643a901dc55e54afa8b3cb72f1c8ab1bc69f05376b961347b5eb75464283"} Sep 10 03:53:07.429271 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:07.428943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" event={"ID":"94a2854a-b630-4786-a5db-f4f0d424a282","Type":"ContainerStarted","Data":"ed4ff4c116e39846dddb730d734ca8643f93cda0ae77ee48043cb92658e308d8"} Sep 10 03:53:07.450498 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:07.450445 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-765645f455-dt5gx" podStartSLOduration=1.454608104 podStartE2EDuration="4.450431255s" totalImagesPullingTime="2.995823151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:53:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:53:07.44939883 +0000 UTC m=+301.536143396" watchObservedRunningTime="2026-09-10 03:53:07.450431255 +0000 UTC m=+301.537175817" Sep 10 03:53:10.628299 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.628243 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-m4mkr"] Sep 10 03:53:10.631752 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.631725 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-m4mkr" Sep 10 03:53:10.634064 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.634037 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 03:53:10.634193 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.634164 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 03:53:10.634239 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.634210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hnxrw\"" Sep 10 03:53:10.641713 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.641693 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-m4mkr"] Sep 10 03:53:10.744400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.744364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8n6n\" (UniqueName: \"kubernetes.io/projected/c2091742-d9b8-4dcf-8434-fdceed03a21d-kube-api-access-k8n6n\") pod \"downloads-85d98c998f-m4mkr\" (UID: \"c2091742-d9b8-4dcf-8434-fdceed03a21d\") " pod="openshift-console/downloads-85d98c998f-m4mkr" Sep 10 03:53:10.845685 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.845648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8n6n\" (UniqueName: \"kubernetes.io/projected/c2091742-d9b8-4dcf-8434-fdceed03a21d-kube-api-access-k8n6n\") pod \"downloads-85d98c998f-m4mkr\" (UID: \"c2091742-d9b8-4dcf-8434-fdceed03a21d\") " pod="openshift-console/downloads-85d98c998f-m4mkr" Sep 10 03:53:10.853656 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.853624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8n6n\" (UniqueName: \"kubernetes.io/projected/c2091742-d9b8-4dcf-8434-fdceed03a21d-kube-api-access-k8n6n\") pod \"downloads-85d98c998f-m4mkr\" (UID: \"c2091742-d9b8-4dcf-8434-fdceed03a21d\") " pod="openshift-console/downloads-85d98c998f-m4mkr" Sep 10 03:53:10.940541 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:10.940454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-m4mkr" Sep 10 03:53:11.211453 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:11.211370 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-m4mkr"] Sep 10 03:53:11.214991 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:53:11.214960 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2091742_d9b8_4dcf_8434_fdceed03a21d.slice/crio-7db4e739e7d8393ac0c2700feec2f04ee85e2ba8fbcf0000b518934dd902afcd WatchSource:0}: Error finding container 7db4e739e7d8393ac0c2700feec2f04ee85e2ba8fbcf0000b518934dd902afcd: Status 404 returned error can't find the container with id 7db4e739e7d8393ac0c2700feec2f04ee85e2ba8fbcf0000b518934dd902afcd Sep 10 03:53:11.216997 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:11.216981 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:53:11.444137 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:11.444100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-m4mkr" event={"ID":"c2091742-d9b8-4dcf-8434-fdceed03a21d","Type":"ContainerStarted","Data":"7db4e739e7d8393ac0c2700feec2f04ee85e2ba8fbcf0000b518934dd902afcd"} Sep 10 03:53:13.557626 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:13.557594 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:53:16.412413 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:16.412376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:53:23.133628 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:23.133585 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:23.134079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:23.133675 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:27.517733 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:27.517688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-m4mkr" event={"ID":"c2091742-d9b8-4dcf-8434-fdceed03a21d","Type":"ContainerStarted","Data":"2c96ad9b46281231df8656f6a572b4c35296285dcaf27e0de17e45fffab9bcb2"} Sep 10 03:53:27.518219 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:27.517922 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-m4mkr" Sep 10 03:53:27.531896 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:27.531870 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-m4mkr" Sep 10 03:53:27.535846 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:27.535748 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-m4mkr" podStartSLOduration=1.66900917 podStartE2EDuration="17.535707516s" totalImagesPullingTime="15.866698346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:53:27.533559544 +0000 UTC m=+321.620304108" watchObservedRunningTime="2026-09-10 03:53:27.535707516 +0000 UTC m=+321.622452080" Sep 10 03:53:28.574391 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.574334 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" podUID="bafdcb89-3716-41e8-b269-d7d2b64e1b13" containerName="registry" containerID="cri-o://ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30" gracePeriod=30 Sep 10 03:53:28.868450 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.868420 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:53:28.912062 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912028 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-image-registry-private-configuration\") pod \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " Sep 10 03:53:28.912242 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912083 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-certificates\") pod \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " Sep 10 03:53:28.912242 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912112 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r66w\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-kube-api-access-8r66w\") pod \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " Sep 10 03:53:28.912242 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912149 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-trusted-ca\") pod \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " Sep 10 03:53:28.912469 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912257 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb89-3716-41e8-b269-d7d2b64e1b13-ca-trust-extracted\") pod \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " Sep 10 03:53:28.912469 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912308 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") pod \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " Sep 10 03:53:28.912469 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912337 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-installation-pull-secrets\") pod \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " Sep 10 03:53:28.912469 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912375 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-bound-sa-token\") pod \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\" (UID: \"bafdcb89-3716-41e8-b269-d7d2b64e1b13\") " Sep 10 03:53:28.912674 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912561 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bafdcb89-3716-41e8-b269-d7d2b64e1b13" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:53:28.912674 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912635 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bafdcb89-3716-41e8-b269-d7d2b64e1b13" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:53:28.912780 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.912699 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-certificates\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:53:28.915260 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.915209 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bafdcb89-3716-41e8-b269-d7d2b64e1b13" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:53:28.916728 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.916675 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bafdcb89-3716-41e8-b269-d7d2b64e1b13" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:53:28.917173 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.917147 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bafdcb89-3716-41e8-b269-d7d2b64e1b13" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:53:28.917263 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.917239 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-kube-api-access-8r66w" (OuterVolumeSpecName: "kube-api-access-8r66w") pod "bafdcb89-3716-41e8-b269-d7d2b64e1b13" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13"). InnerVolumeSpecName "kube-api-access-8r66w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:53:28.918261 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.918238 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bafdcb89-3716-41e8-b269-d7d2b64e1b13" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:53:28.925590 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:28.925559 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafdcb89-3716-41e8-b269-d7d2b64e1b13-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bafdcb89-3716-41e8-b269-d7d2b64e1b13" (UID: "bafdcb89-3716-41e8-b269-d7d2b64e1b13"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:53:29.013943 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.013903 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb89-3716-41e8-b269-d7d2b64e1b13-ca-trust-extracted\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:53:29.013943 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.013942 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-registry-tls\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:53:29.014192 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.013957 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-installation-pull-secrets\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:53:29.014192 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.013974 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-bound-sa-token\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:53:29.014192 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.013990 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bafdcb89-3716-41e8-b269-d7d2b64e1b13-image-registry-private-configuration\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:53:29.014192 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.014004 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r66w\" (UniqueName: \"kubernetes.io/projected/bafdcb89-3716-41e8-b269-d7d2b64e1b13-kube-api-access-8r66w\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:53:29.014192 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.014018 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bafdcb89-3716-41e8-b269-d7d2b64e1b13-trusted-ca\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:53:29.528235 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.528144 2581 generic.go:356] "Generic (PLEG): container finished" podID="bafdcb89-3716-41e8-b269-d7d2b64e1b13" containerID="ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30" exitCode=0 Sep 10 03:53:29.528235 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.528186 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" Sep 10 03:53:29.528235 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.528223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" event={"ID":"bafdcb89-3716-41e8-b269-d7d2b64e1b13","Type":"ContainerDied","Data":"ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30"} Sep 10 03:53:29.528553 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.528300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58dd5c9f4b-dd77z" event={"ID":"bafdcb89-3716-41e8-b269-d7d2b64e1b13","Type":"ContainerDied","Data":"6b8fd0d69f12a5eeb6abbfa6b0e04154ddca877ea6ad99148e2fcdec0e5baaae"} Sep 10 03:53:29.528553 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.528332 2581 scope.go:117] "RemoveContainer" containerID="ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30" Sep 10 03:53:29.530099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.530075 2581 generic.go:356] "Generic (PLEG): container finished" podID="c126bdb5-4908-481b-9568-0b75eec62b9d" containerID="7f25483051375cc7b166750c85f03887f6e1ef9727ca38f751e515645216ce09" exitCode=0 Sep 10 03:53:29.530200 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.530148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" event={"ID":"c126bdb5-4908-481b-9568-0b75eec62b9d","Type":"ContainerDied","Data":"7f25483051375cc7b166750c85f03887f6e1ef9727ca38f751e515645216ce09"} Sep 10 03:53:29.530592 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.530571 2581 scope.go:117] "RemoveContainer" containerID="7f25483051375cc7b166750c85f03887f6e1ef9727ca38f751e515645216ce09" Sep 10 03:53:29.540807 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.540786 2581 scope.go:117] "RemoveContainer" containerID="ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30" Sep 10 03:53:29.541128 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:53:29.541100 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30\": container with ID starting with ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30 not found: ID does not exist" containerID="ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30" Sep 10 03:53:29.541221 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.541140 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30"} err="failed to get container status \"ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30\": rpc error: code = NotFound desc = could not find container \"ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30\": container with ID starting with ac12de480bb22dd64ba8ace6ff35673a8505fbc81077896b96dc5ad236b06a30 not found: ID does not exist" Sep 10 03:53:29.565211 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.565185 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58dd5c9f4b-dd77z"] Sep 10 03:53:29.569162 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:29.569137 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58dd5c9f4b-dd77z"] Sep 10 03:53:30.416376 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:30.416340 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bafdcb89-3716-41e8-b269-d7d2b64e1b13" path="/var/lib/kubelet/pods/bafdcb89-3716-41e8-b269-d7d2b64e1b13/volumes" Sep 10 03:53:30.536587 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:30.536556 2581 generic.go:356] "Generic (PLEG): container finished" podID="21d44376-0129-4670-a02f-069e1c10446e" containerID="4d7aefd896419e2914291bf6f86f10b683087bc3f2c90e03b262afd3295d5943" exitCode=0 Sep 10 03:53:30.536759 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:30.536633 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" event={"ID":"21d44376-0129-4670-a02f-069e1c10446e","Type":"ContainerDied","Data":"4d7aefd896419e2914291bf6f86f10b683087bc3f2c90e03b262afd3295d5943"} Sep 10 03:53:30.537099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:30.537075 2581 scope.go:117] "RemoveContainer" containerID="4d7aefd896419e2914291bf6f86f10b683087bc3f2c90e03b262afd3295d5943" Sep 10 03:53:30.540126 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:30.540103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-rdhqz" event={"ID":"c126bdb5-4908-481b-9568-0b75eec62b9d","Type":"ContainerStarted","Data":"9e2894f304b5c59bcd735e36a9954b9b0e0258e8734d7038b50e8ed950081eea"} Sep 10 03:53:31.546527 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:31.546487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-92ltf" event={"ID":"21d44376-0129-4670-a02f-069e1c10446e","Type":"ContainerStarted","Data":"8468db253e4b73b3f358d69233cb489964a0dfdc5956a6173069f0a51deeba0a"} Sep 10 03:53:43.138853 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:43.138822 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:43.142726 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:43.142696 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-858d5cb4b5-rj6qc" Sep 10 03:53:44.599555 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:44.599521 2581 generic.go:356] "Generic (PLEG): container finished" podID="fc13a35e-4c61-402a-a875-ec9e25d0b975" containerID="c820e8091ad5ff0f2588e9cf861f6568e43499e8feb600a79397cceb55717235" exitCode=0 Sep 10 03:53:44.599948 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:44.599577 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" event={"ID":"fc13a35e-4c61-402a-a875-ec9e25d0b975","Type":"ContainerDied","Data":"c820e8091ad5ff0f2588e9cf861f6568e43499e8feb600a79397cceb55717235"} Sep 10 03:53:44.599948 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:44.599909 2581 scope.go:117] "RemoveContainer" containerID="c820e8091ad5ff0f2588e9cf861f6568e43499e8feb600a79397cceb55717235" Sep 10 03:53:45.605791 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:53:45.605759 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-qdc2w" event={"ID":"fc13a35e-4c61-402a-a875-ec9e25d0b975","Type":"ContainerStarted","Data":"efb632ebc3a3d8344bb4647c6ac3006ed0576cbae83cad4934c87987951fb574"} Sep 10 03:54:20.325364 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.325333 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:54:20.325873 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.325843 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bafdcb89-3716-41e8-b269-d7d2b64e1b13" containerName="registry" Sep 10 03:54:20.325873 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.325866 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bafdcb89-3716-41e8-b269-d7d2b64e1b13" containerName="registry" Sep 10 03:54:20.326068 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.325961 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bafdcb89-3716-41e8-b269-d7d2b64e1b13" containerName="registry" Sep 10 03:54:20.328665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.328645 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.331076 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.331055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5sld2\"" Sep 10 03:54:20.331326 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.331306 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 03:54:20.331433 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.331344 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 03:54:20.331433 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.331359 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 03:54:20.331433 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.331420 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 03:54:20.331596 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.331484 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 03:54:20.331596 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.331482 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 03:54:20.331596 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.331559 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 03:54:20.332047 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.332032 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 03:54:20.336220 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.336200 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 03:54:20.344448 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.344420 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:54:20.364018 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.363981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.364327 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.364307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be24ef12-dbaa-4ea9-b055-5054bd058492-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.364456 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.364442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be24ef12-dbaa-4ea9-b055-5054bd058492-config-out\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.364551 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.364539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-web-config\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.364663 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.364649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be24ef12-dbaa-4ea9-b055-5054bd058492-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.364770 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.364757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:54:20.364864 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.364851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.364969 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.364955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.365056 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.365044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.365143 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.365131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.365230 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.365217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv6q9\" (UniqueName: \"kubernetes.io/projected/be24ef12-dbaa-4ea9-b055-5054bd058492-kube-api-access-qv6q9\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.365358 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.365344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-config-volume\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.365457 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.365444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be24ef12-dbaa-4ea9-b055-5054bd058492-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.365562 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.365547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be24ef12-dbaa-4ea9-b055-5054bd058492-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.368678 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.368645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4de56fa-4cd4-4d54-84d5-393d7ef36599-metrics-certs\") pod \"network-metrics-daemon-qbqrq\" (UID: \"c4de56fa-4cd4-4d54-84d5-393d7ef36599\") " pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:54:20.466495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.466666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be24ef12-dbaa-4ea9-b055-5054bd058492-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.466666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be24ef12-dbaa-4ea9-b055-5054bd058492-config-out\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.466666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-web-config\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.466666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be24ef12-dbaa-4ea9-b055-5054bd058492-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.466666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.466666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.466666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.466666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.467060 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv6q9\" (UniqueName: \"kubernetes.io/projected/be24ef12-dbaa-4ea9-b055-5054bd058492-kube-api-access-qv6q9\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.467060 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-config-volume\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.467060 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be24ef12-dbaa-4ea9-b055-5054bd058492-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.467060 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be24ef12-dbaa-4ea9-b055-5054bd058492-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.467060 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.466992 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be24ef12-dbaa-4ea9-b055-5054bd058492-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.467794 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.467768 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be24ef12-dbaa-4ea9-b055-5054bd058492-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.469694 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.469645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.469694 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.469689 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-web-config\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.469909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.469884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be24ef12-dbaa-4ea9-b055-5054bd058492-config-out\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.470116 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.470088 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.470302 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.470263 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.470873 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.470399 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be24ef12-dbaa-4ea9-b055-5054bd058492-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.470873 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.470468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.470873 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.470607 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be24ef12-dbaa-4ea9-b055-5054bd058492-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.470873 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.470834 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-config-volume\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.471518 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.471502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be24ef12-dbaa-4ea9-b055-5054bd058492-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.475796 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.475781 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv6q9\" (UniqueName: \"kubernetes.io/projected/be24ef12-dbaa-4ea9-b055-5054bd058492-kube-api-access-qv6q9\") pod \"alertmanager-main-0\" (UID: \"be24ef12-dbaa-4ea9-b055-5054bd058492\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.616089 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.616002 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7r79s\"" Sep 10 03:54:20.624051 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.624034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbqrq" Sep 10 03:54:20.638782 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.638746 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 03:54:20.891677 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.891653 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qbqrq"] Sep 10 03:54:20.894013 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:54:20.893985 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4de56fa_4cd4_4d54_84d5_393d7ef36599.slice/crio-5435360f7ce054e88e682ba0cf6bc2651d47d89deeec091257cd0781089e2fce WatchSource:0}: Error finding container 5435360f7ce054e88e682ba0cf6bc2651d47d89deeec091257cd0781089e2fce: Status 404 returned error can't find the container with id 5435360f7ce054e88e682ba0cf6bc2651d47d89deeec091257cd0781089e2fce Sep 10 03:54:20.925153 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:20.925123 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 03:54:20.925732 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:54:20.925700 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe24ef12_dbaa_4ea9_b055_5054bd058492.slice/crio-10277defd9f2b9ff1e2384c1a842d12ade223863d3cfe14fc948520773a8982b WatchSource:0}: Error finding container 10277defd9f2b9ff1e2384c1a842d12ade223863d3cfe14fc948520773a8982b: Status 404 returned error can't find the container with id 10277defd9f2b9ff1e2384c1a842d12ade223863d3cfe14fc948520773a8982b Sep 10 03:54:21.747255 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:21.747186 2581 generic.go:356] "Generic (PLEG): container finished" podID="be24ef12-dbaa-4ea9-b055-5054bd058492" containerID="fbf61a2bdcab55f54e35534d2cc04f22395403f9ff69450ebe5f36d8d83e84bf" exitCode=0 Sep 10 03:54:21.747734 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:21.747297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be24ef12-dbaa-4ea9-b055-5054bd058492","Type":"ContainerDied","Data":"fbf61a2bdcab55f54e35534d2cc04f22395403f9ff69450ebe5f36d8d83e84bf"} Sep 10 03:54:21.747734 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:21.747388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be24ef12-dbaa-4ea9-b055-5054bd058492","Type":"ContainerStarted","Data":"10277defd9f2b9ff1e2384c1a842d12ade223863d3cfe14fc948520773a8982b"} Sep 10 03:54:21.748904 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:21.748873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbqrq" event={"ID":"c4de56fa-4cd4-4d54-84d5-393d7ef36599","Type":"ContainerStarted","Data":"5435360f7ce054e88e682ba0cf6bc2651d47d89deeec091257cd0781089e2fce"} Sep 10 03:54:22.757683 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:22.757640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbqrq" event={"ID":"c4de56fa-4cd4-4d54-84d5-393d7ef36599","Type":"ContainerStarted","Data":"7c90521145aa55057f75875dc356a9fded238342ba12338db3ca0e094970776a"} Sep 10 03:54:22.758101 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:22.757709 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbqrq" event={"ID":"c4de56fa-4cd4-4d54-84d5-393d7ef36599","Type":"ContainerStarted","Data":"a22306b72c79863ca854c51df5a878215e8dc89438a2ae40c949d608b37da841"} Sep 10 03:54:22.775611 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:22.775551 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qbqrq" podStartSLOduration=375.824902616 podStartE2EDuration="6m16.775532468s" totalImagesPullingTime="950.629852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:54:22.773867164 +0000 UTC m=+376.860611742" watchObservedRunningTime="2026-09-10 03:54:22.775532468 +0000 UTC m=+376.862277032" Sep 10 03:54:23.764849 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:23.764770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be24ef12-dbaa-4ea9-b055-5054bd058492","Type":"ContainerStarted","Data":"763440be813c72fe867436ad3d4c18f5682cc1d35b7b50ca40ee43ea1c0c68dc"} Sep 10 03:54:23.764849 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:23.764834 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be24ef12-dbaa-4ea9-b055-5054bd058492","Type":"ContainerStarted","Data":"a3a3e4e6e4bc443bd71b9a44b56141c2eabe9b0266f46c456af4318b57f66a6b"} Sep 10 03:54:23.765217 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:23.764862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be24ef12-dbaa-4ea9-b055-5054bd058492","Type":"ContainerStarted","Data":"efe648c16be404f6920efcf4f26a4a5ae6e07531f624f2bef2d981485d8623a5"} Sep 10 03:54:23.765217 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:23.764890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be24ef12-dbaa-4ea9-b055-5054bd058492","Type":"ContainerStarted","Data":"d50ec3114cd0d548fc70f9d9174d6a4b64f70cc0eaac0b3d1d3a95a6f34873eb"} Sep 10 03:54:23.765217 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:23.764914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be24ef12-dbaa-4ea9-b055-5054bd058492","Type":"ContainerStarted","Data":"81f06ce42023e7b7bff5cfda907e6aebb5e46c75a1d8cfd2460dfa9ae298fe74"} Sep 10 03:54:24.771580 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:24.771542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be24ef12-dbaa-4ea9-b055-5054bd058492","Type":"ContainerStarted","Data":"f92bd3f3592815c3f91eef5366ed18488c79112bd6a11f43cb6540211f6810f2"} Sep 10 03:54:24.796525 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:54:24.796467 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.488207248 podStartE2EDuration="4.796447978s" totalImagesPullingTime="2.287059699s" totalInitContainerRuntime="21.181031ms" isStatefulPod=false podCreationTimestamp="2026-09-10 03:54:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:54:24.794471742 +0000 UTC m=+378.881216338" watchObservedRunningTime="2026-09-10 03:54:24.796447978 +0000 UTC m=+378.883192532" Sep 10 03:55:28.253302 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.253257 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf"] Sep 10 03:55:28.257908 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.257891 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.260327 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.260301 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:55:28.261122 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.261102 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:55:28.261122 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.261115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vkpzf\"" Sep 10 03:55:28.266232 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.266181 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf"] Sep 10 03:55:28.338788 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.338752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.338971 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.338840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.338971 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.338870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfwcs\" (UniqueName: \"kubernetes.io/projected/15db2ec4-1e8a-4690-af44-055edcc74b43-kube-api-access-pfwcs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.439771 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.439737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.439944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.439778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwcs\" (UniqueName: \"kubernetes.io/projected/15db2ec4-1e8a-4690-af44-055edcc74b43-kube-api-access-pfwcs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.439944 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.439834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.440212 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.440191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.440345 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.440202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.448130 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.448105 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwcs\" (UniqueName: \"kubernetes.io/projected/15db2ec4-1e8a-4690-af44-055edcc74b43-kube-api-access-pfwcs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.567249 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.567153 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:28.838854 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:28.838753 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf"] Sep 10 03:55:28.841962 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:55:28.841936 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15db2ec4_1e8a_4690_af44_055edcc74b43.slice/crio-0421a1957b195fefa5ef4990b3bc807a02350a1a112604cfe072158241f7e4d4 WatchSource:0}: Error finding container 0421a1957b195fefa5ef4990b3bc807a02350a1a112604cfe072158241f7e4d4: Status 404 returned error can't find the container with id 0421a1957b195fefa5ef4990b3bc807a02350a1a112604cfe072158241f7e4d4 Sep 10 03:55:29.023563 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:29.023532 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" event={"ID":"15db2ec4-1e8a-4690-af44-055edcc74b43","Type":"ContainerStarted","Data":"0421a1957b195fefa5ef4990b3bc807a02350a1a112604cfe072158241f7e4d4"} Sep 10 03:55:36.055462 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:36.055370 2581 generic.go:356] "Generic (PLEG): container finished" podID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerID="6dee7af12f6b04d715ad5dbe606f13cc78894ad45027ac544bba34231a4e335f" exitCode=0 Sep 10 03:55:36.055968 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:36.055457 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" event={"ID":"15db2ec4-1e8a-4690-af44-055edcc74b43","Type":"ContainerDied","Data":"6dee7af12f6b04d715ad5dbe606f13cc78894ad45027ac544bba34231a4e335f"} Sep 10 03:55:39.071658 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:39.071623 2581 generic.go:356] "Generic (PLEG): container finished" podID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerID="ec4b0d4ef7ff9c69474dba546f330b60864c42442eed4f158928d040c1e5ce72" exitCode=0 Sep 10 03:55:39.072096 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:39.071717 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" event={"ID":"15db2ec4-1e8a-4690-af44-055edcc74b43","Type":"ContainerDied","Data":"ec4b0d4ef7ff9c69474dba546f330b60864c42442eed4f158928d040c1e5ce72"} Sep 10 03:55:46.107193 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:46.107156 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" event={"ID":"15db2ec4-1e8a-4690-af44-055edcc74b43","Type":"ContainerStarted","Data":"c6cdd44f549e07d0e5ae93b8d491f0262b3512cfede8f77d622141ed9c504ff2"} Sep 10 03:55:46.125594 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:46.125420 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" podStartSLOduration=2.028086003 podStartE2EDuration="18.125402045s" totalImagesPullingTime="16.097316042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:55:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:55:46.125193093 +0000 UTC m=+460.211937657" watchObservedRunningTime="2026-09-10 03:55:46.125402045 +0000 UTC m=+460.212146610" Sep 10 03:55:47.113044 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:47.113005 2581 generic.go:356] "Generic (PLEG): container finished" podID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerID="c6cdd44f549e07d0e5ae93b8d491f0262b3512cfede8f77d622141ed9c504ff2" exitCode=0 Sep 10 03:55:47.113451 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:47.113073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" event={"ID":"15db2ec4-1e8a-4690-af44-055edcc74b43","Type":"ContainerDied","Data":"c6cdd44f549e07d0e5ae93b8d491f0262b3512cfede8f77d622141ed9c504ff2"} Sep 10 03:55:48.234659 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.234635 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:48.313984 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.313946 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-bundle\") pod \"15db2ec4-1e8a-4690-af44-055edcc74b43\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " Sep 10 03:55:48.314143 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.314033 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-util\") pod \"15db2ec4-1e8a-4690-af44-055edcc74b43\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " Sep 10 03:55:48.314143 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.314061 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfwcs\" (UniqueName: \"kubernetes.io/projected/15db2ec4-1e8a-4690-af44-055edcc74b43-kube-api-access-pfwcs\") pod \"15db2ec4-1e8a-4690-af44-055edcc74b43\" (UID: \"15db2ec4-1e8a-4690-af44-055edcc74b43\") " Sep 10 03:55:48.314620 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.314587 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-bundle" (OuterVolumeSpecName: "bundle") pod "15db2ec4-1e8a-4690-af44-055edcc74b43" (UID: "15db2ec4-1e8a-4690-af44-055edcc74b43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:55:48.316204 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.316178 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15db2ec4-1e8a-4690-af44-055edcc74b43-kube-api-access-pfwcs" (OuterVolumeSpecName: "kube-api-access-pfwcs") pod "15db2ec4-1e8a-4690-af44-055edcc74b43" (UID: "15db2ec4-1e8a-4690-af44-055edcc74b43"). InnerVolumeSpecName "kube-api-access-pfwcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:55:48.318338 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.318314 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-util" (OuterVolumeSpecName: "util") pod "15db2ec4-1e8a-4690-af44-055edcc74b43" (UID: "15db2ec4-1e8a-4690-af44-055edcc74b43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:55:48.414522 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.414493 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-util\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:55:48.414522 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.414518 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfwcs\" (UniqueName: \"kubernetes.io/projected/15db2ec4-1e8a-4690-af44-055edcc74b43-kube-api-access-pfwcs\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:55:48.414522 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:48.414527 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15db2ec4-1e8a-4690-af44-055edcc74b43-bundle\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:55:49.122318 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:49.122274 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" Sep 10 03:55:49.122318 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:49.122298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zjwrf" event={"ID":"15db2ec4-1e8a-4690-af44-055edcc74b43","Type":"ContainerDied","Data":"0421a1957b195fefa5ef4990b3bc807a02350a1a112604cfe072158241f7e4d4"} Sep 10 03:55:49.122537 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:49.122344 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0421a1957b195fefa5ef4990b3bc807a02350a1a112604cfe072158241f7e4d4" Sep 10 03:55:56.243490 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.243457 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q"] Sep 10 03:55:56.243970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.243794 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerName="pull" Sep 10 03:55:56.243970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.243808 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerName="pull" Sep 10 03:55:56.243970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.243830 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerName="util" Sep 10 03:55:56.243970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.243836 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerName="util" Sep 10 03:55:56.243970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.243842 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerName="extract" Sep 10 03:55:56.243970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.243847 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerName="extract" Sep 10 03:55:56.243970 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.243913 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="15db2ec4-1e8a-4690-af44-055edcc74b43" containerName="extract" Sep 10 03:55:56.247518 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.247498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" Sep 10 03:55:56.249834 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.249805 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:55:56.249967 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.249835 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 03:55:56.250112 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.250097 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5twww\"" Sep 10 03:55:56.257016 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.256995 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q"] Sep 10 03:55:56.268743 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.268718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80472eea-a14d-405a-baef-9395bb5a619a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lww6q\" (UID: \"80472eea-a14d-405a-baef-9395bb5a619a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" Sep 10 03:55:56.268844 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.268747 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcz6z\" (UniqueName: \"kubernetes.io/projected/80472eea-a14d-405a-baef-9395bb5a619a-kube-api-access-vcz6z\") pod \"cert-manager-operator-controller-manager-55c444bf86-lww6q\" (UID: \"80472eea-a14d-405a-baef-9395bb5a619a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" Sep 10 03:55:56.370051 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.370006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80472eea-a14d-405a-baef-9395bb5a619a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lww6q\" (UID: \"80472eea-a14d-405a-baef-9395bb5a619a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" Sep 10 03:55:56.370051 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.370051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcz6z\" (UniqueName: \"kubernetes.io/projected/80472eea-a14d-405a-baef-9395bb5a619a-kube-api-access-vcz6z\") pod \"cert-manager-operator-controller-manager-55c444bf86-lww6q\" (UID: \"80472eea-a14d-405a-baef-9395bb5a619a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" Sep 10 03:55:56.370423 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.370404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80472eea-a14d-405a-baef-9395bb5a619a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lww6q\" (UID: \"80472eea-a14d-405a-baef-9395bb5a619a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" Sep 10 03:55:56.380946 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.380924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcz6z\" (UniqueName: \"kubernetes.io/projected/80472eea-a14d-405a-baef-9395bb5a619a-kube-api-access-vcz6z\") pod \"cert-manager-operator-controller-manager-55c444bf86-lww6q\" (UID: \"80472eea-a14d-405a-baef-9395bb5a619a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" Sep 10 03:55:56.557118 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.557031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" Sep 10 03:55:56.831905 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:56.831821 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q"] Sep 10 03:55:56.835792 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:55:56.835763 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80472eea_a14d_405a_baef_9395bb5a619a.slice/crio-5d52f493d6c460ecdf5e76a67fb6d728a44908e8428b7e356b2bf679ec0e2a3e WatchSource:0}: Error finding container 5d52f493d6c460ecdf5e76a67fb6d728a44908e8428b7e356b2bf679ec0e2a3e: Status 404 returned error can't find the container with id 5d52f493d6c460ecdf5e76a67fb6d728a44908e8428b7e356b2bf679ec0e2a3e Sep 10 03:55:57.158247 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:57.158205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" event={"ID":"80472eea-a14d-405a-baef-9395bb5a619a","Type":"ContainerStarted","Data":"5d52f493d6c460ecdf5e76a67fb6d728a44908e8428b7e356b2bf679ec0e2a3e"} Sep 10 03:55:59.170083 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:59.170049 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" event={"ID":"80472eea-a14d-405a-baef-9395bb5a619a","Type":"ContainerStarted","Data":"97ea2338ad0992b53b147934b95f98ae5dded688b51f3a59dc2d5c26e12179b0"} Sep 10 03:55:59.190911 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:55:59.190863 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lww6q" podStartSLOduration=1.44573466 podStartE2EDuration="3.190849714s" totalImagesPullingTime="1.745115054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:55:59.187937033 +0000 UTC m=+473.274681631" watchObservedRunningTime="2026-09-10 03:55:59.190849714 +0000 UTC m=+473.277594276" Sep 10 03:56:00.311943 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.311908 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds"] Sep 10 03:56:00.314372 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.314355 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.316555 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.316533 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vkpzf\"" Sep 10 03:56:00.316790 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.316769 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:56:00.317425 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.317410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:56:00.323021 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.322998 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds"] Sep 10 03:56:00.401239 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.401198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.401458 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.401251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.401458 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.401315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8xxf\" (UniqueName: \"kubernetes.io/projected/ac549197-a4c5-4181-9d6e-62142367f01d-kube-api-access-m8xxf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.502182 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.502145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.502404 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.502195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.502404 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.502220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8xxf\" (UniqueName: \"kubernetes.io/projected/ac549197-a4c5-4181-9d6e-62142367f01d-kube-api-access-m8xxf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.502601 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.502567 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.502669 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.502621 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.517413 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.517388 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8xxf\" (UniqueName: \"kubernetes.io/projected/ac549197-a4c5-4181-9d6e-62142367f01d-kube-api-access-m8xxf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.624504 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.624422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:00.890907 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:00.890880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds"] Sep 10 03:56:00.893480 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:00.893453 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac549197_a4c5_4181_9d6e_62142367f01d.slice/crio-5e9396b3c968ea29567e4c5bd99465d6a12020f0192ed3f51583dbe70dad3f59 WatchSource:0}: Error finding container 5e9396b3c968ea29567e4c5bd99465d6a12020f0192ed3f51583dbe70dad3f59: Status 404 returned error can't find the container with id 5e9396b3c968ea29567e4c5bd99465d6a12020f0192ed3f51583dbe70dad3f59 Sep 10 03:56:01.181393 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:01.181307 2581 generic.go:356] "Generic (PLEG): container finished" podID="ac549197-a4c5-4181-9d6e-62142367f01d" containerID="43b7362ac0b3c78b01008dac251ed7a868a231390baa3a8c0585b2fa8d7e182a" exitCode=0 Sep 10 03:56:01.181538 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:01.181403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" event={"ID":"ac549197-a4c5-4181-9d6e-62142367f01d","Type":"ContainerDied","Data":"43b7362ac0b3c78b01008dac251ed7a868a231390baa3a8c0585b2fa8d7e182a"} Sep 10 03:56:01.181538 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:01.181441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" event={"ID":"ac549197-a4c5-4181-9d6e-62142367f01d","Type":"ContainerStarted","Data":"5e9396b3c968ea29567e4c5bd99465d6a12020f0192ed3f51583dbe70dad3f59"} Sep 10 03:56:02.580856 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.580820 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt"] Sep 10 03:56:02.585600 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.585574 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" Sep 10 03:56:02.587903 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.587877 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 03:56:02.588818 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.588797 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 03:56:02.588818 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.588802 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7m9lr\"" Sep 10 03:56:02.593323 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.593269 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt"] Sep 10 03:56:02.621245 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.621213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/630a3ffa-5e3c-48d6-a898-21d612526ca3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fcnpt\" (UID: \"630a3ffa-5e3c-48d6-a898-21d612526ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" Sep 10 03:56:02.621245 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.621244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxlfd\" (UniqueName: \"kubernetes.io/projected/630a3ffa-5e3c-48d6-a898-21d612526ca3-kube-api-access-sxlfd\") pod \"cert-manager-cainjector-559cdd8c87-fcnpt\" (UID: \"630a3ffa-5e3c-48d6-a898-21d612526ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" Sep 10 03:56:02.721922 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.721887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/630a3ffa-5e3c-48d6-a898-21d612526ca3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fcnpt\" (UID: \"630a3ffa-5e3c-48d6-a898-21d612526ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" Sep 10 03:56:02.722114 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.721928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxlfd\" (UniqueName: \"kubernetes.io/projected/630a3ffa-5e3c-48d6-a898-21d612526ca3-kube-api-access-sxlfd\") pod \"cert-manager-cainjector-559cdd8c87-fcnpt\" (UID: \"630a3ffa-5e3c-48d6-a898-21d612526ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" Sep 10 03:56:02.730530 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.730498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/630a3ffa-5e3c-48d6-a898-21d612526ca3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fcnpt\" (UID: \"630a3ffa-5e3c-48d6-a898-21d612526ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" Sep 10 03:56:02.730695 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.730583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxlfd\" (UniqueName: \"kubernetes.io/projected/630a3ffa-5e3c-48d6-a898-21d612526ca3-kube-api-access-sxlfd\") pod \"cert-manager-cainjector-559cdd8c87-fcnpt\" (UID: \"630a3ffa-5e3c-48d6-a898-21d612526ca3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" Sep 10 03:56:02.896483 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:02.896449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" Sep 10 03:56:03.500978 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:03.500901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt"] Sep 10 03:56:03.503910 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:03.503880 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod630a3ffa_5e3c_48d6_a898_21d612526ca3.slice/crio-aca7e7a019523b18c645988bde6ca29dce93d37d634630b869077d930fbb1905 WatchSource:0}: Error finding container aca7e7a019523b18c645988bde6ca29dce93d37d634630b869077d930fbb1905: Status 404 returned error can't find the container with id aca7e7a019523b18c645988bde6ca29dce93d37d634630b869077d930fbb1905 Sep 10 03:56:04.197421 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:04.197385 2581 generic.go:356] "Generic (PLEG): container finished" podID="ac549197-a4c5-4181-9d6e-62142367f01d" containerID="fcb2ccc84a0ad1a79a7839e65f5b380d76eb3194c6e8bcfa376a4f950ce03df6" exitCode=0 Sep 10 03:56:04.197883 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:04.197485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" event={"ID":"ac549197-a4c5-4181-9d6e-62142367f01d","Type":"ContainerDied","Data":"fcb2ccc84a0ad1a79a7839e65f5b380d76eb3194c6e8bcfa376a4f950ce03df6"} Sep 10 03:56:04.199153 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:04.199128 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" event={"ID":"630a3ffa-5e3c-48d6-a898-21d612526ca3","Type":"ContainerStarted","Data":"aca7e7a019523b18c645988bde6ca29dce93d37d634630b869077d930fbb1905"} Sep 10 03:56:05.206797 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:05.206762 2581 generic.go:356] "Generic (PLEG): container finished" podID="ac549197-a4c5-4181-9d6e-62142367f01d" containerID="596637f7c7f15652f17ee6c57769c4bef7a66bfeea45675ab51e3a45c1ac7a99" exitCode=0 Sep 10 03:56:05.207269 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:05.206862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" event={"ID":"ac549197-a4c5-4181-9d6e-62142367f01d","Type":"ContainerDied","Data":"596637f7c7f15652f17ee6c57769c4bef7a66bfeea45675ab51e3a45c1ac7a99"} Sep 10 03:56:06.213884 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.213842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" event={"ID":"630a3ffa-5e3c-48d6-a898-21d612526ca3","Type":"ContainerStarted","Data":"2512f35e0d12e4a47322c99bc1639652d3e1fe00a557bb6f63d3566525abefa5"} Sep 10 03:56:06.229248 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.229193 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fcnpt" podStartSLOduration=1.6260001640000001 podStartE2EDuration="4.229176719s" totalImagesPullingTime="2.603176555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:56:06.22815075 +0000 UTC m=+480.314895326" watchObservedRunningTime="2026-09-10 03:56:06.229176719 +0000 UTC m=+480.315921281" Sep 10 03:56:06.370015 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.369942 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:06.458688 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.458655 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8xxf\" (UniqueName: \"kubernetes.io/projected/ac549197-a4c5-4181-9d6e-62142367f01d-kube-api-access-m8xxf\") pod \"ac549197-a4c5-4181-9d6e-62142367f01d\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " Sep 10 03:56:06.458861 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.458765 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-util\") pod \"ac549197-a4c5-4181-9d6e-62142367f01d\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " Sep 10 03:56:06.458861 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.458797 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-bundle\") pod \"ac549197-a4c5-4181-9d6e-62142367f01d\" (UID: \"ac549197-a4c5-4181-9d6e-62142367f01d\") " Sep 10 03:56:06.459208 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.459185 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-bundle" (OuterVolumeSpecName: "bundle") pod "ac549197-a4c5-4181-9d6e-62142367f01d" (UID: "ac549197-a4c5-4181-9d6e-62142367f01d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:56:06.460901 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.460869 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac549197-a4c5-4181-9d6e-62142367f01d-kube-api-access-m8xxf" (OuterVolumeSpecName: "kube-api-access-m8xxf") pod "ac549197-a4c5-4181-9d6e-62142367f01d" (UID: "ac549197-a4c5-4181-9d6e-62142367f01d"). InnerVolumeSpecName "kube-api-access-m8xxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:56:06.466562 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.466532 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-util" (OuterVolumeSpecName: "util") pod "ac549197-a4c5-4181-9d6e-62142367f01d" (UID: "ac549197-a4c5-4181-9d6e-62142367f01d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:56:06.559588 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.559554 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-util\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:06.559588 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.559581 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac549197-a4c5-4181-9d6e-62142367f01d-bundle\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:06.559588 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:06.559591 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8xxf\" (UniqueName: \"kubernetes.io/projected/ac549197-a4c5-4181-9d6e-62142367f01d-kube-api-access-m8xxf\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:07.219993 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:07.219961 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" Sep 10 03:56:07.220391 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:07.219995 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9dpds" event={"ID":"ac549197-a4c5-4181-9d6e-62142367f01d","Type":"ContainerDied","Data":"5e9396b3c968ea29567e4c5bd99465d6a12020f0192ed3f51583dbe70dad3f59"} Sep 10 03:56:07.220391 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:07.220040 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e9396b3c968ea29567e4c5bd99465d6a12020f0192ed3f51583dbe70dad3f59" Sep 10 03:56:09.958689 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.958654 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wjkjx"] Sep 10 03:56:09.959086 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.958960 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac549197-a4c5-4181-9d6e-62142367f01d" containerName="extract" Sep 10 03:56:09.959086 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.958971 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac549197-a4c5-4181-9d6e-62142367f01d" containerName="extract" Sep 10 03:56:09.959086 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.958983 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac549197-a4c5-4181-9d6e-62142367f01d" containerName="pull" Sep 10 03:56:09.959086 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.958989 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac549197-a4c5-4181-9d6e-62142367f01d" containerName="pull" Sep 10 03:56:09.959086 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.958997 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac549197-a4c5-4181-9d6e-62142367f01d" containerName="util" Sep 10 03:56:09.959086 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.959003 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac549197-a4c5-4181-9d6e-62142367f01d" containerName="util" Sep 10 03:56:09.959086 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.959063 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac549197-a4c5-4181-9d6e-62142367f01d" containerName="extract" Sep 10 03:56:09.962516 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.962496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wjkjx" Sep 10 03:56:09.964702 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.964678 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-z9f2s\"" Sep 10 03:56:09.971654 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:09.971631 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wjkjx"] Sep 10 03:56:10.092675 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:10.092635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b5572e3-fbee-446d-8c69-f67252a9c0e6-bound-sa-token\") pod \"cert-manager-55b4d954d5-wjkjx\" (UID: \"9b5572e3-fbee-446d-8c69-f67252a9c0e6\") " pod="cert-manager/cert-manager-55b4d954d5-wjkjx" Sep 10 03:56:10.092826 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:10.092722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9768\" (UniqueName: \"kubernetes.io/projected/9b5572e3-fbee-446d-8c69-f67252a9c0e6-kube-api-access-v9768\") pod \"cert-manager-55b4d954d5-wjkjx\" (UID: \"9b5572e3-fbee-446d-8c69-f67252a9c0e6\") " pod="cert-manager/cert-manager-55b4d954d5-wjkjx" Sep 10 03:56:10.193774 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:10.193738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b5572e3-fbee-446d-8c69-f67252a9c0e6-bound-sa-token\") pod \"cert-manager-55b4d954d5-wjkjx\" (UID: \"9b5572e3-fbee-446d-8c69-f67252a9c0e6\") " pod="cert-manager/cert-manager-55b4d954d5-wjkjx" Sep 10 03:56:10.193898 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:10.193803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9768\" (UniqueName: \"kubernetes.io/projected/9b5572e3-fbee-446d-8c69-f67252a9c0e6-kube-api-access-v9768\") pod \"cert-manager-55b4d954d5-wjkjx\" (UID: \"9b5572e3-fbee-446d-8c69-f67252a9c0e6\") " pod="cert-manager/cert-manager-55b4d954d5-wjkjx" Sep 10 03:56:10.205025 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:10.203181 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b5572e3-fbee-446d-8c69-f67252a9c0e6-bound-sa-token\") pod \"cert-manager-55b4d954d5-wjkjx\" (UID: \"9b5572e3-fbee-446d-8c69-f67252a9c0e6\") " pod="cert-manager/cert-manager-55b4d954d5-wjkjx" Sep 10 03:56:10.207400 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:10.207372 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9768\" (UniqueName: \"kubernetes.io/projected/9b5572e3-fbee-446d-8c69-f67252a9c0e6-kube-api-access-v9768\") pod \"cert-manager-55b4d954d5-wjkjx\" (UID: \"9b5572e3-fbee-446d-8c69-f67252a9c0e6\") " pod="cert-manager/cert-manager-55b4d954d5-wjkjx" Sep 10 03:56:10.272311 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:10.272185 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wjkjx" Sep 10 03:56:10.542477 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:10.542438 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wjkjx"] Sep 10 03:56:10.544634 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:10.544593 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b5572e3_fbee_446d_8c69_f67252a9c0e6.slice/crio-a9c454413372c84087f1e9a6f12617bc0f0514e703d7704ad29bc4a6fa73f2f5 WatchSource:0}: Error finding container a9c454413372c84087f1e9a6f12617bc0f0514e703d7704ad29bc4a6fa73f2f5: Status 404 returned error can't find the container with id a9c454413372c84087f1e9a6f12617bc0f0514e703d7704ad29bc4a6fa73f2f5 Sep 10 03:56:11.238978 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:11.238946 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wjkjx" event={"ID":"9b5572e3-fbee-446d-8c69-f67252a9c0e6","Type":"ContainerStarted","Data":"6340fbda9ebed714e468614941d1939c0e6d8584380fcfc455827f7a55ea65be"} Sep 10 03:56:11.238978 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:11.238988 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wjkjx" event={"ID":"9b5572e3-fbee-446d-8c69-f67252a9c0e6","Type":"ContainerStarted","Data":"a9c454413372c84087f1e9a6f12617bc0f0514e703d7704ad29bc4a6fa73f2f5"} Sep 10 03:56:11.261428 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:11.261377 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wjkjx" podStartSLOduration=2.261359441 podStartE2EDuration="2.261359441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:56:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:56:11.25870802 +0000 UTC m=+485.345452583" watchObservedRunningTime="2026-09-10 03:56:11.261359441 +0000 UTC m=+485.348104003" Sep 10 03:56:12.928643 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:12.928605 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm"] Sep 10 03:56:12.932218 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:12.932196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" Sep 10 03:56:12.934500 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:12.934460 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 03:56:12.935538 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:12.935515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2xp6k\"" Sep 10 03:56:12.935651 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:12.935520 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:56:12.941555 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:12.941525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm"] Sep 10 03:56:13.020878 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:13.020839 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4mlvm\" (UID: \"8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" Sep 10 03:56:13.021048 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:13.020891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kn24\" (UniqueName: \"kubernetes.io/projected/8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee-kube-api-access-9kn24\") pod \"openshift-lws-operator-fd8ccff4c-4mlvm\" (UID: \"8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" Sep 10 03:56:13.121942 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:13.121904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4mlvm\" (UID: \"8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" Sep 10 03:56:13.122111 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:13.121954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kn24\" (UniqueName: \"kubernetes.io/projected/8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee-kube-api-access-9kn24\") pod \"openshift-lws-operator-fd8ccff4c-4mlvm\" (UID: \"8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" Sep 10 03:56:13.122333 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:13.122309 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4mlvm\" (UID: \"8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" Sep 10 03:56:13.130009 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:13.129983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kn24\" (UniqueName: \"kubernetes.io/projected/8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee-kube-api-access-9kn24\") pod \"openshift-lws-operator-fd8ccff4c-4mlvm\" (UID: \"8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" Sep 10 03:56:13.243164 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:13.243052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" Sep 10 03:56:13.513033 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:13.512956 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm"] Sep 10 03:56:13.516635 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:13.516611 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a63a5c9_6cb1_4dc8_80f2_a0660183b9ee.slice/crio-20b90bdee9aaf018c6e0c2397be04a1c37421608b4c256c91ec190da62d180c8 WatchSource:0}: Error finding container 20b90bdee9aaf018c6e0c2397be04a1c37421608b4c256c91ec190da62d180c8: Status 404 returned error can't find the container with id 20b90bdee9aaf018c6e0c2397be04a1c37421608b4c256c91ec190da62d180c8 Sep 10 03:56:14.253481 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:14.253410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" event={"ID":"8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee","Type":"ContainerStarted","Data":"20b90bdee9aaf018c6e0c2397be04a1c37421608b4c256c91ec190da62d180c8"} Sep 10 03:56:16.267019 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:16.266982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" event={"ID":"8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee","Type":"ContainerStarted","Data":"b34a9477049fea9de055f0b59521c0d86809352a318b4b4f4ec255e1112770e1"} Sep 10 03:56:16.283301 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:16.283223 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4mlvm" podStartSLOduration=2.16824296 podStartE2EDuration="4.283205767s" totalImagesPullingTime="2.114962807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:56:16.282349776 +0000 UTC m=+490.369094340" watchObservedRunningTime="2026-09-10 03:56:16.283205767 +0000 UTC m=+490.369950330" Sep 10 03:56:21.496360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.496323 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56"] Sep 10 03:56:21.500226 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.500204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.502549 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.502521 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:56:21.502803 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.502788 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:56:21.503545 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.503527 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vkpzf\"" Sep 10 03:56:21.509533 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.509509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56"] Sep 10 03:56:21.602755 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.602715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.602755 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.602758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spmjn\" (UniqueName: \"kubernetes.io/projected/01f807e1-fd2c-479b-b066-9fe8ad4547f9-kube-api-access-spmjn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.602991 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.602899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.703333 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.703269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.703522 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.703367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.703522 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.703390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmjn\" (UniqueName: \"kubernetes.io/projected/01f807e1-fd2c-479b-b066-9fe8ad4547f9-kube-api-access-spmjn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.703700 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.703677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.703754 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.703728 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.711595 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.711571 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmjn\" (UniqueName: \"kubernetes.io/projected/01f807e1-fd2c-479b-b066-9fe8ad4547f9-kube-api-access-spmjn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:21.811991 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:21.811895 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:22.083516 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:22.083485 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56"] Sep 10 03:56:22.085395 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:22.085371 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f807e1_fd2c_479b_b066_9fe8ad4547f9.slice/crio-c0b963fe905ba3ec8eb2f057b8185f6adc87fe029bde97865f1e2687f03535af WatchSource:0}: Error finding container c0b963fe905ba3ec8eb2f057b8185f6adc87fe029bde97865f1e2687f03535af: Status 404 returned error can't find the container with id c0b963fe905ba3ec8eb2f057b8185f6adc87fe029bde97865f1e2687f03535af Sep 10 03:56:22.295369 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:22.295336 2581 generic.go:356] "Generic (PLEG): container finished" podID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerID="617c2d6716795a56bab4b4c38a0962db13ed5bcff0701ca02751fa58325796f8" exitCode=0 Sep 10 03:56:22.295539 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:22.295409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" event={"ID":"01f807e1-fd2c-479b-b066-9fe8ad4547f9","Type":"ContainerDied","Data":"617c2d6716795a56bab4b4c38a0962db13ed5bcff0701ca02751fa58325796f8"} Sep 10 03:56:22.295539 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:22.295469 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" event={"ID":"01f807e1-fd2c-479b-b066-9fe8ad4547f9","Type":"ContainerStarted","Data":"c0b963fe905ba3ec8eb2f057b8185f6adc87fe029bde97865f1e2687f03535af"} Sep 10 03:56:23.301783 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:23.301698 2581 generic.go:356] "Generic (PLEG): container finished" podID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerID="aeb37cb14bd2150db5bfe6ad97cd511547b991c76528c96c67d52e59734ff9f4" exitCode=0 Sep 10 03:56:23.302126 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:23.301778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" event={"ID":"01f807e1-fd2c-479b-b066-9fe8ad4547f9","Type":"ContainerDied","Data":"aeb37cb14bd2150db5bfe6ad97cd511547b991c76528c96c67d52e59734ff9f4"} Sep 10 03:56:24.308545 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:24.308513 2581 generic.go:356] "Generic (PLEG): container finished" podID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerID="65b5e83476ca0d65cecf770fe17fbda86236d91996ccce2511088442e7b04d84" exitCode=0 Sep 10 03:56:24.308930 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:24.308589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" event={"ID":"01f807e1-fd2c-479b-b066-9fe8ad4547f9","Type":"ContainerDied","Data":"65b5e83476ca0d65cecf770fe17fbda86236d91996ccce2511088442e7b04d84"} Sep 10 03:56:25.439016 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.438989 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:25.539203 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.539166 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-util\") pod \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " Sep 10 03:56:25.539405 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.539255 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spmjn\" (UniqueName: \"kubernetes.io/projected/01f807e1-fd2c-479b-b066-9fe8ad4547f9-kube-api-access-spmjn\") pod \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " Sep 10 03:56:25.539405 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.539317 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-bundle\") pod \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\" (UID: \"01f807e1-fd2c-479b-b066-9fe8ad4547f9\") " Sep 10 03:56:25.540159 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.540106 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-bundle" (OuterVolumeSpecName: "bundle") pod "01f807e1-fd2c-479b-b066-9fe8ad4547f9" (UID: "01f807e1-fd2c-479b-b066-9fe8ad4547f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:56:25.541474 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.541449 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f807e1-fd2c-479b-b066-9fe8ad4547f9-kube-api-access-spmjn" (OuterVolumeSpecName: "kube-api-access-spmjn") pod "01f807e1-fd2c-479b-b066-9fe8ad4547f9" (UID: "01f807e1-fd2c-479b-b066-9fe8ad4547f9"). InnerVolumeSpecName "kube-api-access-spmjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:56:25.544968 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.544933 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-util" (OuterVolumeSpecName: "util") pod "01f807e1-fd2c-479b-b066-9fe8ad4547f9" (UID: "01f807e1-fd2c-479b-b066-9fe8ad4547f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:56:25.640543 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.640504 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spmjn\" (UniqueName: \"kubernetes.io/projected/01f807e1-fd2c-479b-b066-9fe8ad4547f9-kube-api-access-spmjn\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:25.640543 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.640536 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-bundle\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:25.640543 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:25.640545 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01f807e1-fd2c-479b-b066-9fe8ad4547f9-util\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:26.319911 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:26.319878 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" Sep 10 03:56:26.320075 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:26.319867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm5d56" event={"ID":"01f807e1-fd2c-479b-b066-9fe8ad4547f9","Type":"ContainerDied","Data":"c0b963fe905ba3ec8eb2f057b8185f6adc87fe029bde97865f1e2687f03535af"} Sep 10 03:56:26.320075 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:26.319996 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0b963fe905ba3ec8eb2f057b8185f6adc87fe029bde97865f1e2687f03535af" Sep 10 03:56:31.731881 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.731844 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p"] Sep 10 03:56:31.732342 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.732221 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerName="util" Sep 10 03:56:31.732342 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.732234 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerName="util" Sep 10 03:56:31.732342 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.732249 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerName="pull" Sep 10 03:56:31.732342 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.732255 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerName="pull" Sep 10 03:56:31.732342 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.732262 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerName="extract" Sep 10 03:56:31.732342 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.732268 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerName="extract" Sep 10 03:56:31.732611 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.732351 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f807e1-fd2c-479b-b066-9fe8ad4547f9" containerName="extract" Sep 10 03:56:31.735372 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.735356 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.738117 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.738095 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:56:31.738211 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.738125 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vkpzf\"" Sep 10 03:56:31.738265 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.738205 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:56:31.743565 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.743541 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p"] Sep 10 03:56:31.889228 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.889179 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.889450 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.889239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.889450 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.889275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6rj7\" (UniqueName: \"kubernetes.io/projected/a43d7982-3035-49a9-8309-a5391ce0b80d-kube-api-access-s6rj7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.990693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.990602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.990693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.990656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6rj7\" (UniqueName: \"kubernetes.io/projected/a43d7982-3035-49a9-8309-a5391ce0b80d-kube-api-access-s6rj7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.990877 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.990774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.991099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.991076 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.991136 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.991088 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:31.998420 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:31.998398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6rj7\" (UniqueName: \"kubernetes.io/projected/a43d7982-3035-49a9-8309-a5391ce0b80d-kube-api-access-s6rj7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:32.045422 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:32.045385 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:32.319222 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:32.319193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p"] Sep 10 03:56:32.321364 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:32.321336 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43d7982_3035_49a9_8309_a5391ce0b80d.slice/crio-2e088404758d07641c5ffd3414f651fff3757e9ed681ed2b188dded143459a61 WatchSource:0}: Error finding container 2e088404758d07641c5ffd3414f651fff3757e9ed681ed2b188dded143459a61: Status 404 returned error can't find the container with id 2e088404758d07641c5ffd3414f651fff3757e9ed681ed2b188dded143459a61 Sep 10 03:56:32.348438 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:32.348409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" event={"ID":"a43d7982-3035-49a9-8309-a5391ce0b80d","Type":"ContainerStarted","Data":"2e088404758d07641c5ffd3414f651fff3757e9ed681ed2b188dded143459a61"} Sep 10 03:56:33.354638 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.354550 2581 generic.go:356] "Generic (PLEG): container finished" podID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerID="381e75ab9671fc4bee6634e1f03ec811eaebe1bfb4267fb414699a38cf4541c7" exitCode=0 Sep 10 03:56:33.354638 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.354621 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" event={"ID":"a43d7982-3035-49a9-8309-a5391ce0b80d","Type":"ContainerDied","Data":"381e75ab9671fc4bee6634e1f03ec811eaebe1bfb4267fb414699a38cf4541c7"} Sep 10 03:56:33.931557 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.931516 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp"] Sep 10 03:56:33.935766 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.935740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:33.937986 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.937967 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 03:56:33.939897 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.939876 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 03:56:33.941059 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.940920 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 03:56:33.941059 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.940934 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jgxxc\"" Sep 10 03:56:33.941297 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.941264 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 03:56:33.956077 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:33.956051 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp"] Sep 10 03:56:34.109461 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.109423 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96a19b26-034c-4782-9b8a-a8ca9e307554-apiservice-cert\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.109609 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.109471 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96a19b26-034c-4782-9b8a-a8ca9e307554-manifests\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.109609 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.109508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjqxx\" (UniqueName: \"kubernetes.io/projected/96a19b26-034c-4782-9b8a-a8ca9e307554-kube-api-access-jjqxx\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.109609 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.109573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96a19b26-034c-4782-9b8a-a8ca9e307554-webhook-cert\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.109609 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.109602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96a19b26-034c-4782-9b8a-a8ca9e307554-tmp\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.210385 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.210261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96a19b26-034c-4782-9b8a-a8ca9e307554-apiservice-cert\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.210563 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.210423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96a19b26-034c-4782-9b8a-a8ca9e307554-manifests\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.210563 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.210446 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqxx\" (UniqueName: \"kubernetes.io/projected/96a19b26-034c-4782-9b8a-a8ca9e307554-kube-api-access-jjqxx\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.210563 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.210523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96a19b26-034c-4782-9b8a-a8ca9e307554-webhook-cert\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.210563 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.210553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96a19b26-034c-4782-9b8a-a8ca9e307554-tmp\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.210926 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.210891 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/96a19b26-034c-4782-9b8a-a8ca9e307554-manifests\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.212750 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.212679 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96a19b26-034c-4782-9b8a-a8ca9e307554-tmp\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.212995 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.212943 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/96a19b26-034c-4782-9b8a-a8ca9e307554-webhook-cert\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.212995 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.212975 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/96a19b26-034c-4782-9b8a-a8ca9e307554-apiservice-cert\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.217807 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.217783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjqxx\" (UniqueName: \"kubernetes.io/projected/96a19b26-034c-4782-9b8a-a8ca9e307554-kube-api-access-jjqxx\") pod \"opendatahub-operator-controller-manager-797557847b-2gtzp\" (UID: \"96a19b26-034c-4782-9b8a-a8ca9e307554\") " pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.246940 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.246901 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:34.361367 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.361330 2581 generic.go:356] "Generic (PLEG): container finished" podID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerID="aa3833dd4a64d42cbe40e5463b4b6dfca4054ec8fb6b030983280af4e76cf208" exitCode=0 Sep 10 03:56:34.361746 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.361410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" event={"ID":"a43d7982-3035-49a9-8309-a5391ce0b80d","Type":"ContainerDied","Data":"aa3833dd4a64d42cbe40e5463b4b6dfca4054ec8fb6b030983280af4e76cf208"} Sep 10 03:56:34.532879 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:34.532853 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp"] Sep 10 03:56:34.566214 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:34.566171 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a19b26_034c_4782_9b8a_a8ca9e307554.slice/crio-381c03baca26969443e58f71f319b7f6d6ee7ff3556bdbd4e7a1e0af0fe8e6c8 WatchSource:0}: Error finding container 381c03baca26969443e58f71f319b7f6d6ee7ff3556bdbd4e7a1e0af0fe8e6c8: Status 404 returned error can't find the container with id 381c03baca26969443e58f71f319b7f6d6ee7ff3556bdbd4e7a1e0af0fe8e6c8 Sep 10 03:56:35.370735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:35.370696 2581 generic.go:356] "Generic (PLEG): container finished" podID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerID="8efab4125088ca4ba3df7c99882dae7f6f1b463622080667d06584fece22a58a" exitCode=0 Sep 10 03:56:35.371228 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:35.370791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" event={"ID":"a43d7982-3035-49a9-8309-a5391ce0b80d","Type":"ContainerDied","Data":"8efab4125088ca4ba3df7c99882dae7f6f1b463622080667d06584fece22a58a"} Sep 10 03:56:35.372453 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:35.372420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" event={"ID":"96a19b26-034c-4782-9b8a-a8ca9e307554","Type":"ContainerStarted","Data":"381c03baca26969443e58f71f319b7f6d6ee7ff3556bdbd4e7a1e0af0fe8e6c8"} Sep 10 03:56:36.627437 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.627187 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:36.735640 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.735607 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6rj7\" (UniqueName: \"kubernetes.io/projected/a43d7982-3035-49a9-8309-a5391ce0b80d-kube-api-access-s6rj7\") pod \"a43d7982-3035-49a9-8309-a5391ce0b80d\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " Sep 10 03:56:36.735843 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.735689 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-bundle\") pod \"a43d7982-3035-49a9-8309-a5391ce0b80d\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " Sep 10 03:56:36.735843 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.735721 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-util\") pod \"a43d7982-3035-49a9-8309-a5391ce0b80d\" (UID: \"a43d7982-3035-49a9-8309-a5391ce0b80d\") " Sep 10 03:56:36.736686 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.736647 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-bundle" (OuterVolumeSpecName: "bundle") pod "a43d7982-3035-49a9-8309-a5391ce0b80d" (UID: "a43d7982-3035-49a9-8309-a5391ce0b80d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:56:36.738186 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.738159 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43d7982-3035-49a9-8309-a5391ce0b80d-kube-api-access-s6rj7" (OuterVolumeSpecName: "kube-api-access-s6rj7") pod "a43d7982-3035-49a9-8309-a5391ce0b80d" (UID: "a43d7982-3035-49a9-8309-a5391ce0b80d"). InnerVolumeSpecName "kube-api-access-s6rj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:56:36.742414 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.742389 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-util" (OuterVolumeSpecName: "util") pod "a43d7982-3035-49a9-8309-a5391ce0b80d" (UID: "a43d7982-3035-49a9-8309-a5391ce0b80d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:56:36.837215 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.837180 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-bundle\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:36.837215 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.837211 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a43d7982-3035-49a9-8309-a5391ce0b80d-util\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:36.837215 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:36.837221 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6rj7\" (UniqueName: \"kubernetes.io/projected/a43d7982-3035-49a9-8309-a5391ce0b80d-kube-api-access-s6rj7\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:56:37.385813 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:37.385759 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" event={"ID":"a43d7982-3035-49a9-8309-a5391ce0b80d","Type":"ContainerDied","Data":"2e088404758d07641c5ffd3414f651fff3757e9ed681ed2b188dded143459a61"} Sep 10 03:56:37.385963 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:37.385783 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07544p" Sep 10 03:56:37.385963 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:37.385873 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e088404758d07641c5ffd3414f651fff3757e9ed681ed2b188dded143459a61" Sep 10 03:56:38.394798 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:38.394763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" event={"ID":"96a19b26-034c-4782-9b8a-a8ca9e307554","Type":"ContainerStarted","Data":"264b7eb709a38befaff7d8d66fbb404d08bec5d2b7ec971cab49f42fb73c44ea"} Sep 10 03:56:39.403326 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:39.403273 2581 generic.go:356] "Generic (PLEG): container finished" podID="96a19b26-034c-4782-9b8a-a8ca9e307554" containerID="264b7eb709a38befaff7d8d66fbb404d08bec5d2b7ec971cab49f42fb73c44ea" exitCode=0 Sep 10 03:56:39.403326 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:39.403312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" event={"ID":"96a19b26-034c-4782-9b8a-a8ca9e307554","Type":"ContainerDied","Data":"264b7eb709a38befaff7d8d66fbb404d08bec5d2b7ec971cab49f42fb73c44ea"} Sep 10 03:56:40.416182 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:40.416150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" event={"ID":"96a19b26-034c-4782-9b8a-a8ca9e307554","Type":"ContainerStarted","Data":"70e0de65207adcc20a8f01f3b6e928530c5a381784010f435e19c649290779de"} Sep 10 03:56:40.416603 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:40.416204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:40.436353 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:40.436304 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" podStartSLOduration=2.971715735 podStartE2EDuration="7.436274657s" totalImagesPullingTime="3.412990299s" totalInitContainerRuntime="1.051568623s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:56:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:56:40.434213937 +0000 UTC m=+514.520958500" watchObservedRunningTime="2026-09-10 03:56:40.436274657 +0000 UTC m=+514.523019220" Sep 10 03:56:51.418390 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:51.418356 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-797557847b-2gtzp" Sep 10 03:56:53.685976 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.685940 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm"] Sep 10 03:56:53.686360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.686298 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerName="util" Sep 10 03:56:53.686360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.686315 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerName="util" Sep 10 03:56:53.686360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.686328 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerName="extract" Sep 10 03:56:53.686360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.686336 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerName="extract" Sep 10 03:56:53.686360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.686357 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerName="pull" Sep 10 03:56:53.686551 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.686365 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerName="pull" Sep 10 03:56:53.686551 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.686429 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a43d7982-3035-49a9-8309-a5391ce0b80d" containerName="extract" Sep 10 03:56:53.695999 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.695976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.699496 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.699472 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 03:56:53.699742 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.699726 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 03:56:53.717368 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.717341 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm"] Sep 10 03:56:53.784656 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.784618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f105076-6819-47c5-a53d-bef1ab04af07-tls-certs\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.784845 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.784671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f105076-6819-47c5-a53d-bef1ab04af07-tmp\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.784845 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.784749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dfcd\" (UniqueName: \"kubernetes.io/projected/9f105076-6819-47c5-a53d-bef1ab04af07-kube-api-access-9dfcd\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.885883 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.885847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f105076-6819-47c5-a53d-bef1ab04af07-tls-certs\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.885883 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.885885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f105076-6819-47c5-a53d-bef1ab04af07-tmp\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.886127 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.885919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dfcd\" (UniqueName: \"kubernetes.io/projected/9f105076-6819-47c5-a53d-bef1ab04af07-kube-api-access-9dfcd\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.888249 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.888226 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f105076-6819-47c5-a53d-bef1ab04af07-tmp\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.888519 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.888498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f105076-6819-47c5-a53d-bef1ab04af07-tls-certs\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:53.893679 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:53.893656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dfcd\" (UniqueName: \"kubernetes.io/projected/9f105076-6819-47c5-a53d-bef1ab04af07-kube-api-access-9dfcd\") pod \"kube-auth-proxy-5dcb5c9454-2plsm\" (UID: \"9f105076-6819-47c5-a53d-bef1ab04af07\") " pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:54.006197 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.006100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" Sep 10 03:56:54.278423 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.278328 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm"] Sep 10 03:56:54.281788 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:54.281749 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f105076_6819_47c5_a53d_bef1ab04af07.slice/crio-3037e8208304fdf6174bf5ec1ed28bda0d4b1c47d7b5be1105e27e582364cd22 WatchSource:0}: Error finding container 3037e8208304fdf6174bf5ec1ed28bda0d4b1c47d7b5be1105e27e582364cd22: Status 404 returned error can't find the container with id 3037e8208304fdf6174bf5ec1ed28bda0d4b1c47d7b5be1105e27e582364cd22 Sep 10 03:56:54.479567 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.479530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" event={"ID":"9f105076-6819-47c5-a53d-bef1ab04af07","Type":"ContainerStarted","Data":"3037e8208304fdf6174bf5ec1ed28bda0d4b1c47d7b5be1105e27e582364cd22"} Sep 10 03:56:54.848460 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.848428 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb"] Sep 10 03:56:54.853730 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.853711 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.856244 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.856214 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 03:56:54.856393 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.856348 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vds9h\"" Sep 10 03:56:54.856393 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.856349 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 03:56:54.856521 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.856390 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 03:56:54.856521 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.856222 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 03:56:54.864444 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.864419 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb"] Sep 10 03:56:54.894625 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.894584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.894895 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.894875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.895024 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.895005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.895152 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.895136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.895353 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.895336 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.895511 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.895495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b4083a2-11ee-4aa0-84bc-1fe614d74959-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.895607 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.895593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl7bw\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-kube-api-access-rl7bw\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.996996 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.996730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.996996 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.996830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.996996 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.996886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b4083a2-11ee-4aa0-84bc-1fe614d74959-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.996996 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.996911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl7bw\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-kube-api-access-rl7bw\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.996996 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.996942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.996996 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.996975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.996996 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.997001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:54.998045 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:54.997996 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:55.001377 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.001214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:55.003682 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.002510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:55.003682 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.003431 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b4083a2-11ee-4aa0-84bc-1fe614d74959-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:55.005940 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.005892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:55.006251 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.006227 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl7bw\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-kube-api-access-rl7bw\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:55.006393 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.006381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w66vb\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:55.167459 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.167418 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:55.464362 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.464328 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb"] Sep 10 03:56:55.467217 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:56:55.467190 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4083a2_11ee_4aa0_84bc_1fe614d74959.slice/crio-e883f00d50b876f54c0ceadba753f1ddf48aa5e2a23c4ac6d6b8505c424dc30e WatchSource:0}: Error finding container e883f00d50b876f54c0ceadba753f1ddf48aa5e2a23c4ac6d6b8505c424dc30e: Status 404 returned error can't find the container with id e883f00d50b876f54c0ceadba753f1ddf48aa5e2a23c4ac6d6b8505c424dc30e Sep 10 03:56:55.488255 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:55.488204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" event={"ID":"4b4083a2-11ee-4aa0-84bc-1fe614d74959","Type":"ContainerStarted","Data":"e883f00d50b876f54c0ceadba753f1ddf48aa5e2a23c4ac6d6b8505c424dc30e"} Sep 10 03:56:57.510200 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:57.510072 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" event={"ID":"9f105076-6819-47c5-a53d-bef1ab04af07","Type":"ContainerStarted","Data":"19af515cd8416d8edf30925b2d04425d48acb113ebf67a1420c750a018635825"} Sep 10 03:56:57.528399 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:57.528259 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dcb5c9454-2plsm" podStartSLOduration=1.601751405 podStartE2EDuration="4.528236938s" totalImagesPullingTime="2.926485533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:56:57.525330342 +0000 UTC m=+531.612074906" watchObservedRunningTime="2026-09-10 03:56:57.528236938 +0000 UTC m=+531.614981502" Sep 10 03:56:58.986506 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:58.986458 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:56:58.986764 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:58.986537 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 03:56:59.523312 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:59.523262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" event={"ID":"4b4083a2-11ee-4aa0-84bc-1fe614d74959","Type":"ContainerStarted","Data":"472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1"} Sep 10 03:56:59.523516 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:59.523406 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:56:59.542886 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:56:59.542831 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" podStartSLOduration=2.026633133 podStartE2EDuration="5.542814761s" totalImagesPullingTime="3.516181628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:56:59.541422136 +0000 UTC m=+533.628166700" watchObservedRunningTime="2026-09-10 03:56:59.542814761 +0000 UTC m=+533.629559324" Sep 10 03:57:00.531102 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:00.531073 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:57:13.513872 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.513836 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-64z86"] Sep 10 03:57:13.525459 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.525425 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr"] Sep 10 03:57:13.525642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.525535 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:13.528110 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.528084 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vsx5b\"" Sep 10 03:57:13.528454 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.528437 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 10 03:57:13.529884 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.529843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:13.530348 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.530326 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-64z86"] Sep 10 03:57:13.531935 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.531914 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 10 03:57:13.532759 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.532497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dml7s\"" Sep 10 03:57:13.536360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.536338 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr"] Sep 10 03:57:13.673975 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.673938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqdzd\" (UniqueName: \"kubernetes.io/projected/de808e0a-5250-4082-8ead-9c32b05341ce-kube-api-access-rqdzd\") pod \"llmisvc-controller-manager-777c6bd7d5-z2psr\" (UID: \"de808e0a-5250-4082-8ead-9c32b05341ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:13.674174 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.673980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de808e0a-5250-4082-8ead-9c32b05341ce-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z2psr\" (UID: \"de808e0a-5250-4082-8ead-9c32b05341ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:13.674174 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.674014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz9ch\" (UniqueName: \"kubernetes.io/projected/5c93f3ad-f956-4630-ab3f-224a6feb7d92-kube-api-access-qz9ch\") pod \"kserve-controller-manager-d6f4b65b8-64z86\" (UID: \"5c93f3ad-f956-4630-ab3f-224a6feb7d92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:13.674174 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.674089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c93f3ad-f956-4630-ab3f-224a6feb7d92-cert\") pod \"kserve-controller-manager-d6f4b65b8-64z86\" (UID: \"5c93f3ad-f956-4630-ab3f-224a6feb7d92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:13.775644 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.775557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c93f3ad-f956-4630-ab3f-224a6feb7d92-cert\") pod \"kserve-controller-manager-d6f4b65b8-64z86\" (UID: \"5c93f3ad-f956-4630-ab3f-224a6feb7d92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:13.775644 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.775631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqdzd\" (UniqueName: \"kubernetes.io/projected/de808e0a-5250-4082-8ead-9c32b05341ce-kube-api-access-rqdzd\") pod \"llmisvc-controller-manager-777c6bd7d5-z2psr\" (UID: \"de808e0a-5250-4082-8ead-9c32b05341ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:13.775834 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.775654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de808e0a-5250-4082-8ead-9c32b05341ce-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z2psr\" (UID: \"de808e0a-5250-4082-8ead-9c32b05341ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:13.775834 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.775671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz9ch\" (UniqueName: \"kubernetes.io/projected/5c93f3ad-f956-4630-ab3f-224a6feb7d92-kube-api-access-qz9ch\") pod \"kserve-controller-manager-d6f4b65b8-64z86\" (UID: \"5c93f3ad-f956-4630-ab3f-224a6feb7d92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:13.778051 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.778020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de808e0a-5250-4082-8ead-9c32b05341ce-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z2psr\" (UID: \"de808e0a-5250-4082-8ead-9c32b05341ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:13.778165 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.778020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c93f3ad-f956-4630-ab3f-224a6feb7d92-cert\") pod \"kserve-controller-manager-d6f4b65b8-64z86\" (UID: \"5c93f3ad-f956-4630-ab3f-224a6feb7d92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:13.792625 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.792597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqdzd\" (UniqueName: \"kubernetes.io/projected/de808e0a-5250-4082-8ead-9c32b05341ce-kube-api-access-rqdzd\") pod \"llmisvc-controller-manager-777c6bd7d5-z2psr\" (UID: \"de808e0a-5250-4082-8ead-9c32b05341ce\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:13.796792 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.796771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz9ch\" (UniqueName: \"kubernetes.io/projected/5c93f3ad-f956-4630-ab3f-224a6feb7d92-kube-api-access-qz9ch\") pod \"kserve-controller-manager-d6f4b65b8-64z86\" (UID: \"5c93f3ad-f956-4630-ab3f-224a6feb7d92\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:13.842909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.842873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:13.854301 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:13.854217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:14.124747 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:14.124721 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-64z86"] Sep 10 03:57:14.126802 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:57:14.126775 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c93f3ad_f956_4630_ab3f_224a6feb7d92.slice/crio-aa87bb03eec9dd8f8f56c5444d3bda5ab36367958ce01e4df80c1a6671ff81d3 WatchSource:0}: Error finding container aa87bb03eec9dd8f8f56c5444d3bda5ab36367958ce01e4df80c1a6671ff81d3: Status 404 returned error can't find the container with id aa87bb03eec9dd8f8f56c5444d3bda5ab36367958ce01e4df80c1a6671ff81d3 Sep 10 03:57:14.156237 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:14.156210 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr"] Sep 10 03:57:14.157920 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:57:14.157892 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde808e0a_5250_4082_8ead_9c32b05341ce.slice/crio-8f39a7c49193a5a9ccd13dcf5a33a7e12ffbcfaab26f518054086454ab31bfbe WatchSource:0}: Error finding container 8f39a7c49193a5a9ccd13dcf5a33a7e12ffbcfaab26f518054086454ab31bfbe: Status 404 returned error can't find the container with id 8f39a7c49193a5a9ccd13dcf5a33a7e12ffbcfaab26f518054086454ab31bfbe Sep 10 03:57:14.607187 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:14.607155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" event={"ID":"5c93f3ad-f956-4630-ab3f-224a6feb7d92","Type":"ContainerStarted","Data":"aa87bb03eec9dd8f8f56c5444d3bda5ab36367958ce01e4df80c1a6671ff81d3"} Sep 10 03:57:14.608360 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:14.608335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" event={"ID":"de808e0a-5250-4082-8ead-9c32b05341ce","Type":"ContainerStarted","Data":"8f39a7c49193a5a9ccd13dcf5a33a7e12ffbcfaab26f518054086454ab31bfbe"} Sep 10 03:57:17.643118 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:17.643081 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" event={"ID":"de808e0a-5250-4082-8ead-9c32b05341ce","Type":"ContainerStarted","Data":"e782133f53e8b3a181a333275d98fef1350f5b4a7b1d3a2536f56bc79c98215d"} Sep 10 03:57:17.643598 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:17.643150 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:17.644679 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:17.644644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" event={"ID":"5c93f3ad-f956-4630-ab3f-224a6feb7d92","Type":"ContainerStarted","Data":"421ddb1807979df9ad4381410deba07d997eff4432030723734ded7e9bdfe590"} Sep 10 03:57:17.644788 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:17.644706 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:57:17.659735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:17.659642 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" podStartSLOduration=1.412767937 podStartE2EDuration="4.659626198s" totalImagesPullingTime="3.246858261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:57:17.658304224 +0000 UTC m=+551.745048778" watchObservedRunningTime="2026-09-10 03:57:17.659626198 +0000 UTC m=+551.746370776" Sep 10 03:57:17.674627 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:17.674577 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" podStartSLOduration=1.401071369 podStartE2EDuration="4.674560415s" totalImagesPullingTime="3.273489046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:57:17.673714615 +0000 UTC m=+551.760459178" watchObservedRunningTime="2026-09-10 03:57:17.674560415 +0000 UTC m=+551.761304977" Sep 10 03:57:17.852542 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:17.852499 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb"] Sep 10 03:57:17.852744 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:17.852721 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" podUID="4b4083a2-11ee-4aa0-84bc-1fe614d74959" containerName="discovery" containerID="cri-o://472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1" gracePeriod=30 Sep 10 03:57:18.108252 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.108224 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:57:18.219245 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.219164 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-token\") pod \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " Sep 10 03:57:18.219245 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.219220 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-ca-configmap\") pod \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " Sep 10 03:57:18.219494 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.219248 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-kubeconfig\") pod \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " Sep 10 03:57:18.219494 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.219314 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-cacerts\") pod \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " Sep 10 03:57:18.219494 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.219339 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-dns-cert\") pod \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " Sep 10 03:57:18.219494 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.219377 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b4083a2-11ee-4aa0-84bc-1fe614d74959-local-certs\") pod \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " Sep 10 03:57:18.219494 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.219407 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl7bw\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-kube-api-access-rl7bw\") pod \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\" (UID: \"4b4083a2-11ee-4aa0-84bc-1fe614d74959\") " Sep 10 03:57:18.219979 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.219933 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4b4083a2-11ee-4aa0-84bc-1fe614d74959" (UID: "4b4083a2-11ee-4aa0-84bc-1fe614d74959"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:57:18.221744 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.221717 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-cacerts" (OuterVolumeSpecName: "cacerts") pod "4b4083a2-11ee-4aa0-84bc-1fe614d74959" (UID: "4b4083a2-11ee-4aa0-84bc-1fe614d74959"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:57:18.222053 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.221982 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4083a2-11ee-4aa0-84bc-1fe614d74959-local-certs" (OuterVolumeSpecName: "local-certs") pod "4b4083a2-11ee-4aa0-84bc-1fe614d74959" (UID: "4b4083a2-11ee-4aa0-84bc-1fe614d74959"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:57:18.222135 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.222073 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b4083a2-11ee-4aa0-84bc-1fe614d74959" (UID: "4b4083a2-11ee-4aa0-84bc-1fe614d74959"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:57:18.222135 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.222088 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-kube-api-access-rl7bw" (OuterVolumeSpecName: "kube-api-access-rl7bw") pod "4b4083a2-11ee-4aa0-84bc-1fe614d74959" (UID: "4b4083a2-11ee-4aa0-84bc-1fe614d74959"). InnerVolumeSpecName "kube-api-access-rl7bw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:57:18.222135 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.222096 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4b4083a2-11ee-4aa0-84bc-1fe614d74959" (UID: "4b4083a2-11ee-4aa0-84bc-1fe614d74959"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:57:18.222135 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.222078 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4b4083a2-11ee-4aa0-84bc-1fe614d74959" (UID: "4b4083a2-11ee-4aa0-84bc-1fe614d74959"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:57:18.321020 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.320988 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-ca-configmap\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:57:18.321020 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.321014 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-kubeconfig\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:57:18.321020 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.321025 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-cacerts\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:57:18.321231 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.321033 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-csr-dns-cert\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:57:18.321231 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.321042 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b4083a2-11ee-4aa0-84bc-1fe614d74959-local-certs\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:57:18.321231 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.321050 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl7bw\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-kube-api-access-rl7bw\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:57:18.321231 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.321058 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b4083a2-11ee-4aa0-84bc-1fe614d74959-istio-token\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:57:18.651880 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.651846 2581 generic.go:356] "Generic (PLEG): container finished" podID="4b4083a2-11ee-4aa0-84bc-1fe614d74959" containerID="472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1" exitCode=0 Sep 10 03:57:18.652353 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.651907 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" Sep 10 03:57:18.652353 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.651941 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" event={"ID":"4b4083a2-11ee-4aa0-84bc-1fe614d74959","Type":"ContainerDied","Data":"472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1"} Sep 10 03:57:18.652353 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.652007 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb" event={"ID":"4b4083a2-11ee-4aa0-84bc-1fe614d74959","Type":"ContainerDied","Data":"e883f00d50b876f54c0ceadba753f1ddf48aa5e2a23c4ac6d6b8505c424dc30e"} Sep 10 03:57:18.652353 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.652047 2581 scope.go:117] "RemoveContainer" containerID="472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1" Sep 10 03:57:18.661032 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.661014 2581 scope.go:117] "RemoveContainer" containerID="472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1" Sep 10 03:57:18.661308 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:57:18.661269 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1\": container with ID starting with 472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1 not found: ID does not exist" containerID="472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1" Sep 10 03:57:18.661356 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.661320 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1"} err="failed to get container status \"472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1\": rpc error: code = NotFound desc = could not find container \"472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1\": container with ID starting with 472850c4068d0365e50c02a256fa68c684ad31f873f4bff40912c963fc844fe1 not found: ID does not exist" Sep 10 03:57:18.670699 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.670676 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb"] Sep 10 03:57:18.674386 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:18.674365 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w66vb"] Sep 10 03:57:20.416440 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:20.416404 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4083a2-11ee-4aa0-84bc-1fe614d74959" path="/var/lib/kubelet/pods/4b4083a2-11ee-4aa0-84bc-1fe614d74959/volumes" Sep 10 03:57:48.654029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:48.653994 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z2psr" Sep 10 03:57:48.657272 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:57:48.657252 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-64z86" Sep 10 03:58:10.726113 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.726074 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt"] Sep 10 03:58:10.728372 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.726609 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4083a2-11ee-4aa0-84bc-1fe614d74959" containerName="discovery" Sep 10 03:58:10.728372 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.726624 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4083a2-11ee-4aa0-84bc-1fe614d74959" containerName="discovery" Sep 10 03:58:10.728372 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.726702 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b4083a2-11ee-4aa0-84bc-1fe614d74959" containerName="discovery" Sep 10 03:58:10.729556 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.729541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.731931 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.731910 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 03:58:10.732713 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.732696 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vkpzf\"" Sep 10 03:58:10.732763 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.732704 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 03:58:10.737295 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.737248 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt"] Sep 10 03:58:10.821446 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.821413 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k"] Sep 10 03:58:10.824958 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.824941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:10.832454 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.832425 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k"] Sep 10 03:58:10.877747 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.877714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.877909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.877761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8dpv\" (UniqueName: \"kubernetes.io/projected/6c8b9789-f40f-469d-a045-f94242ebde27-kube-api-access-j8dpv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.877909 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.877785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.923957 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.923929 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw"] Sep 10 03:58:10.927484 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.927467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:10.935247 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.935226 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw"] Sep 10 03:58:10.978677 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.978592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:10.978677 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.978652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.978845 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.978709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:10.978845 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.978746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmzfn\" (UniqueName: \"kubernetes.io/projected/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-kube-api-access-bmzfn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:10.978845 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.978778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8dpv\" (UniqueName: \"kubernetes.io/projected/6c8b9789-f40f-469d-a045-f94242ebde27-kube-api-access-j8dpv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.978845 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.978833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.978974 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.978933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.979139 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.979121 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:10.987564 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:10.987535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8dpv\" (UniqueName: \"kubernetes.io/projected/6c8b9789-f40f-469d-a045-f94242ebde27-kube-api-access-j8dpv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:11.025771 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.025742 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2"] Sep 10 03:58:11.029623 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.029606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.039476 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.039449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:11.039760 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.039741 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2"] Sep 10 03:58:11.079424 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.079371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:11.079621 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.079447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.079621 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.079497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqrr\" (UniqueName: \"kubernetes.io/projected/199bd425-a7f0-484d-bc2d-4ad64f94fca0-kube-api-access-grqrr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.079621 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.079527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:11.079621 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.079553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmzfn\" (UniqueName: \"kubernetes.io/projected/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-kube-api-access-bmzfn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:11.079837 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.079648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.080271 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.080149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:11.080271 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.080229 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:11.089239 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.089203 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmzfn\" (UniqueName: \"kubernetes.io/projected/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-kube-api-access-bmzfn\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:11.134871 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.134842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:11.180341 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.180305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.180341 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.180342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.180578 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.180366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk7hf\" (UniqueName: \"kubernetes.io/projected/6420943d-b33f-4c6f-b31c-f280893693d0-kube-api-access-dk7hf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.180578 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.180473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.180578 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.180528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.180578 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.180563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqrr\" (UniqueName: \"kubernetes.io/projected/199bd425-a7f0-484d-bc2d-4ad64f94fca0-kube-api-access-grqrr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.180777 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.180739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.181059 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.181039 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.189872 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.189845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqrr\" (UniqueName: \"kubernetes.io/projected/199bd425-a7f0-484d-bc2d-4ad64f94fca0-kube-api-access-grqrr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.237852 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.237766 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:11.281371 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.281332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.281546 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.281392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk7hf\" (UniqueName: \"kubernetes.io/projected/6420943d-b33f-4c6f-b31c-f280893693d0-kube-api-access-dk7hf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.281546 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.281482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.281706 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.281684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.281828 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.281809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.290602 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.290576 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk7hf\" (UniqueName: \"kubernetes.io/projected/6420943d-b33f-4c6f-b31c-f280893693d0-kube-api-access-dk7hf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.316271 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.316183 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt"] Sep 10 03:58:11.318808 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:11.318763 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8b9789_f40f_469d_a045_f94242ebde27.slice/crio-111b2d6e525b3351c378682585c9c7248ab00631576a18dd945b27cce2a9379d WatchSource:0}: Error finding container 111b2d6e525b3351c378682585c9c7248ab00631576a18dd945b27cce2a9379d: Status 404 returned error can't find the container with id 111b2d6e525b3351c378682585c9c7248ab00631576a18dd945b27cce2a9379d Sep 10 03:58:11.340023 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.339996 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:11.409239 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.409202 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k"] Sep 10 03:58:11.412321 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:11.412271 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c375bde_4d09_41ed_b4de_bb7fe9e7ba51.slice/crio-7dfa5f0ba129211fcd47ff9399b7a1212ec1562adf0942b3a14e3cd6fce5b7bb WatchSource:0}: Error finding container 7dfa5f0ba129211fcd47ff9399b7a1212ec1562adf0942b3a14e3cd6fce5b7bb: Status 404 returned error can't find the container with id 7dfa5f0ba129211fcd47ff9399b7a1212ec1562adf0942b3a14e3cd6fce5b7bb Sep 10 03:58:11.509695 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.509669 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw"] Sep 10 03:58:11.512442 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:11.512414 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199bd425_a7f0_484d_bc2d_4ad64f94fca0.slice/crio-c504b8ae7410a9190936bbb90611524e42788b4d3951de60b6c9549d510f104e WatchSource:0}: Error finding container c504b8ae7410a9190936bbb90611524e42788b4d3951de60b6c9549d510f104e: Status 404 returned error can't find the container with id c504b8ae7410a9190936bbb90611524e42788b4d3951de60b6c9549d510f104e Sep 10 03:58:11.613571 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.613444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2"] Sep 10 03:58:11.620703 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:11.620673 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6420943d_b33f_4c6f_b31c_f280893693d0.slice/crio-38b855e72ca78b4f630d1c82ade666af2b7f4f3b2950e3aaaae02ab28b241420 WatchSource:0}: Error finding container 38b855e72ca78b4f630d1c82ade666af2b7f4f3b2950e3aaaae02ab28b241420: Status 404 returned error can't find the container with id 38b855e72ca78b4f630d1c82ade666af2b7f4f3b2950e3aaaae02ab28b241420 Sep 10 03:58:11.936632 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.936600 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerID="3027371892e192510b5b3424541809748f7289edd908ccc3ce4b98e26e615526" exitCode=0 Sep 10 03:58:11.937025 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.936706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" event={"ID":"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51","Type":"ContainerDied","Data":"3027371892e192510b5b3424541809748f7289edd908ccc3ce4b98e26e615526"} Sep 10 03:58:11.937025 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.936793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" event={"ID":"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51","Type":"ContainerStarted","Data":"7dfa5f0ba129211fcd47ff9399b7a1212ec1562adf0942b3a14e3cd6fce5b7bb"} Sep 10 03:58:11.937784 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.937765 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:58:11.938362 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.938339 2581 generic.go:356] "Generic (PLEG): container finished" podID="6420943d-b33f-4c6f-b31c-f280893693d0" containerID="b774cc1a1c6341b5363b5c5fc8ac0744eca9813e82c57ba001b306aaa14140ee" exitCode=0 Sep 10 03:58:11.938446 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.938423 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" event={"ID":"6420943d-b33f-4c6f-b31c-f280893693d0","Type":"ContainerDied","Data":"b774cc1a1c6341b5363b5c5fc8ac0744eca9813e82c57ba001b306aaa14140ee"} Sep 10 03:58:11.938541 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.938482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" event={"ID":"6420943d-b33f-4c6f-b31c-f280893693d0","Type":"ContainerStarted","Data":"38b855e72ca78b4f630d1c82ade666af2b7f4f3b2950e3aaaae02ab28b241420"} Sep 10 03:58:11.940100 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.940075 2581 generic.go:356] "Generic (PLEG): container finished" podID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerID="c969af9f4b83bbf10d3f83b57ecfc525fa01ee3196b25d897a30d175f41a3cd7" exitCode=0 Sep 10 03:58:11.940182 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.940155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" event={"ID":"199bd425-a7f0-484d-bc2d-4ad64f94fca0","Type":"ContainerDied","Data":"c969af9f4b83bbf10d3f83b57ecfc525fa01ee3196b25d897a30d175f41a3cd7"} Sep 10 03:58:11.940250 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.940200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" event={"ID":"199bd425-a7f0-484d-bc2d-4ad64f94fca0","Type":"ContainerStarted","Data":"c504b8ae7410a9190936bbb90611524e42788b4d3951de60b6c9549d510f104e"} Sep 10 03:58:11.944752 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.943661 2581 generic.go:356] "Generic (PLEG): container finished" podID="6c8b9789-f40f-469d-a045-f94242ebde27" containerID="6ac8a941869d0b4efb72a061898c0ee6adc5840bb656fa99f12c54a6a4f5e00a" exitCode=0 Sep 10 03:58:11.944752 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.943692 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" event={"ID":"6c8b9789-f40f-469d-a045-f94242ebde27","Type":"ContainerDied","Data":"6ac8a941869d0b4efb72a061898c0ee6adc5840bb656fa99f12c54a6a4f5e00a"} Sep 10 03:58:11.944752 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:11.943728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" event={"ID":"6c8b9789-f40f-469d-a045-f94242ebde27","Type":"ContainerStarted","Data":"111b2d6e525b3351c378682585c9c7248ab00631576a18dd945b27cce2a9379d"} Sep 10 03:58:12.950164 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:12.950133 2581 generic.go:356] "Generic (PLEG): container finished" podID="6420943d-b33f-4c6f-b31c-f280893693d0" containerID="249a3bf34a342d8c9272eef9914def705efed9687395cf72bb61c2fc8dc63e88" exitCode=0 Sep 10 03:58:12.950641 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:12.950206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" event={"ID":"6420943d-b33f-4c6f-b31c-f280893693d0","Type":"ContainerDied","Data":"249a3bf34a342d8c9272eef9914def705efed9687395cf72bb61c2fc8dc63e88"} Sep 10 03:58:12.952226 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:12.952205 2581 generic.go:356] "Generic (PLEG): container finished" podID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerID="d7c014f3703d8967bdfa3a1761a1181cbdbc8b6a22444368f9cda73f1d9534f2" exitCode=0 Sep 10 03:58:12.952341 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:12.952312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" event={"ID":"199bd425-a7f0-484d-bc2d-4ad64f94fca0","Type":"ContainerDied","Data":"d7c014f3703d8967bdfa3a1761a1181cbdbc8b6a22444368f9cda73f1d9534f2"} Sep 10 03:58:12.954405 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:12.954387 2581 generic.go:356] "Generic (PLEG): container finished" podID="6c8b9789-f40f-469d-a045-f94242ebde27" containerID="c547b6354ac7661557973cbf9286fd3502fd037dd16d8d87061a528cc6dac1a6" exitCode=0 Sep 10 03:58:12.954497 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:12.954476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" event={"ID":"6c8b9789-f40f-469d-a045-f94242ebde27","Type":"ContainerDied","Data":"c547b6354ac7661557973cbf9286fd3502fd037dd16d8d87061a528cc6dac1a6"} Sep 10 03:58:13.961744 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:13.961708 2581 generic.go:356] "Generic (PLEG): container finished" podID="6420943d-b33f-4c6f-b31c-f280893693d0" containerID="d5f3460aab67bb738825a6f0034667d427b56e013a48e2ad14797f70c7f78002" exitCode=0 Sep 10 03:58:13.962164 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:13.961788 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" event={"ID":"6420943d-b33f-4c6f-b31c-f280893693d0","Type":"ContainerDied","Data":"d5f3460aab67bb738825a6f0034667d427b56e013a48e2ad14797f70c7f78002"} Sep 10 03:58:13.963742 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:13.963719 2581 generic.go:356] "Generic (PLEG): container finished" podID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerID="90688a297dfca9a639ef3a6d9c782ea47d11787748c86cdab809b9f7d6abcd29" exitCode=0 Sep 10 03:58:13.963831 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:13.963795 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" event={"ID":"199bd425-a7f0-484d-bc2d-4ad64f94fca0","Type":"ContainerDied","Data":"90688a297dfca9a639ef3a6d9c782ea47d11787748c86cdab809b9f7d6abcd29"} Sep 10 03:58:13.965867 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:13.965846 2581 generic.go:356] "Generic (PLEG): container finished" podID="6c8b9789-f40f-469d-a045-f94242ebde27" containerID="fe21c5be3faed388c6af27412c4f0de38eaa2dcd5c5a1ef63c51184ab22c89f0" exitCode=0 Sep 10 03:58:13.965974 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:13.965872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" event={"ID":"6c8b9789-f40f-469d-a045-f94242ebde27","Type":"ContainerDied","Data":"fe21c5be3faed388c6af27412c4f0de38eaa2dcd5c5a1ef63c51184ab22c89f0"} Sep 10 03:58:15.130395 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.130364 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:15.164983 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.164953 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:15.168128 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.168070 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:15.220403 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.220363 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-util\") pod \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " Sep 10 03:58:15.220588 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.220407 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grqrr\" (UniqueName: \"kubernetes.io/projected/199bd425-a7f0-484d-bc2d-4ad64f94fca0-kube-api-access-grqrr\") pod \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " Sep 10 03:58:15.220588 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.220534 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-bundle\") pod \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\" (UID: \"199bd425-a7f0-484d-bc2d-4ad64f94fca0\") " Sep 10 03:58:15.221031 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.221000 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-bundle" (OuterVolumeSpecName: "bundle") pod "199bd425-a7f0-484d-bc2d-4ad64f94fca0" (UID: "199bd425-a7f0-484d-bc2d-4ad64f94fca0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:15.222527 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.222469 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199bd425-a7f0-484d-bc2d-4ad64f94fca0-kube-api-access-grqrr" (OuterVolumeSpecName: "kube-api-access-grqrr") pod "199bd425-a7f0-484d-bc2d-4ad64f94fca0" (UID: "199bd425-a7f0-484d-bc2d-4ad64f94fca0"). InnerVolumeSpecName "kube-api-access-grqrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:58:15.225893 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.225873 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-util" (OuterVolumeSpecName: "util") pod "199bd425-a7f0-484d-bc2d-4ad64f94fca0" (UID: "199bd425-a7f0-484d-bc2d-4ad64f94fca0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:15.321429 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321394 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-util\") pod \"6420943d-b33f-4c6f-b31c-f280893693d0\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " Sep 10 03:58:15.321429 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321432 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-bundle\") pod \"6420943d-b33f-4c6f-b31c-f280893693d0\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " Sep 10 03:58:15.321642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321463 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8dpv\" (UniqueName: \"kubernetes.io/projected/6c8b9789-f40f-469d-a045-f94242ebde27-kube-api-access-j8dpv\") pod \"6c8b9789-f40f-469d-a045-f94242ebde27\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " Sep 10 03:58:15.321642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321499 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-util\") pod \"6c8b9789-f40f-469d-a045-f94242ebde27\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " Sep 10 03:58:15.321642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321514 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-bundle\") pod \"6c8b9789-f40f-469d-a045-f94242ebde27\" (UID: \"6c8b9789-f40f-469d-a045-f94242ebde27\") " Sep 10 03:58:15.321642 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321547 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk7hf\" (UniqueName: \"kubernetes.io/projected/6420943d-b33f-4c6f-b31c-f280893693d0-kube-api-access-dk7hf\") pod \"6420943d-b33f-4c6f-b31c-f280893693d0\" (UID: \"6420943d-b33f-4c6f-b31c-f280893693d0\") " Sep 10 03:58:15.321887 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321870 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-bundle\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.321942 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321893 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/199bd425-a7f0-484d-bc2d-4ad64f94fca0-util\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.321942 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.321906 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grqrr\" (UniqueName: \"kubernetes.io/projected/199bd425-a7f0-484d-bc2d-4ad64f94fca0-kube-api-access-grqrr\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.322172 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.322099 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-bundle" (OuterVolumeSpecName: "bundle") pod "6c8b9789-f40f-469d-a045-f94242ebde27" (UID: "6c8b9789-f40f-469d-a045-f94242ebde27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:15.322172 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.322103 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-bundle" (OuterVolumeSpecName: "bundle") pod "6420943d-b33f-4c6f-b31c-f280893693d0" (UID: "6420943d-b33f-4c6f-b31c-f280893693d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:15.324264 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.324235 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c8b9789-f40f-469d-a045-f94242ebde27-kube-api-access-j8dpv" (OuterVolumeSpecName: "kube-api-access-j8dpv") pod "6c8b9789-f40f-469d-a045-f94242ebde27" (UID: "6c8b9789-f40f-469d-a045-f94242ebde27"). InnerVolumeSpecName "kube-api-access-j8dpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:58:15.324373 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.324266 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6420943d-b33f-4c6f-b31c-f280893693d0-kube-api-access-dk7hf" (OuterVolumeSpecName: "kube-api-access-dk7hf") pod "6420943d-b33f-4c6f-b31c-f280893693d0" (UID: "6420943d-b33f-4c6f-b31c-f280893693d0"). InnerVolumeSpecName "kube-api-access-dk7hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:58:15.327507 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.327485 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-util" (OuterVolumeSpecName: "util") pod "6420943d-b33f-4c6f-b31c-f280893693d0" (UID: "6420943d-b33f-4c6f-b31c-f280893693d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:15.327594 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.327575 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-util" (OuterVolumeSpecName: "util") pod "6c8b9789-f40f-469d-a045-f94242ebde27" (UID: "6c8b9789-f40f-469d-a045-f94242ebde27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:15.423255 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.423215 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk7hf\" (UniqueName: \"kubernetes.io/projected/6420943d-b33f-4c6f-b31c-f280893693d0-kube-api-access-dk7hf\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.423255 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.423249 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-util\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.423255 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.423258 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6420943d-b33f-4c6f-b31c-f280893693d0-bundle\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.423519 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.423267 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8dpv\" (UniqueName: \"kubernetes.io/projected/6c8b9789-f40f-469d-a045-f94242ebde27-kube-api-access-j8dpv\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.423519 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.423276 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-util\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.423519 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.423336 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c8b9789-f40f-469d-a045-f94242ebde27-bundle\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:15.978371 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.978335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" event={"ID":"6420943d-b33f-4c6f-b31c-f280893693d0","Type":"ContainerDied","Data":"38b855e72ca78b4f630d1c82ade666af2b7f4f3b2950e3aaaae02ab28b241420"} Sep 10 03:58:15.978371 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.978366 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfxlm2" Sep 10 03:58:15.978594 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.978381 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38b855e72ca78b4f630d1c82ade666af2b7f4f3b2950e3aaaae02ab28b241420" Sep 10 03:58:15.980335 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.980309 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" Sep 10 03:58:15.980335 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.980315 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6mlwxw" event={"ID":"199bd425-a7f0-484d-bc2d-4ad64f94fca0","Type":"ContainerDied","Data":"c504b8ae7410a9190936bbb90611524e42788b4d3951de60b6c9549d510f104e"} Sep 10 03:58:15.980525 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.980359 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c504b8ae7410a9190936bbb90611524e42788b4d3951de60b6c9549d510f104e" Sep 10 03:58:15.982314 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.982269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" event={"ID":"6c8b9789-f40f-469d-a045-f94242ebde27","Type":"ContainerDied","Data":"111b2d6e525b3351c378682585c9c7248ab00631576a18dd945b27cce2a9379d"} Sep 10 03:58:15.982411 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.982314 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x97dt" Sep 10 03:58:15.982411 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:15.982330 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="111b2d6e525b3351c378682585c9c7248ab00631576a18dd945b27cce2a9379d" Sep 10 03:58:19.000749 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:19.000716 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerID="966b654247f94fd5059351ad183b1a2a942349c1430d70efd9491f37ac8a704b" exitCode=0 Sep 10 03:58:19.001109 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:19.000758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" event={"ID":"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51","Type":"ContainerDied","Data":"966b654247f94fd5059351ad183b1a2a942349c1430d70efd9491f37ac8a704b"} Sep 10 03:58:20.008312 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:20.008259 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerID="d556b3aef9abf2622a14ce3d9ad245523cfed2fdbebc12d80d6af2b004d335fc" exitCode=0 Sep 10 03:58:20.008697 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:20.008310 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" event={"ID":"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51","Type":"ContainerDied","Data":"d556b3aef9abf2622a14ce3d9ad245523cfed2fdbebc12d80d6af2b004d335fc"} Sep 10 03:58:21.148800 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.148773 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:21.169409 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.169369 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-util\") pod \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " Sep 10 03:58:21.169550 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.169419 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmzfn\" (UniqueName: \"kubernetes.io/projected/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-kube-api-access-bmzfn\") pod \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " Sep 10 03:58:21.169550 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.169457 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-bundle\") pod \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\" (UID: \"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51\") " Sep 10 03:58:21.170269 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.170234 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-bundle" (OuterVolumeSpecName: "bundle") pod "1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" (UID: "1c375bde-4d09-41ed-b4de-bb7fe9e7ba51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:21.171650 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.171618 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-kube-api-access-bmzfn" (OuterVolumeSpecName: "kube-api-access-bmzfn") pod "1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" (UID: "1c375bde-4d09-41ed-b4de-bb7fe9e7ba51"). InnerVolumeSpecName "kube-api-access-bmzfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:58:21.174191 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.174170 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-util" (OuterVolumeSpecName: "util") pod "1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" (UID: "1c375bde-4d09-41ed-b4de-bb7fe9e7ba51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:21.270710 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.270619 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmzfn\" (UniqueName: \"kubernetes.io/projected/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-kube-api-access-bmzfn\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:21.270710 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.270652 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-bundle\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:21.270710 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:21.270662 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c375bde-4d09-41ed-b4de-bb7fe9e7ba51-util\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:22.021297 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:22.021254 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" Sep 10 03:58:22.021297 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:22.021269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqt95k" event={"ID":"1c375bde-4d09-41ed-b4de-bb7fe9e7ba51","Type":"ContainerDied","Data":"7dfa5f0ba129211fcd47ff9399b7a1212ec1562adf0942b3a14e3cd6fce5b7bb"} Sep 10 03:58:22.021498 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:22.021326 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dfa5f0ba129211fcd47ff9399b7a1212ec1562adf0942b3a14e3cd6fce5b7bb" Sep 10 03:58:28.104959 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.104922 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8"] Sep 10 03:58:28.105351 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105311 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8b9789-f40f-469d-a045-f94242ebde27" containerName="pull" Sep 10 03:58:28.105351 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105327 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8b9789-f40f-469d-a045-f94242ebde27" containerName="pull" Sep 10 03:58:28.105351 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105347 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8b9789-f40f-469d-a045-f94242ebde27" containerName="util" Sep 10 03:58:28.105351 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105354 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8b9789-f40f-469d-a045-f94242ebde27" containerName="util" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105363 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6420943d-b33f-4c6f-b31c-f280893693d0" containerName="util" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105369 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6420943d-b33f-4c6f-b31c-f280893693d0" containerName="util" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105376 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6420943d-b33f-4c6f-b31c-f280893693d0" containerName="pull" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105381 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6420943d-b33f-4c6f-b31c-f280893693d0" containerName="pull" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105387 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerName="pull" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105392 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerName="pull" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105400 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerName="pull" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105404 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerName="pull" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105412 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerName="util" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105417 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerName="util" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105423 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8b9789-f40f-469d-a045-f94242ebde27" containerName="extract" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105428 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8b9789-f40f-469d-a045-f94242ebde27" containerName="extract" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105434 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerName="util" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105439 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerName="util" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105445 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerName="extract" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105449 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerName="extract" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105457 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerName="extract" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105463 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerName="extract" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105467 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6420943d-b33f-4c6f-b31c-f280893693d0" containerName="extract" Sep 10 03:58:28.105495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105472 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6420943d-b33f-4c6f-b31c-f280893693d0" containerName="extract" Sep 10 03:58:28.106066 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105522 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c8b9789-f40f-469d-a045-f94242ebde27" containerName="extract" Sep 10 03:58:28.106066 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105531 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="199bd425-a7f0-484d-bc2d-4ad64f94fca0" containerName="extract" Sep 10 03:58:28.106066 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105538 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6420943d-b33f-4c6f-b31c-f280893693d0" containerName="extract" Sep 10 03:58:28.106066 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.105545 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c375bde-4d09-41ed-b4de-bb7fe9e7ba51" containerName="extract" Sep 10 03:58:28.108855 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.108834 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:28.111747 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.111723 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ct5rg\"" Sep 10 03:58:28.112625 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.112610 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 03:58:28.112673 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.112650 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 03:58:28.126494 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.126467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8"] Sep 10 03:58:28.127688 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.127655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qqdz\" (UniqueName: \"kubernetes.io/projected/9fb48b53-2505-4926-94e0-42ef611b1402-kube-api-access-6qqdz\") pod \"limitador-operator-controller-manager-74495c69f8-f6lh8\" (UID: \"9fb48b53-2505-4926-94e0-42ef611b1402\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:28.228426 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.228380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qqdz\" (UniqueName: \"kubernetes.io/projected/9fb48b53-2505-4926-94e0-42ef611b1402-kube-api-access-6qqdz\") pod \"limitador-operator-controller-manager-74495c69f8-f6lh8\" (UID: \"9fb48b53-2505-4926-94e0-42ef611b1402\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:28.243343 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.237448 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qqdz\" (UniqueName: \"kubernetes.io/projected/9fb48b53-2505-4926-94e0-42ef611b1402-kube-api-access-6qqdz\") pod \"limitador-operator-controller-manager-74495c69f8-f6lh8\" (UID: \"9fb48b53-2505-4926-94e0-42ef611b1402\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:28.419619 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.419582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:28.705037 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:28.705012 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8"] Sep 10 03:58:28.707659 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:28.707625 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb48b53_2505_4926_94e0_42ef611b1402.slice/crio-7504dc23b1465ff175ee1560f92ee11911dae1084e02d43a532dd06c43149934 WatchSource:0}: Error finding container 7504dc23b1465ff175ee1560f92ee11911dae1084e02d43a532dd06c43149934: Status 404 returned error can't find the container with id 7504dc23b1465ff175ee1560f92ee11911dae1084e02d43a532dd06c43149934 Sep 10 03:58:29.060100 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:29.060012 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" event={"ID":"9fb48b53-2505-4926-94e0-42ef611b1402","Type":"ContainerStarted","Data":"7504dc23b1465ff175ee1560f92ee11911dae1084e02d43a532dd06c43149934"} Sep 10 03:58:30.580844 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:30.580803 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2ds47"] Sep 10 03:58:30.585101 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:30.585078 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" Sep 10 03:58:30.587490 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:30.587463 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dpqwr\"" Sep 10 03:58:30.595457 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:30.595425 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2ds47"] Sep 10 03:58:30.653860 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:30.653818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnpg\" (UniqueName: \"kubernetes.io/projected/7a2f124d-4e25-432a-95aa-fb86b169c938-kube-api-access-7qnpg\") pod \"authorino-operator-76b478bd78-2ds47\" (UID: \"7a2f124d-4e25-432a-95aa-fb86b169c938\") " pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" Sep 10 03:58:30.754602 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:30.754562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnpg\" (UniqueName: \"kubernetes.io/projected/7a2f124d-4e25-432a-95aa-fb86b169c938-kube-api-access-7qnpg\") pod \"authorino-operator-76b478bd78-2ds47\" (UID: \"7a2f124d-4e25-432a-95aa-fb86b169c938\") " pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" Sep 10 03:58:30.768908 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:30.768877 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnpg\" (UniqueName: \"kubernetes.io/projected/7a2f124d-4e25-432a-95aa-fb86b169c938-kube-api-access-7qnpg\") pod \"authorino-operator-76b478bd78-2ds47\" (UID: \"7a2f124d-4e25-432a-95aa-fb86b169c938\") " pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" Sep 10 03:58:30.898900 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:30.898856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" Sep 10 03:58:31.662573 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:31.662538 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2ds47"] Sep 10 03:58:31.664147 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:31.664122 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2f124d_4e25_432a_95aa_fb86b169c938.slice/crio-c73e139b2a5c99a129281bfa4162563e7c04dfa3e26a407ab1341b092bd25964 WatchSource:0}: Error finding container c73e139b2a5c99a129281bfa4162563e7c04dfa3e26a407ab1341b092bd25964: Status 404 returned error can't find the container with id c73e139b2a5c99a129281bfa4162563e7c04dfa3e26a407ab1341b092bd25964 Sep 10 03:58:32.080800 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:32.080691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" event={"ID":"9fb48b53-2505-4926-94e0-42ef611b1402","Type":"ContainerStarted","Data":"c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3"} Sep 10 03:58:32.080800 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:32.080759 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:32.082084 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:32.082056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" event={"ID":"7a2f124d-4e25-432a-95aa-fb86b169c938","Type":"ContainerStarted","Data":"c73e139b2a5c99a129281bfa4162563e7c04dfa3e26a407ab1341b092bd25964"} Sep 10 03:58:32.106079 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:32.106015 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" podStartSLOduration=1.349222863 podStartE2EDuration="4.105992346s" totalImagesPullingTime="2.756769483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:58:32.10472063 +0000 UTC m=+626.191465193" watchObservedRunningTime="2026-09-10 03:58:32.105992346 +0000 UTC m=+626.192736909" Sep 10 03:58:33.090066 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:33.090031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" event={"ID":"7a2f124d-4e25-432a-95aa-fb86b169c938","Type":"ContainerStarted","Data":"34f763220aca996c3463051ef8ae13ec4dc673ff9f79c303d4839fd710208bea"} Sep 10 03:58:33.106678 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:33.106620 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" podStartSLOduration=1.8320697240000001 podStartE2EDuration="3.106603257s" totalImagesPullingTime="1.274533533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:58:33.105252965 +0000 UTC m=+627.191997531" watchObservedRunningTime="2026-09-10 03:58:33.106603257 +0000 UTC m=+627.193347819" Sep 10 03:58:34.105891 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:34.105851 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" Sep 10 03:58:35.324427 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.324389 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs"] Sep 10 03:58:35.328063 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.328040 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:35.331202 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.331181 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-425jf\"" Sep 10 03:58:35.351009 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.350975 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs"] Sep 10 03:58:35.399793 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.399756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c50a8330-6b2a-4f10-8f77-6fb027dcf870-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" (UID: \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:35.399947 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.399805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8prk9\" (UniqueName: \"kubernetes.io/projected/c50a8330-6b2a-4f10-8f77-6fb027dcf870-kube-api-access-8prk9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" (UID: \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:35.500935 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.500895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c50a8330-6b2a-4f10-8f77-6fb027dcf870-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" (UID: \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:35.501110 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.500951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8prk9\" (UniqueName: \"kubernetes.io/projected/c50a8330-6b2a-4f10-8f77-6fb027dcf870-kube-api-access-8prk9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" (UID: \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:35.501355 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.501338 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c50a8330-6b2a-4f10-8f77-6fb027dcf870-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" (UID: \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:35.509999 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.509968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8prk9\" (UniqueName: \"kubernetes.io/projected/c50a8330-6b2a-4f10-8f77-6fb027dcf870-kube-api-access-8prk9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" (UID: \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:35.638319 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.638255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:35.918294 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:35.918211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs"] Sep 10 03:58:35.921344 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:35.921319 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50a8330_6b2a_4f10_8f77_6fb027dcf870.slice/crio-92879b1c9652235ffaf673dc645c673bbded202ed169da63cb5f029af57f0abf WatchSource:0}: Error finding container 92879b1c9652235ffaf673dc645c673bbded202ed169da63cb5f029af57f0abf: Status 404 returned error can't find the container with id 92879b1c9652235ffaf673dc645c673bbded202ed169da63cb5f029af57f0abf Sep 10 03:58:36.118430 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:36.118388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" event={"ID":"c50a8330-6b2a-4f10-8f77-6fb027dcf870","Type":"ContainerStarted","Data":"92879b1c9652235ffaf673dc645c673bbded202ed169da63cb5f029af57f0abf"} Sep 10 03:58:37.603092 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.603023 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd"] Sep 10 03:58:37.606713 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.606686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" Sep 10 03:58:37.610604 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.610575 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vlrrd\"" Sep 10 03:58:37.610736 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.610677 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 10 03:58:37.623012 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.622949 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd"] Sep 10 03:58:37.724974 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.724939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kxd\" (UniqueName: \"kubernetes.io/projected/c2a65d91-2a0e-4c69-afbb-0130b231bd5d-kube-api-access-s4kxd\") pod \"dns-operator-controller-manager-7b84cd7c9c-dqrnd\" (UID: \"c2a65d91-2a0e-4c69-afbb-0130b231bd5d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" Sep 10 03:58:37.825502 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.825470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kxd\" (UniqueName: \"kubernetes.io/projected/c2a65d91-2a0e-4c69-afbb-0130b231bd5d-kube-api-access-s4kxd\") pod \"dns-operator-controller-manager-7b84cd7c9c-dqrnd\" (UID: \"c2a65d91-2a0e-4c69-afbb-0130b231bd5d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" Sep 10 03:58:37.835298 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.835258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kxd\" (UniqueName: \"kubernetes.io/projected/c2a65d91-2a0e-4c69-afbb-0130b231bd5d-kube-api-access-s4kxd\") pod \"dns-operator-controller-manager-7b84cd7c9c-dqrnd\" (UID: \"c2a65d91-2a0e-4c69-afbb-0130b231bd5d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" Sep 10 03:58:37.920740 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:37.920707 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" Sep 10 03:58:38.207421 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:38.207389 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd"] Sep 10 03:58:38.209860 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:38.209829 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a65d91_2a0e_4c69_afbb_0130b231bd5d.slice/crio-2394747b4839f835b2d94f6cbb8c9ad830c480f628eea1fd5695d6a1a9beb84d WatchSource:0}: Error finding container 2394747b4839f835b2d94f6cbb8c9ad830c480f628eea1fd5695d6a1a9beb84d: Status 404 returned error can't find the container with id 2394747b4839f835b2d94f6cbb8c9ad830c480f628eea1fd5695d6a1a9beb84d Sep 10 03:58:39.141771 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:39.141726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" event={"ID":"c2a65d91-2a0e-4c69-afbb-0130b231bd5d","Type":"ContainerStarted","Data":"2394747b4839f835b2d94f6cbb8c9ad830c480f628eea1fd5695d6a1a9beb84d"} Sep 10 03:58:40.150261 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:40.150221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" event={"ID":"c50a8330-6b2a-4f10-8f77-6fb027dcf870","Type":"ContainerStarted","Data":"a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3"} Sep 10 03:58:40.150749 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:40.150329 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:40.172552 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:40.172498 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" podStartSLOduration=1.325281714 podStartE2EDuration="5.172478812s" totalImagesPullingTime="3.847197098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:58:40.170844369 +0000 UTC m=+634.257588947" watchObservedRunningTime="2026-09-10 03:58:40.172478812 +0000 UTC m=+634.259223378" Sep 10 03:58:41.157436 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:41.157402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" event={"ID":"c2a65d91-2a0e-4c69-afbb-0130b231bd5d","Type":"ContainerStarted","Data":"b60ee227c74a529e7c9b0daf8b6740a82c26b7bda3b7789ffe5411fbdead2b77"} Sep 10 03:58:41.157819 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:41.157796 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" Sep 10 03:58:41.173475 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:41.173406 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" podStartSLOduration=1.723692689 podStartE2EDuration="4.173389544s" totalImagesPullingTime="2.449696855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:58:41.172640059 +0000 UTC m=+635.259384624" watchObservedRunningTime="2026-09-10 03:58:41.173389544 +0000 UTC m=+635.260134106" Sep 10 03:58:43.092993 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:43.092959 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:45.114068 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:45.114039 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-2ds47" Sep 10 03:58:51.159742 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:51.159712 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:52.581099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.581061 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq"] Sep 10 03:58:52.586192 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.586162 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:52.606856 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.606818 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq"] Sep 10 03:58:52.764462 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.764430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49c6w\" (UniqueName: \"kubernetes.io/projected/80ddbe80-47ee-497b-8990-883d6dc6362e-kube-api-access-49c6w\") pod \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" (UID: \"80ddbe80-47ee-497b-8990-883d6dc6362e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:52.764637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.764487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ddbe80-47ee-497b-8990-883d6dc6362e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" (UID: \"80ddbe80-47ee-497b-8990-883d6dc6362e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:52.865015 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.864924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49c6w\" (UniqueName: \"kubernetes.io/projected/80ddbe80-47ee-497b-8990-883d6dc6362e-kube-api-access-49c6w\") pod \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" (UID: \"80ddbe80-47ee-497b-8990-883d6dc6362e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:52.865015 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.865001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ddbe80-47ee-497b-8990-883d6dc6362e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" (UID: \"80ddbe80-47ee-497b-8990-883d6dc6362e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:52.865427 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.865405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ddbe80-47ee-497b-8990-883d6dc6362e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" (UID: \"80ddbe80-47ee-497b-8990-883d6dc6362e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:52.872904 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.872881 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49c6w\" (UniqueName: \"kubernetes.io/projected/80ddbe80-47ee-497b-8990-883d6dc6362e-kube-api-access-49c6w\") pod \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" (UID: \"80ddbe80-47ee-497b-8990-883d6dc6362e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:52.896901 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:52.896874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:53.171337 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.171306 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dqrnd" Sep 10 03:58:53.176520 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.176490 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq"] Sep 10 03:58:53.179875 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:53.179850 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ddbe80_47ee_497b_8990_883d6dc6362e.slice/crio-7ec417dcc01d758c9600e18470b3b35402bf252369bb438400f8b5b6d0973457 WatchSource:0}: Error finding container 7ec417dcc01d758c9600e18470b3b35402bf252369bb438400f8b5b6d0973457: Status 404 returned error can't find the container with id 7ec417dcc01d758c9600e18470b3b35402bf252369bb438400f8b5b6d0973457 Sep 10 03:58:53.207983 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.207952 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq"] Sep 10 03:58:53.218835 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.218797 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq"] Sep 10 03:58:53.242659 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.242620 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs"] Sep 10 03:58:53.243637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.243120 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" containerName="manager" containerID="cri-o://a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3" gracePeriod=2 Sep 10 03:58:53.246224 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.246187 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9"] Sep 10 03:58:53.252641 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.251626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:53.264579 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.264554 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs"] Sep 10 03:58:53.268252 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.268224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9"] Sep 10 03:58:53.270129 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.270097 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c50a8330-6b2a-4f10-8f77-6fb027dcf870\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\": pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:53.272105 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.272073 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:53.280588 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.280559 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8"] Sep 10 03:58:53.280772 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.280753 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" containerName="manager" containerID="cri-o://c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3" gracePeriod=2 Sep 10 03:58:53.294830 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.294797 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8"] Sep 10 03:58:53.301952 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.301894 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6lh8\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:53.303814 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.303780 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:53.314589 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.314563 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx"] Sep 10 03:58:53.315074 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.315016 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" containerName="manager" Sep 10 03:58:53.315074 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.315037 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" containerName="manager" Sep 10 03:58:53.315074 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.315050 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" containerName="manager" Sep 10 03:58:53.315074 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.315059 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" containerName="manager" Sep 10 03:58:53.315363 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.315150 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" containerName="manager" Sep 10 03:58:53.315363 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.315163 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" containerName="manager" Sep 10 03:58:53.319717 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.319695 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" Sep 10 03:58:53.322478 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.322266 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6lh8\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:53.325445 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.325411 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:53.329444 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.329422 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx"] Sep 10 03:58:53.369104 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.369077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j567\" (UniqueName: \"kubernetes.io/projected/2f134874-5c0a-4d28-8393-cbe749d4441b-kube-api-access-6j567\") pod \"kuadrant-operator-controller-manager-5f685c496f-8dsv9\" (UID: \"2f134874-5c0a-4d28-8393-cbe749d4441b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:53.369267 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.369131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f134874-5c0a-4d28-8393-cbe749d4441b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-8dsv9\" (UID: \"2f134874-5c0a-4d28-8393-cbe749d4441b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:53.469866 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.469831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j567\" (UniqueName: \"kubernetes.io/projected/2f134874-5c0a-4d28-8393-cbe749d4441b-kube-api-access-6j567\") pod \"kuadrant-operator-controller-manager-5f685c496f-8dsv9\" (UID: \"2f134874-5c0a-4d28-8393-cbe749d4441b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:53.470042 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.469888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f134874-5c0a-4d28-8393-cbe749d4441b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-8dsv9\" (UID: \"2f134874-5c0a-4d28-8393-cbe749d4441b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:53.470042 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.469936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsqbt\" (UniqueName: \"kubernetes.io/projected/987cba77-5659-4f5f-8c8f-ed5b30c83106-kube-api-access-lsqbt\") pod \"limitador-operator-controller-manager-74495c69f8-vlzzx\" (UID: \"987cba77-5659-4f5f-8c8f-ed5b30c83106\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" Sep 10 03:58:53.470393 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.470367 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f134874-5c0a-4d28-8393-cbe749d4441b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-8dsv9\" (UID: \"2f134874-5c0a-4d28-8393-cbe749d4441b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:53.487175 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.487142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j567\" (UniqueName: \"kubernetes.io/projected/2f134874-5c0a-4d28-8393-cbe749d4441b-kube-api-access-6j567\") pod \"kuadrant-operator-controller-manager-5f685c496f-8dsv9\" (UID: \"2f134874-5c0a-4d28-8393-cbe749d4441b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:53.515663 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.515633 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:53.517675 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.517644 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6lh8\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:53.519560 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.519529 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:53.526567 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.526548 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:53.528542 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.528517 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6lh8\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:53.530560 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:53.530538 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:53.571064 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.571021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsqbt\" (UniqueName: \"kubernetes.io/projected/987cba77-5659-4f5f-8c8f-ed5b30c83106-kube-api-access-lsqbt\") pod \"limitador-operator-controller-manager-74495c69f8-vlzzx\" (UID: \"987cba77-5659-4f5f-8c8f-ed5b30c83106\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" Sep 10 03:58:53.581086 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.581054 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsqbt\" (UniqueName: \"kubernetes.io/projected/987cba77-5659-4f5f-8c8f-ed5b30c83106-kube-api-access-lsqbt\") pod \"limitador-operator-controller-manager-74495c69f8-vlzzx\" (UID: \"987cba77-5659-4f5f-8c8f-ed5b30c83106\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" Sep 10 03:58:53.656724 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.656693 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:53.669726 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.669700 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" Sep 10 03:58:53.671993 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.671970 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c50a8330-6b2a-4f10-8f77-6fb027dcf870-extensions-socket-volume\") pod \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\" (UID: \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\") " Sep 10 03:58:53.672100 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.672070 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qqdz\" (UniqueName: \"kubernetes.io/projected/9fb48b53-2505-4926-94e0-42ef611b1402-kube-api-access-6qqdz\") pod \"9fb48b53-2505-4926-94e0-42ef611b1402\" (UID: \"9fb48b53-2505-4926-94e0-42ef611b1402\") " Sep 10 03:58:53.672152 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.672106 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8prk9\" (UniqueName: \"kubernetes.io/projected/c50a8330-6b2a-4f10-8f77-6fb027dcf870-kube-api-access-8prk9\") pod \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\" (UID: \"c50a8330-6b2a-4f10-8f77-6fb027dcf870\") " Sep 10 03:58:53.672472 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.672450 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50a8330-6b2a-4f10-8f77-6fb027dcf870-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c50a8330-6b2a-4f10-8f77-6fb027dcf870" (UID: "c50a8330-6b2a-4f10-8f77-6fb027dcf870"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:53.674258 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.674235 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb48b53-2505-4926-94e0-42ef611b1402-kube-api-access-6qqdz" (OuterVolumeSpecName: "kube-api-access-6qqdz") pod "9fb48b53-2505-4926-94e0-42ef611b1402" (UID: "9fb48b53-2505-4926-94e0-42ef611b1402"). InnerVolumeSpecName "kube-api-access-6qqdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:58:53.674478 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.674446 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c50a8330-6b2a-4f10-8f77-6fb027dcf870-kube-api-access-8prk9" (OuterVolumeSpecName: "kube-api-access-8prk9") pod "c50a8330-6b2a-4f10-8f77-6fb027dcf870" (UID: "c50a8330-6b2a-4f10-8f77-6fb027dcf870"). InnerVolumeSpecName "kube-api-access-8prk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:58:53.773026 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.772993 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qqdz\" (UniqueName: \"kubernetes.io/projected/9fb48b53-2505-4926-94e0-42ef611b1402-kube-api-access-6qqdz\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:53.773026 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.773024 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8prk9\" (UniqueName: \"kubernetes.io/projected/c50a8330-6b2a-4f10-8f77-6fb027dcf870-kube-api-access-8prk9\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:53.773212 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.773036 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c50a8330-6b2a-4f10-8f77-6fb027dcf870-extensions-socket-volume\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:53.944900 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.944873 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9"] Sep 10 03:58:53.946368 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:53.946332 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f134874_5c0a_4d28_8393_cbe749d4441b.slice/crio-851fbb07f012f8aff79cb1f2b49ab482d3349b67666789698dd409a2f426ca79 WatchSource:0}: Error finding container 851fbb07f012f8aff79cb1f2b49ab482d3349b67666789698dd409a2f426ca79: Status 404 returned error can't find the container with id 851fbb07f012f8aff79cb1f2b49ab482d3349b67666789698dd409a2f426ca79 Sep 10 03:58:53.957660 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:53.957630 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx"] Sep 10 03:58:53.958648 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:58:53.958619 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987cba77_5659_4f5f_8c8f_ed5b30c83106.slice/crio-470f0af5844dca40670547b8f374d891c0be71ae41266c5819e1ec05a3793863 WatchSource:0}: Error finding container 470f0af5844dca40670547b8f374d891c0be71ae41266c5819e1ec05a3793863: Status 404 returned error can't find the container with id 470f0af5844dca40670547b8f374d891c0be71ae41266c5819e1ec05a3793863 Sep 10 03:58:54.238449 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.238338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" event={"ID":"2f134874-5c0a-4d28-8393-cbe749d4441b","Type":"ContainerStarted","Data":"61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b"} Sep 10 03:58:54.238449 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.238408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" event={"ID":"2f134874-5c0a-4d28-8393-cbe749d4441b","Type":"ContainerStarted","Data":"851fbb07f012f8aff79cb1f2b49ab482d3349b67666789698dd409a2f426ca79"} Sep 10 03:58:54.238665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.238522 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:58:54.239735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.239708 2581 generic.go:356] "Generic (PLEG): container finished" podID="9fb48b53-2505-4926-94e0-42ef611b1402" containerID="c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3" exitCode=0 Sep 10 03:58:54.239854 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.239753 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:54.239854 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.239806 2581 scope.go:117] "RemoveContainer" containerID="c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3" Sep 10 03:58:54.241750 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.241718 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" containerName="manager" containerID="cri-o://dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff" gracePeriod=2 Sep 10 03:58:54.243547 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.243522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" event={"ID":"987cba77-5659-4f5f-8c8f-ed5b30c83106","Type":"ContainerStarted","Data":"2a6af150747789b3358e4df811b1c4794394a3d1e4a7613beb123b13c33e72f6"} Sep 10 03:58:54.243663 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.243572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" event={"ID":"987cba77-5659-4f5f-8c8f-ed5b30c83106","Type":"ContainerStarted","Data":"470f0af5844dca40670547b8f374d891c0be71ae41266c5819e1ec05a3793863"} Sep 10 03:58:54.243663 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.243596 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" Sep 10 03:58:54.245261 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.245238 2581 generic.go:356] "Generic (PLEG): container finished" podID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" containerID="a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3" exitCode=0 Sep 10 03:58:54.245361 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.245298 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:54.251493 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.251477 2581 scope.go:117] "RemoveContainer" containerID="c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3" Sep 10 03:58:54.251766 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.251748 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3\": container with ID starting with c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3 not found: ID does not exist" containerID="c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3" Sep 10 03:58:54.251816 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.251778 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3"} err="failed to get container status \"c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3\": rpc error: code = NotFound desc = could not find container \"c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3\": container with ID starting with c5fa2d1f7db3bd12c0a4d425eb4d47c911500f2f09cff48c899cfc648969e1d3 not found: ID does not exist" Sep 10 03:58:54.251816 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.251797 2581 scope.go:117] "RemoveContainer" containerID="a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3" Sep 10 03:58:54.260591 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.260557 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" podStartSLOduration=1.260544943 podStartE2EDuration="1.260544943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:58:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:58:54.25927418 +0000 UTC m=+648.346018746" watchObservedRunningTime="2026-09-10 03:58:54.260544943 +0000 UTC m=+648.347289507" Sep 10 03:58:54.261438 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.261415 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6lh8\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:54.263197 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.263174 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:54.264999 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.264978 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6lh8\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:54.266472 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.266450 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:54.267919 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.267903 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:54.290732 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.290675 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" podStartSLOduration=1.290657312 podStartE2EDuration="1.290657312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:58:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:58:54.28861527 +0000 UTC m=+648.375359868" watchObservedRunningTime="2026-09-10 03:58:54.290657312 +0000 UTC m=+648.377401874" Sep 10 03:58:54.303977 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.303941 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6lh8\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6lh8" Sep 10 03:58:54.305660 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.305633 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rxgbs\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rxgbs" Sep 10 03:58:54.307339 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.307312 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:54.353200 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.353175 2581 scope.go:117] "RemoveContainer" containerID="a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3" Sep 10 03:58:54.353550 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:54.353526 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3\": container with ID starting with a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3 not found: ID does not exist" containerID="a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3" Sep 10 03:58:54.353641 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.353557 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3"} err="failed to get container status \"a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3\": rpc error: code = NotFound desc = could not find container \"a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3\": container with ID starting with a21e591b664ba4ff2383070cf3bff0a6e43643f8000fda4011b8f0c7f2fbcaf3 not found: ID does not exist" Sep 10 03:58:54.416949 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.416914 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb48b53-2505-4926-94e0-42ef611b1402" path="/var/lib/kubelet/pods/9fb48b53-2505-4926-94e0-42ef611b1402/volumes" Sep 10 03:58:54.417326 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.417312 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c50a8330-6b2a-4f10-8f77-6fb027dcf870" path="/var/lib/kubelet/pods/c50a8330-6b2a-4f10-8f77-6fb027dcf870/volumes" Sep 10 03:58:54.478019 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.477993 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:54.582402 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.582257 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ddbe80-47ee-497b-8990-883d6dc6362e-extensions-socket-volume\") pod \"80ddbe80-47ee-497b-8990-883d6dc6362e\" (UID: \"80ddbe80-47ee-497b-8990-883d6dc6362e\") " Sep 10 03:58:54.582584 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.582431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49c6w\" (UniqueName: \"kubernetes.io/projected/80ddbe80-47ee-497b-8990-883d6dc6362e-kube-api-access-49c6w\") pod \"80ddbe80-47ee-497b-8990-883d6dc6362e\" (UID: \"80ddbe80-47ee-497b-8990-883d6dc6362e\") " Sep 10 03:58:54.583102 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.583056 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ddbe80-47ee-497b-8990-883d6dc6362e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "80ddbe80-47ee-497b-8990-883d6dc6362e" (UID: "80ddbe80-47ee-497b-8990-883d6dc6362e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:58:54.584883 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.584850 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ddbe80-47ee-497b-8990-883d6dc6362e-kube-api-access-49c6w" (OuterVolumeSpecName: "kube-api-access-49c6w") pod "80ddbe80-47ee-497b-8990-883d6dc6362e" (UID: "80ddbe80-47ee-497b-8990-883d6dc6362e"). InnerVolumeSpecName "kube-api-access-49c6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:58:54.683728 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.683687 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80ddbe80-47ee-497b-8990-883d6dc6362e-extensions-socket-volume\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:54.683728 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:54.683720 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49c6w\" (UniqueName: \"kubernetes.io/projected/80ddbe80-47ee-497b-8990-883d6dc6362e-kube-api-access-49c6w\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:58:55.253723 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:55.253683 2581 generic.go:356] "Generic (PLEG): container finished" podID="80ddbe80-47ee-497b-8990-883d6dc6362e" containerID="dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff" exitCode=2 Sep 10 03:58:55.253919 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:55.253728 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:55.253919 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:55.253785 2581 scope.go:117] "RemoveContainer" containerID="dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff" Sep 10 03:58:55.255972 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:55.255936 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:55.263029 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:55.263012 2581 scope.go:117] "RemoveContainer" containerID="dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff" Sep 10 03:58:55.263378 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:55.263357 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff\": container with ID starting with dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff not found: ID does not exist" containerID="dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff" Sep 10 03:58:55.263423 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:55.263387 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff"} err="failed to get container status \"dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff\": rpc error: code = NotFound desc = could not find container \"dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff\": container with ID starting with dc7b1b84b90f63d9b66c457feee5d01a0f65ce8631632f6fd41cae3dcadcc1ff not found: ID does not exist" Sep 10 03:58:55.263889 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:55.263873 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:56.415316 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:58:56.415256 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-s8nbq\" is forbidden: User \"system:node:ip-10-0-130-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-114.ec2.internal' and this object" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-s8nbq" Sep 10 03:58:56.416705 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:58:56.416683 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" path="/var/lib/kubelet/pods/80ddbe80-47ee-497b-8990-883d6dc6362e/volumes" Sep 10 03:59:05.258089 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.258055 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vlzzx" Sep 10 03:59:05.258583 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.258137 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:59:05.656099 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.656062 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm"] Sep 10 03:59:05.656462 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.656449 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" containerName="manager" Sep 10 03:59:05.656511 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.656463 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" containerName="manager" Sep 10 03:59:05.656546 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.656539 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ddbe80-47ee-497b-8990-883d6dc6362e" containerName="manager" Sep 10 03:59:05.662771 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.662746 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:05.674690 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.674660 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm"] Sep 10 03:59:05.680519 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.680490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86716209-6114-4b8f-afac-fc08f6ecc768-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dlfhm\" (UID: \"86716209-6114-4b8f-afac-fc08f6ecc768\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:05.680684 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.680646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9smqz\" (UniqueName: \"kubernetes.io/projected/86716209-6114-4b8f-afac-fc08f6ecc768-kube-api-access-9smqz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dlfhm\" (UID: \"86716209-6114-4b8f-afac-fc08f6ecc768\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:05.781515 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.781418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9smqz\" (UniqueName: \"kubernetes.io/projected/86716209-6114-4b8f-afac-fc08f6ecc768-kube-api-access-9smqz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dlfhm\" (UID: \"86716209-6114-4b8f-afac-fc08f6ecc768\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:05.781515 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.781478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86716209-6114-4b8f-afac-fc08f6ecc768-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dlfhm\" (UID: \"86716209-6114-4b8f-afac-fc08f6ecc768\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:05.781879 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.781857 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86716209-6114-4b8f-afac-fc08f6ecc768-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dlfhm\" (UID: \"86716209-6114-4b8f-afac-fc08f6ecc768\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:05.789665 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.789637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9smqz\" (UniqueName: \"kubernetes.io/projected/86716209-6114-4b8f-afac-fc08f6ecc768-kube-api-access-9smqz\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dlfhm\" (UID: \"86716209-6114-4b8f-afac-fc08f6ecc768\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:05.974509 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:05.974467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:06.251572 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:06.251536 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm"] Sep 10 03:59:06.254255 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:59:06.254226 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86716209_6114_4b8f_afac_fc08f6ecc768.slice/crio-adcfeab1316b85758b7d42fc1fa8ba04cd142aad44ca34033d8be8e034efaedf WatchSource:0}: Error finding container adcfeab1316b85758b7d42fc1fa8ba04cd142aad44ca34033d8be8e034efaedf: Status 404 returned error can't find the container with id adcfeab1316b85758b7d42fc1fa8ba04cd142aad44ca34033d8be8e034efaedf Sep 10 03:59:06.336137 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:06.336106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" event={"ID":"86716209-6114-4b8f-afac-fc08f6ecc768","Type":"ContainerStarted","Data":"4e1b7c7e49fe073063744dda8020a061dd81c11a25557f8364eb7240c9db9c80"} Sep 10 03:59:06.336585 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:06.336163 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" event={"ID":"86716209-6114-4b8f-afac-fc08f6ecc768","Type":"ContainerStarted","Data":"adcfeab1316b85758b7d42fc1fa8ba04cd142aad44ca34033d8be8e034efaedf"} Sep 10 03:59:06.336585 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:06.336198 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:06.356090 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:06.356039 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" podStartSLOduration=1.356022624 podStartE2EDuration="1.356022624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:59:06.354462524 +0000 UTC m=+660.441207069" watchObservedRunningTime="2026-09-10 03:59:06.356022624 +0000 UTC m=+660.442767186" Sep 10 03:59:17.344531 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.344496 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dlfhm" Sep 10 03:59:17.394175 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.394132 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9"] Sep 10 03:59:17.394879 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.394842 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" podUID="2f134874-5c0a-4d28-8393-cbe749d4441b" containerName="manager" containerID="cri-o://61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b" gracePeriod=10 Sep 10 03:59:17.646755 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.646730 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:59:17.691509 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.691478 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j567\" (UniqueName: \"kubernetes.io/projected/2f134874-5c0a-4d28-8393-cbe749d4441b-kube-api-access-6j567\") pod \"2f134874-5c0a-4d28-8393-cbe749d4441b\" (UID: \"2f134874-5c0a-4d28-8393-cbe749d4441b\") " Sep 10 03:59:17.691707 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.691520 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f134874-5c0a-4d28-8393-cbe749d4441b-extensions-socket-volume\") pod \"2f134874-5c0a-4d28-8393-cbe749d4441b\" (UID: \"2f134874-5c0a-4d28-8393-cbe749d4441b\") " Sep 10 03:59:17.691932 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.691908 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f134874-5c0a-4d28-8393-cbe749d4441b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f134874-5c0a-4d28-8393-cbe749d4441b" (UID: "2f134874-5c0a-4d28-8393-cbe749d4441b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:59:17.693673 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.693641 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f134874-5c0a-4d28-8393-cbe749d4441b-kube-api-access-6j567" (OuterVolumeSpecName: "kube-api-access-6j567") pod "2f134874-5c0a-4d28-8393-cbe749d4441b" (UID: "2f134874-5c0a-4d28-8393-cbe749d4441b"). InnerVolumeSpecName "kube-api-access-6j567". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:59:17.792860 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.792816 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j567\" (UniqueName: \"kubernetes.io/projected/2f134874-5c0a-4d28-8393-cbe749d4441b-kube-api-access-6j567\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:59:17.792860 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:17.792855 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f134874-5c0a-4d28-8393-cbe749d4441b-extensions-socket-volume\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:59:18.408803 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.408765 2581 generic.go:356] "Generic (PLEG): container finished" podID="2f134874-5c0a-4d28-8393-cbe749d4441b" containerID="61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b" exitCode=0 Sep 10 03:59:18.409198 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.408812 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" Sep 10 03:59:18.409198 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.408838 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" event={"ID":"2f134874-5c0a-4d28-8393-cbe749d4441b","Type":"ContainerDied","Data":"61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b"} Sep 10 03:59:18.409198 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.408890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9" event={"ID":"2f134874-5c0a-4d28-8393-cbe749d4441b","Type":"ContainerDied","Data":"851fbb07f012f8aff79cb1f2b49ab482d3349b67666789698dd409a2f426ca79"} Sep 10 03:59:18.409198 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.408918 2581 scope.go:117] "RemoveContainer" containerID="61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b" Sep 10 03:59:18.419329 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.419300 2581 scope.go:117] "RemoveContainer" containerID="61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b" Sep 10 03:59:18.419601 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:59:18.419580 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b\": container with ID starting with 61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b not found: ID does not exist" containerID="61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b" Sep 10 03:59:18.419666 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.419610 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b"} err="failed to get container status \"61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b\": rpc error: code = NotFound desc = could not find container \"61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b\": container with ID starting with 61fd438e00e0e968d5d0eba9def8f8c16350ed18a1257314ce3c25f954c6b65b not found: ID does not exist" Sep 10 03:59:18.437679 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.437641 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9"] Sep 10 03:59:18.442355 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:18.442328 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-8dsv9"] Sep 10 03:59:20.416504 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:20.416466 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f134874-5c0a-4d28-8393-cbe749d4441b" path="/var/lib/kubelet/pods/2f134874-5c0a-4d28-8393-cbe749d4441b/volumes" Sep 10 03:59:33.717098 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.717062 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-m5wbh"] Sep 10 03:59:33.717693 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.717673 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f134874-5c0a-4d28-8393-cbe749d4441b" containerName="manager" Sep 10 03:59:33.717765 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.717697 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f134874-5c0a-4d28-8393-cbe749d4441b" containerName="manager" Sep 10 03:59:33.717800 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.717786 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f134874-5c0a-4d28-8393-cbe749d4441b" containerName="manager" Sep 10 03:59:33.720249 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.720235 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:33.722593 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.722547 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 03:59:33.722593 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.722585 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n7cbv\"" Sep 10 03:59:33.727436 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.727412 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-m5wbh"] Sep 10 03:59:33.816711 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.816679 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-m5wbh"] Sep 10 03:59:33.840332 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.840236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cfz\" (UniqueName: \"kubernetes.io/projected/055a7586-4781-43dd-9669-6c0a1cc0177b-kube-api-access-w4cfz\") pod \"limitador-limitador-8588749977-m5wbh\" (UID: \"055a7586-4781-43dd-9669-6c0a1cc0177b\") " pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:33.840485 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.840367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/055a7586-4781-43dd-9669-6c0a1cc0177b-config-file\") pod \"limitador-limitador-8588749977-m5wbh\" (UID: \"055a7586-4781-43dd-9669-6c0a1cc0177b\") " pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:33.941637 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.941596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cfz\" (UniqueName: \"kubernetes.io/projected/055a7586-4781-43dd-9669-6c0a1cc0177b-kube-api-access-w4cfz\") pod \"limitador-limitador-8588749977-m5wbh\" (UID: \"055a7586-4781-43dd-9669-6c0a1cc0177b\") " pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:33.941829 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.941654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/055a7586-4781-43dd-9669-6c0a1cc0177b-config-file\") pod \"limitador-limitador-8588749977-m5wbh\" (UID: \"055a7586-4781-43dd-9669-6c0a1cc0177b\") " pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:33.942239 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.942219 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/055a7586-4781-43dd-9669-6c0a1cc0177b-config-file\") pod \"limitador-limitador-8588749977-m5wbh\" (UID: \"055a7586-4781-43dd-9669-6c0a1cc0177b\") " pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:33.949614 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:33.949586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cfz\" (UniqueName: \"kubernetes.io/projected/055a7586-4781-43dd-9669-6c0a1cc0177b-kube-api-access-w4cfz\") pod \"limitador-limitador-8588749977-m5wbh\" (UID: \"055a7586-4781-43dd-9669-6c0a1cc0177b\") " pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:34.031723 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.031631 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:34.304144 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.304063 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-m5wbh"] Sep 10 03:59:34.307306 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:59:34.307266 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055a7586_4781_43dd_9669_6c0a1cc0177b.slice/crio-a72c3b60580fc150745c6ad0b21013c1dab240c6af4776736ee42fdc2b54206d WatchSource:0}: Error finding container a72c3b60580fc150745c6ad0b21013c1dab240c6af4776736ee42fdc2b54206d: Status 404 returned error can't find the container with id a72c3b60580fc150745c6ad0b21013c1dab240c6af4776736ee42fdc2b54206d Sep 10 03:59:34.500448 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.500408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" event={"ID":"055a7586-4781-43dd-9669-6c0a1cc0177b","Type":"ContainerStarted","Data":"a72c3b60580fc150745c6ad0b21013c1dab240c6af4776736ee42fdc2b54206d"} Sep 10 03:59:34.618973 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.618879 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-grjjs"] Sep 10 03:59:34.621979 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.621956 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-grjjs" Sep 10 03:59:34.624388 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.624362 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8xm54\"" Sep 10 03:59:34.626885 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.626862 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-grjjs"] Sep 10 03:59:34.748476 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.748444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zjxm\" (UniqueName: \"kubernetes.io/projected/1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900-kube-api-access-7zjxm\") pod \"authorino-59c974bd48-grjjs\" (UID: \"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900\") " pod="kuadrant-system/authorino-59c974bd48-grjjs" Sep 10 03:59:34.849227 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.849190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zjxm\" (UniqueName: \"kubernetes.io/projected/1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900-kube-api-access-7zjxm\") pod \"authorino-59c974bd48-grjjs\" (UID: \"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900\") " pod="kuadrant-system/authorino-59c974bd48-grjjs" Sep 10 03:59:34.857256 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.857229 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zjxm\" (UniqueName: \"kubernetes.io/projected/1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900-kube-api-access-7zjxm\") pod \"authorino-59c974bd48-grjjs\" (UID: \"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900\") " pod="kuadrant-system/authorino-59c974bd48-grjjs" Sep 10 03:59:34.933433 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:34.933400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-grjjs" Sep 10 03:59:35.209941 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:35.209912 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-grjjs"] Sep 10 03:59:35.285357 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:59:35.285325 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a2cf8a6_eacb_4685_a0a4_9c0afeb1c900.slice/crio-36a518cac7cbf88eef72c4853862ab12ec66ef82aedf935855c8632a7642dced WatchSource:0}: Error finding container 36a518cac7cbf88eef72c4853862ab12ec66ef82aedf935855c8632a7642dced: Status 404 returned error can't find the container with id 36a518cac7cbf88eef72c4853862ab12ec66ef82aedf935855c8632a7642dced Sep 10 03:59:35.508013 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:35.507917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" event={"ID":"055a7586-4781-43dd-9669-6c0a1cc0177b","Type":"ContainerStarted","Data":"2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71"} Sep 10 03:59:35.508173 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:35.508088 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:35.509270 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:35.509239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-grjjs" event={"ID":"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900","Type":"ContainerStarted","Data":"36a518cac7cbf88eef72c4853862ab12ec66ef82aedf935855c8632a7642dced"} Sep 10 03:59:35.525171 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:35.525114 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" podStartSLOduration=1.511768893 podStartE2EDuration="2.525098827s" totalImagesPullingTime="1.013329934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:59:35.523242324 +0000 UTC m=+689.609986906" watchObservedRunningTime="2026-09-10 03:59:35.525098827 +0000 UTC m=+689.611843389" Sep 10 03:59:38.527408 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:38.527366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-grjjs" event={"ID":"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900","Type":"ContainerStarted","Data":"df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527"} Sep 10 03:59:38.543688 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:38.543628 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-grjjs" podStartSLOduration=2.317199434 podStartE2EDuration="4.543611347s" totalImagesPullingTime="2.226411913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:59:38.54132299 +0000 UTC m=+692.628067552" watchObservedRunningTime="2026-09-10 03:59:38.543611347 +0000 UTC m=+692.630355948" Sep 10 03:59:46.516515 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:46.516484 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:47.418265 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:47.418230 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-m5wbh"] Sep 10 03:59:47.418495 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:47.418469 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" podUID="055a7586-4781-43dd-9669-6c0a1cc0177b" containerName="limitador" containerID="cri-o://2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71" gracePeriod=30 Sep 10 03:59:47.963171 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:47.963146 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:48.060451 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.060364 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/055a7586-4781-43dd-9669-6c0a1cc0177b-config-file\") pod \"055a7586-4781-43dd-9669-6c0a1cc0177b\" (UID: \"055a7586-4781-43dd-9669-6c0a1cc0177b\") " Sep 10 03:59:48.060451 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.060403 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4cfz\" (UniqueName: \"kubernetes.io/projected/055a7586-4781-43dd-9669-6c0a1cc0177b-kube-api-access-w4cfz\") pod \"055a7586-4781-43dd-9669-6c0a1cc0177b\" (UID: \"055a7586-4781-43dd-9669-6c0a1cc0177b\") " Sep 10 03:59:48.060735 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.060712 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055a7586-4781-43dd-9669-6c0a1cc0177b-config-file" (OuterVolumeSpecName: "config-file") pod "055a7586-4781-43dd-9669-6c0a1cc0177b" (UID: "055a7586-4781-43dd-9669-6c0a1cc0177b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:59:48.062502 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.062481 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055a7586-4781-43dd-9669-6c0a1cc0177b-kube-api-access-w4cfz" (OuterVolumeSpecName: "kube-api-access-w4cfz") pod "055a7586-4781-43dd-9669-6c0a1cc0177b" (UID: "055a7586-4781-43dd-9669-6c0a1cc0177b"). InnerVolumeSpecName "kube-api-access-w4cfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:59:48.161148 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.161110 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/055a7586-4781-43dd-9669-6c0a1cc0177b-config-file\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:59:48.161148 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.161144 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4cfz\" (UniqueName: \"kubernetes.io/projected/055a7586-4781-43dd-9669-6c0a1cc0177b-kube-api-access-w4cfz\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 03:59:48.586668 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.586632 2581 generic.go:356] "Generic (PLEG): container finished" podID="055a7586-4781-43dd-9669-6c0a1cc0177b" containerID="2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71" exitCode=0 Sep 10 03:59:48.586833 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.586696 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" Sep 10 03:59:48.586833 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.586703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" event={"ID":"055a7586-4781-43dd-9669-6c0a1cc0177b","Type":"ContainerDied","Data":"2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71"} Sep 10 03:59:48.586833 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.586814 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-m5wbh" event={"ID":"055a7586-4781-43dd-9669-6c0a1cc0177b","Type":"ContainerDied","Data":"a72c3b60580fc150745c6ad0b21013c1dab240c6af4776736ee42fdc2b54206d"} Sep 10 03:59:48.586943 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.586836 2581 scope.go:117] "RemoveContainer" containerID="2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71" Sep 10 03:59:48.595694 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.595670 2581 scope.go:117] "RemoveContainer" containerID="2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71" Sep 10 03:59:48.595986 ip-10-0-130-114 kubenswrapper[2581]: E0910 03:59:48.595966 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71\": container with ID starting with 2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71 not found: ID does not exist" containerID="2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71" Sep 10 03:59:48.596046 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.595996 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71"} err="failed to get container status \"2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71\": rpc error: code = NotFound desc = could not find container \"2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71\": container with ID starting with 2563d807cbccb334768fc2c9edddb6d0fdc6b751b0f83a2535b8525f8bf3cb71 not found: ID does not exist" Sep 10 03:59:48.602941 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.602916 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-m5wbh"] Sep 10 03:59:48.605165 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:48.605144 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-m5wbh"] Sep 10 03:59:50.121248 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.121217 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4kc92"] Sep 10 03:59:50.121653 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.121639 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055a7586-4781-43dd-9669-6c0a1cc0177b" containerName="limitador" Sep 10 03:59:50.121653 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.121655 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="055a7586-4781-43dd-9669-6c0a1cc0177b" containerName="limitador" Sep 10 03:59:50.121728 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.121723 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="055a7586-4781-43dd-9669-6c0a1cc0177b" containerName="limitador" Sep 10 03:59:50.126132 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.126107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:50.128505 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.128467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 10 03:59:50.128626 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.128513 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 03:59:50.129596 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.129570 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6b9ml\"" Sep 10 03:59:50.129717 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.129595 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 03:59:50.132635 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.132612 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4kc92"] Sep 10 03:59:50.176140 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.176110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkz9b\" (UniqueName: \"kubernetes.io/projected/f54121c7-4fb7-42ae-b6e2-8849fb29cca7-kube-api-access-fkz9b\") pod \"postgres-69fb4594cf-4kc92\" (UID: \"f54121c7-4fb7-42ae-b6e2-8849fb29cca7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:50.176329 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.176177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f54121c7-4fb7-42ae-b6e2-8849fb29cca7-data\") pod \"postgres-69fb4594cf-4kc92\" (UID: \"f54121c7-4fb7-42ae-b6e2-8849fb29cca7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:50.277064 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.277028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkz9b\" (UniqueName: \"kubernetes.io/projected/f54121c7-4fb7-42ae-b6e2-8849fb29cca7-kube-api-access-fkz9b\") pod \"postgres-69fb4594cf-4kc92\" (UID: \"f54121c7-4fb7-42ae-b6e2-8849fb29cca7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:50.277226 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.277080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f54121c7-4fb7-42ae-b6e2-8849fb29cca7-data\") pod \"postgres-69fb4594cf-4kc92\" (UID: \"f54121c7-4fb7-42ae-b6e2-8849fb29cca7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:50.277468 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.277452 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f54121c7-4fb7-42ae-b6e2-8849fb29cca7-data\") pod \"postgres-69fb4594cf-4kc92\" (UID: \"f54121c7-4fb7-42ae-b6e2-8849fb29cca7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:50.287996 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.287970 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkz9b\" (UniqueName: \"kubernetes.io/projected/f54121c7-4fb7-42ae-b6e2-8849fb29cca7-kube-api-access-fkz9b\") pod \"postgres-69fb4594cf-4kc92\" (UID: \"f54121c7-4fb7-42ae-b6e2-8849fb29cca7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:50.416739 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.416706 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="055a7586-4781-43dd-9669-6c0a1cc0177b" path="/var/lib/kubelet/pods/055a7586-4781-43dd-9669-6c0a1cc0177b/volumes" Sep 10 03:59:50.438354 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.438315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:50.709317 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:50.709272 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4kc92"] Sep 10 03:59:50.711845 ip-10-0-130-114 kubenswrapper[2581]: W0910 03:59:50.711815 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54121c7_4fb7_42ae_b6e2_8849fb29cca7.slice/crio-5be00435cf3f27788ab8b1d4a3823648f985e50145e81bfff228ce8d3b362590 WatchSource:0}: Error finding container 5be00435cf3f27788ab8b1d4a3823648f985e50145e81bfff228ce8d3b362590: Status 404 returned error can't find the container with id 5be00435cf3f27788ab8b1d4a3823648f985e50145e81bfff228ce8d3b362590 Sep 10 03:59:51.610651 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:51.610611 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" event={"ID":"f54121c7-4fb7-42ae-b6e2-8849fb29cca7","Type":"ContainerStarted","Data":"5be00435cf3f27788ab8b1d4a3823648f985e50145e81bfff228ce8d3b362590"} Sep 10 03:59:55.639528 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:55.639493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" event={"ID":"f54121c7-4fb7-42ae-b6e2-8849fb29cca7","Type":"ContainerStarted","Data":"28019e1fb981f88a98d0eb262993419ab584f72fd8f32729fe5cd9b4a5e0c766"} Sep 10 03:59:55.639875 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:55.639624 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 03:59:55.656249 ip-10-0-130-114 kubenswrapper[2581]: I0910 03:59:55.656197 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" podStartSLOduration=0.882825625 podStartE2EDuration="5.656182557s" totalImagesPullingTime="4.773356932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:59:55.653515468 +0000 UTC m=+709.740260034" watchObservedRunningTime="2026-09-10 03:59:55.656182557 +0000 UTC m=+709.742927121" Sep 10 04:00:01.675791 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:01.675760 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4kc92" Sep 10 04:00:02.218681 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.218633 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-j7v4b"] Sep 10 04:00:02.221485 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.221462 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-j7v4b" Sep 10 04:00:02.229201 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.229173 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-j7v4b"] Sep 10 04:00:02.266142 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.266106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbdw\" (UniqueName: \"kubernetes.io/projected/31394011-e7f9-472d-9e02-d13252a6a259-kube-api-access-gxbdw\") pod \"authorino-557f876f69-j7v4b\" (UID: \"31394011-e7f9-472d-9e02-d13252a6a259\") " pod="kuadrant-system/authorino-557f876f69-j7v4b" Sep 10 04:00:02.343094 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.343062 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-j7v4b"] Sep 10 04:00:02.343378 ip-10-0-130-114 kubenswrapper[2581]: E0910 04:00:02.343359 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gxbdw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-j7v4b" podUID="31394011-e7f9-472d-9e02-d13252a6a259" Sep 10 04:00:02.366873 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.366841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbdw\" (UniqueName: \"kubernetes.io/projected/31394011-e7f9-472d-9e02-d13252a6a259-kube-api-access-gxbdw\") pod \"authorino-557f876f69-j7v4b\" (UID: \"31394011-e7f9-472d-9e02-d13252a6a259\") " pod="kuadrant-system/authorino-557f876f69-j7v4b" Sep 10 04:00:02.380232 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.380201 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbdw\" (UniqueName: \"kubernetes.io/projected/31394011-e7f9-472d-9e02-d13252a6a259-kube-api-access-gxbdw\") pod \"authorino-557f876f69-j7v4b\" (UID: \"31394011-e7f9-472d-9e02-d13252a6a259\") " pod="kuadrant-system/authorino-557f876f69-j7v4b" Sep 10 04:00:02.501414 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.501320 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-744b9444d8-bsdcr"] Sep 10 04:00:02.504445 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.504422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-744b9444d8-bsdcr" Sep 10 04:00:02.506912 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.506890 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 04:00:02.515936 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.515910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-744b9444d8-bsdcr"] Sep 10 04:00:02.568698 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.568657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpwhx\" (UniqueName: \"kubernetes.io/projected/6dd73a91-672d-4056-b046-9ddaf6f5130e-kube-api-access-qpwhx\") pod \"authorino-744b9444d8-bsdcr\" (UID: \"6dd73a91-672d-4056-b046-9ddaf6f5130e\") " pod="kuadrant-system/authorino-744b9444d8-bsdcr" Sep 10 04:00:02.568878 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.568711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6dd73a91-672d-4056-b046-9ddaf6f5130e-tls-cert\") pod \"authorino-744b9444d8-bsdcr\" (UID: \"6dd73a91-672d-4056-b046-9ddaf6f5130e\") " pod="kuadrant-system/authorino-744b9444d8-bsdcr" Sep 10 04:00:02.669727 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.669694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpwhx\" (UniqueName: \"kubernetes.io/projected/6dd73a91-672d-4056-b046-9ddaf6f5130e-kube-api-access-qpwhx\") pod \"authorino-744b9444d8-bsdcr\" (UID: \"6dd73a91-672d-4056-b046-9ddaf6f5130e\") " pod="kuadrant-system/authorino-744b9444d8-bsdcr" Sep 10 04:00:02.669876 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.669736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6dd73a91-672d-4056-b046-9ddaf6f5130e-tls-cert\") pod \"authorino-744b9444d8-bsdcr\" (UID: \"6dd73a91-672d-4056-b046-9ddaf6f5130e\") " pod="kuadrant-system/authorino-744b9444d8-bsdcr" Sep 10 04:00:02.672192 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.672166 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6dd73a91-672d-4056-b046-9ddaf6f5130e-tls-cert\") pod \"authorino-744b9444d8-bsdcr\" (UID: \"6dd73a91-672d-4056-b046-9ddaf6f5130e\") " pod="kuadrant-system/authorino-744b9444d8-bsdcr" Sep 10 04:00:02.677841 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.677817 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpwhx\" (UniqueName: \"kubernetes.io/projected/6dd73a91-672d-4056-b046-9ddaf6f5130e-kube-api-access-qpwhx\") pod \"authorino-744b9444d8-bsdcr\" (UID: \"6dd73a91-672d-4056-b046-9ddaf6f5130e\") " pod="kuadrant-system/authorino-744b9444d8-bsdcr" Sep 10 04:00:02.682267 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.682231 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-j7v4b" Sep 10 04:00:02.693137 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.693110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-j7v4b" Sep 10 04:00:02.815304 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.815178 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-744b9444d8-bsdcr" Sep 10 04:00:02.871521 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.871307 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxbdw\" (UniqueName: \"kubernetes.io/projected/31394011-e7f9-472d-9e02-d13252a6a259-kube-api-access-gxbdw\") pod \"31394011-e7f9-472d-9e02-d13252a6a259\" (UID: \"31394011-e7f9-472d-9e02-d13252a6a259\") " Sep 10 04:00:02.873898 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.873870 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31394011-e7f9-472d-9e02-d13252a6a259-kube-api-access-gxbdw" (OuterVolumeSpecName: "kube-api-access-gxbdw") pod "31394011-e7f9-472d-9e02-d13252a6a259" (UID: "31394011-e7f9-472d-9e02-d13252a6a259"). InnerVolumeSpecName "kube-api-access-gxbdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:00:02.972010 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:02.971972 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxbdw\" (UniqueName: \"kubernetes.io/projected/31394011-e7f9-472d-9e02-d13252a6a259-kube-api-access-gxbdw\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 04:00:03.084430 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:03.084402 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-744b9444d8-bsdcr"] Sep 10 04:00:03.086097 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:00:03.086074 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dd73a91_672d_4056_b046_9ddaf6f5130e.slice/crio-ced8287eb7c8f7444ec6e259b4c70861257e0017ced489f1d21a9554f5a12914 WatchSource:0}: Error finding container ced8287eb7c8f7444ec6e259b4c70861257e0017ced489f1d21a9554f5a12914: Status 404 returned error can't find the container with id ced8287eb7c8f7444ec6e259b4c70861257e0017ced489f1d21a9554f5a12914 Sep 10 04:00:03.688737 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:03.688650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-744b9444d8-bsdcr" event={"ID":"6dd73a91-672d-4056-b046-9ddaf6f5130e","Type":"ContainerStarted","Data":"ced8287eb7c8f7444ec6e259b4c70861257e0017ced489f1d21a9554f5a12914"} Sep 10 04:00:03.688737 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:03.688659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-j7v4b" Sep 10 04:00:03.717720 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:03.717685 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-j7v4b"] Sep 10 04:00:03.721087 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:03.721062 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-j7v4b"] Sep 10 04:00:04.416257 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:04.416221 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31394011-e7f9-472d-9e02-d13252a6a259" path="/var/lib/kubelet/pods/31394011-e7f9-472d-9e02-d13252a6a259/volumes" Sep 10 04:00:05.702813 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:05.702778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-744b9444d8-bsdcr" event={"ID":"6dd73a91-672d-4056-b046-9ddaf6f5130e","Type":"ContainerStarted","Data":"4c6954042cafb39fc67e7c8ca07c7b02058059ef5e182ca4a75799b26240f116"} Sep 10 04:00:05.720113 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:05.720062 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-744b9444d8-bsdcr" podStartSLOduration=2.113331154 podStartE2EDuration="3.720048526s" totalImagesPullingTime="1.606717372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:00:05.717370853 +0000 UTC m=+719.804115423" watchObservedRunningTime="2026-09-10 04:00:05.720048526 +0000 UTC m=+719.806793088" Sep 10 04:00:05.745352 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:05.745314 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-grjjs"] Sep 10 04:00:05.745566 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:05.745537 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-grjjs" podUID="1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900" containerName="authorino" containerID="cri-o://df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527" gracePeriod=30 Sep 10 04:00:05.996000 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:05.995976 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-grjjs" Sep 10 04:00:06.099389 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.099355 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zjxm\" (UniqueName: \"kubernetes.io/projected/1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900-kube-api-access-7zjxm\") pod \"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900\" (UID: \"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900\") " Sep 10 04:00:06.101414 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.101382 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900-kube-api-access-7zjxm" (OuterVolumeSpecName: "kube-api-access-7zjxm") pod "1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900" (UID: "1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900"). InnerVolumeSpecName "kube-api-access-7zjxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:00:06.200277 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.200242 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zjxm\" (UniqueName: \"kubernetes.io/projected/1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900-kube-api-access-7zjxm\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 04:00:06.709442 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.709345 2581 generic.go:356] "Generic (PLEG): container finished" podID="1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900" containerID="df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527" exitCode=0 Sep 10 04:00:06.709442 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.709391 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-grjjs" Sep 10 04:00:06.709871 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.709431 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-grjjs" event={"ID":"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900","Type":"ContainerDied","Data":"df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527"} Sep 10 04:00:06.709871 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.709479 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-grjjs" event={"ID":"1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900","Type":"ContainerDied","Data":"36a518cac7cbf88eef72c4853862ab12ec66ef82aedf935855c8632a7642dced"} Sep 10 04:00:06.709871 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.709498 2581 scope.go:117] "RemoveContainer" containerID="df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527" Sep 10 04:00:06.718234 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.718213 2581 scope.go:117] "RemoveContainer" containerID="df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527" Sep 10 04:00:06.718562 ip-10-0-130-114 kubenswrapper[2581]: E0910 04:00:06.718535 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527\": container with ID starting with df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527 not found: ID does not exist" containerID="df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527" Sep 10 04:00:06.718636 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.718571 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527"} err="failed to get container status \"df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527\": rpc error: code = NotFound desc = could not find container \"df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527\": container with ID starting with df983cb86fd49119914c37c87dd754965fda8508ef32430f31c2b9205d0c2527 not found: ID does not exist" Sep 10 04:00:06.726451 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.726427 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-grjjs"] Sep 10 04:00:06.729900 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:06.729877 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-grjjs"] Sep 10 04:00:08.416718 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:08.416681 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900" path="/var/lib/kubelet/pods/1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900/volumes" Sep 10 04:00:10.450769 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.450731 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-849798d777-l4d2m"] Sep 10 04:00:10.451329 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.451162 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900" containerName="authorino" Sep 10 04:00:10.451329 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.451175 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900" containerName="authorino" Sep 10 04:00:10.451329 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.451317 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2cf8a6-eacb-4685-a0a4-9c0afeb1c900" containerName="authorino" Sep 10 04:00:10.600816 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.600784 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-849798d777-l4d2m"] Sep 10 04:00:10.601011 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.600921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.604545 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.604515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vrjrs\"" Sep 10 04:00:10.604670 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.604590 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 10 04:00:10.604670 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.604529 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 04:00:10.604780 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.604529 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 10 04:00:10.615086 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.615062 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c4575b7dc-89d7w"] Sep 10 04:00:10.618074 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.618052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.629571 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.629542 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c4575b7dc-89d7w"] Sep 10 04:00:10.636896 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.636864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw7gt\" (UniqueName: \"kubernetes.io/projected/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-kube-api-access-hw7gt\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.637063 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.636954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e0d64f-7b75-49c9-853f-411f9011f8df-webhook-cert\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.637063 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.636988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14e0d64f-7b75-49c9-853f-411f9011f8df-metrics-certs\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.637203 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.637086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv7kv\" (UniqueName: \"kubernetes.io/projected/14e0d64f-7b75-49c9-853f-411f9011f8df-kube-api-access-jv7kv\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.637203 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.637123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-webhook-cert\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.637203 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.637148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-metrics-certs\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.738645 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.738553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv7kv\" (UniqueName: \"kubernetes.io/projected/14e0d64f-7b75-49c9-853f-411f9011f8df-kube-api-access-jv7kv\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.738645 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.738590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-webhook-cert\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.738645 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.738608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-metrics-certs\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.738645 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.738649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7gt\" (UniqueName: \"kubernetes.io/projected/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-kube-api-access-hw7gt\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.738976 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.738682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e0d64f-7b75-49c9-853f-411f9011f8df-webhook-cert\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.738976 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.738697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14e0d64f-7b75-49c9-853f-411f9011f8df-metrics-certs\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.741184 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.741161 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14e0d64f-7b75-49c9-853f-411f9011f8df-webhook-cert\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.741316 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.741191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-metrics-certs\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.741453 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.741437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14e0d64f-7b75-49c9-853f-411f9011f8df-metrics-certs\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.741529 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.741512 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-webhook-cert\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.745845 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.745817 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw7gt\" (UniqueName: \"kubernetes.io/projected/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-kube-api-access-hw7gt\") pod \"maas-controller-849798d777-l4d2m\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.746182 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.746165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv7kv\" (UniqueName: \"kubernetes.io/projected/14e0d64f-7b75-49c9-853f-411f9011f8df-kube-api-access-jv7kv\") pod \"maas-controller-7c4575b7dc-89d7w\" (UID: \"14e0d64f-7b75-49c9-853f-411f9011f8df\") " pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:10.912475 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.912433 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:10.930536 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:10.930505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:11.188141 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:11.188115 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-849798d777-l4d2m"] Sep 10 04:00:11.190786 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:00:11.190760 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c3f7b1_62cf_467d_9ad4_15a08e14853c.slice/crio-a81eec7f1373a6172493d368ff4c9f12c21e82286b8b3bbbbeab76109207d903 WatchSource:0}: Error finding container a81eec7f1373a6172493d368ff4c9f12c21e82286b8b3bbbbeab76109207d903: Status 404 returned error can't find the container with id a81eec7f1373a6172493d368ff4c9f12c21e82286b8b3bbbbeab76109207d903 Sep 10 04:00:11.209324 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:11.209269 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c4575b7dc-89d7w"] Sep 10 04:00:11.211064 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:00:11.211038 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e0d64f_7b75_49c9_853f_411f9011f8df.slice/crio-c532c199925d977946f77618baf188afcebc7d7e77ba7b6085b09a90201b301d WatchSource:0}: Error finding container c532c199925d977946f77618baf188afcebc7d7e77ba7b6085b09a90201b301d: Status 404 returned error can't find the container with id c532c199925d977946f77618baf188afcebc7d7e77ba7b6085b09a90201b301d Sep 10 04:00:11.742840 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:11.742801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c4575b7dc-89d7w" event={"ID":"14e0d64f-7b75-49c9-853f-411f9011f8df","Type":"ContainerStarted","Data":"c532c199925d977946f77618baf188afcebc7d7e77ba7b6085b09a90201b301d"} Sep 10 04:00:11.744481 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:11.744447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-849798d777-l4d2m" event={"ID":"a9c3f7b1-62cf-467d-9ad4-15a08e14853c","Type":"ContainerStarted","Data":"a81eec7f1373a6172493d368ff4c9f12c21e82286b8b3bbbbeab76109207d903"} Sep 10 04:00:14.766516 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:14.766477 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c4575b7dc-89d7w" event={"ID":"14e0d64f-7b75-49c9-853f-411f9011f8df","Type":"ContainerStarted","Data":"4be997701f684bc9e60b90ec851154def42f35d760b70936c5192b3d0eaaa2f0"} Sep 10 04:00:14.766957 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:14.766592 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:14.768100 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:14.768076 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-849798d777-l4d2m" event={"ID":"a9c3f7b1-62cf-467d-9ad4-15a08e14853c","Type":"ContainerStarted","Data":"82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4"} Sep 10 04:00:14.768167 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:14.768154 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:14.783936 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:14.783890 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c4575b7dc-89d7w" podStartSLOduration=2.272221267 podStartE2EDuration="4.783875961s" totalImagesPullingTime="2.511654694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:00:14.782303558 +0000 UTC m=+728.869048114" watchObservedRunningTime="2026-09-10 04:00:14.783875961 +0000 UTC m=+728.870620523" Sep 10 04:00:14.798587 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:14.798539 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-849798d777-l4d2m" podStartSLOduration=2.254354123 podStartE2EDuration="4.798524191s" totalImagesPullingTime="2.544170068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:00:14.797436852 +0000 UTC m=+728.884181416" watchObservedRunningTime="2026-09-10 04:00:14.798524191 +0000 UTC m=+728.885268822" Sep 10 04:00:25.776680 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:25.776646 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c4575b7dc-89d7w" Sep 10 04:00:25.777129 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:25.776849 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:25.842686 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:25.842647 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-849798d777-l4d2m"] Sep 10 04:00:25.842927 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:25.842891 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-849798d777-l4d2m" podUID="a9c3f7b1-62cf-467d-9ad4-15a08e14853c" containerName="manager" containerID="cri-o://82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4" gracePeriod=30 Sep 10 04:00:26.091033 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.091003 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:26.188675 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.188639 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-webhook-cert\") pod \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " Sep 10 04:00:26.188861 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.188721 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw7gt\" (UniqueName: \"kubernetes.io/projected/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-kube-api-access-hw7gt\") pod \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " Sep 10 04:00:26.188861 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.188738 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-metrics-certs\") pod \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\" (UID: \"a9c3f7b1-62cf-467d-9ad4-15a08e14853c\") " Sep 10 04:00:26.190857 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.190820 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a9c3f7b1-62cf-467d-9ad4-15a08e14853c" (UID: "a9c3f7b1-62cf-467d-9ad4-15a08e14853c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:00:26.190964 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.190878 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-kube-api-access-hw7gt" (OuterVolumeSpecName: "kube-api-access-hw7gt") pod "a9c3f7b1-62cf-467d-9ad4-15a08e14853c" (UID: "a9c3f7b1-62cf-467d-9ad4-15a08e14853c"). InnerVolumeSpecName "kube-api-access-hw7gt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 04:00:26.190964 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.190904 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a9c3f7b1-62cf-467d-9ad4-15a08e14853c" (UID: "a9c3f7b1-62cf-467d-9ad4-15a08e14853c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 04:00:26.289512 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.289471 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-webhook-cert\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 04:00:26.289512 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.289501 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw7gt\" (UniqueName: \"kubernetes.io/projected/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-kube-api-access-hw7gt\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 04:00:26.289512 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.289510 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9c3f7b1-62cf-467d-9ad4-15a08e14853c-metrics-certs\") on node \"ip-10-0-130-114.ec2.internal\" DevicePath \"\"" Sep 10 04:00:26.838488 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.838394 2581 generic.go:356] "Generic (PLEG): container finished" podID="a9c3f7b1-62cf-467d-9ad4-15a08e14853c" containerID="82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4" exitCode=0 Sep 10 04:00:26.838488 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.838442 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-849798d777-l4d2m" Sep 10 04:00:26.838949 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.838487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-849798d777-l4d2m" event={"ID":"a9c3f7b1-62cf-467d-9ad4-15a08e14853c","Type":"ContainerDied","Data":"82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4"} Sep 10 04:00:26.838949 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.838553 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-849798d777-l4d2m" event={"ID":"a9c3f7b1-62cf-467d-9ad4-15a08e14853c","Type":"ContainerDied","Data":"a81eec7f1373a6172493d368ff4c9f12c21e82286b8b3bbbbeab76109207d903"} Sep 10 04:00:26.838949 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.838577 2581 scope.go:117] "RemoveContainer" containerID="82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4" Sep 10 04:00:26.847923 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.847761 2581 scope.go:117] "RemoveContainer" containerID="82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4" Sep 10 04:00:26.848068 ip-10-0-130-114 kubenswrapper[2581]: E0910 04:00:26.848051 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4\": container with ID starting with 82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4 not found: ID does not exist" containerID="82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4" Sep 10 04:00:26.848108 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.848075 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4"} err="failed to get container status \"82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4\": rpc error: code = NotFound desc = could not find container \"82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4\": container with ID starting with 82e7fb6b0cbf777c0a63a9e8a931bf56f6b8cea9efffc8408e00dbce3e913ec4 not found: ID does not exist" Sep 10 04:00:26.855330 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.855305 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-849798d777-l4d2m"] Sep 10 04:00:26.858581 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:26.858560 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-849798d777-l4d2m"] Sep 10 04:00:28.416682 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:28.416647 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c3f7b1-62cf-467d-9ad4-15a08e14853c" path="/var/lib/kubelet/pods/a9c3f7b1-62cf-467d-9ad4-15a08e14853c/volumes" Sep 10 04:00:48.598733 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.598693 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85746f7c44-wwh94"] Sep 10 04:00:48.599366 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.599150 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c3f7b1-62cf-467d-9ad4-15a08e14853c" containerName="manager" Sep 10 04:00:48.599366 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.599163 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c3f7b1-62cf-467d-9ad4-15a08e14853c" containerName="manager" Sep 10 04:00:48.599366 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.599232 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9c3f7b1-62cf-467d-9ad4-15a08e14853c" containerName="manager" Sep 10 04:00:48.605169 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.605140 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.608789 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.607979 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 10 04:00:48.608789 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.608059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 10 04:00:48.608789 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.608000 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fl6m9\"" Sep 10 04:00:48.610850 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.610825 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85746f7c44-wwh94"] Sep 10 04:00:48.797123 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.797083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl5fj\" (UniqueName: \"kubernetes.io/projected/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-kube-api-access-kl5fj\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.797123 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.797128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-metrics-certs\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.797395 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.797155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-maas-api-tls\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.797395 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.797172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-openshift-service-ca\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.898624 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.898592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-maas-api-tls\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.898624 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.898628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-openshift-service-ca\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.898818 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.898700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl5fj\" (UniqueName: \"kubernetes.io/projected/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-kube-api-access-kl5fj\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.898818 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.898724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-metrics-certs\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.899356 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.899332 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-openshift-service-ca\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.901321 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.901300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-metrics-certs\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.901435 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.901341 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-maas-api-tls\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.906390 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.906366 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl5fj\" (UniqueName: \"kubernetes.io/projected/2e7d97a7-8e1c-4683-90ab-6e3db06cf623-kube-api-access-kl5fj\") pod \"maas-api-85746f7c44-wwh94\" (UID: \"2e7d97a7-8e1c-4683-90ab-6e3db06cf623\") " pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:48.918264 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:48.918238 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:49.204622 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.204599 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85746f7c44-wwh94"] Sep 10 04:00:49.206862 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:00:49.206836 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7d97a7_8e1c_4683_90ab_6e3db06cf623.slice/crio-1c2fa50becfe799c66e80c23d4b6281a4b3089820282ee687b6552d2a2c9c3dd WatchSource:0}: Error finding container 1c2fa50becfe799c66e80c23d4b6281a4b3089820282ee687b6552d2a2c9c3dd: Status 404 returned error can't find the container with id 1c2fa50becfe799c66e80c23d4b6281a4b3089820282ee687b6552d2a2c9c3dd Sep 10 04:00:49.234272 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.234227 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-g52nf"] Sep 10 04:00:49.238705 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.238687 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:49.241010 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.240986 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 04:00:49.241086 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.241040 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bnxjf\"" Sep 10 04:00:49.249038 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.249010 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-g52nf"] Sep 10 04:00:49.303183 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.303149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcfws\" (UniqueName: \"kubernetes.io/projected/65c4f7d2-b3ef-4b6f-86e8-34688eafad9c-kube-api-access-kcfws\") pod \"payload-processing-5b54b7fbb7-g52nf\" (UID: \"65c4f7d2-b3ef-4b6f-86e8-34688eafad9c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:49.303362 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.303244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65c4f7d2-b3ef-4b6f-86e8-34688eafad9c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-g52nf\" (UID: \"65c4f7d2-b3ef-4b6f-86e8-34688eafad9c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:49.403999 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.403946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65c4f7d2-b3ef-4b6f-86e8-34688eafad9c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-g52nf\" (UID: \"65c4f7d2-b3ef-4b6f-86e8-34688eafad9c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:49.404196 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.404086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcfws\" (UniqueName: \"kubernetes.io/projected/65c4f7d2-b3ef-4b6f-86e8-34688eafad9c-kube-api-access-kcfws\") pod \"payload-processing-5b54b7fbb7-g52nf\" (UID: \"65c4f7d2-b3ef-4b6f-86e8-34688eafad9c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:49.404728 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.404700 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65c4f7d2-b3ef-4b6f-86e8-34688eafad9c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-g52nf\" (UID: \"65c4f7d2-b3ef-4b6f-86e8-34688eafad9c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:49.414367 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.414341 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcfws\" (UniqueName: \"kubernetes.io/projected/65c4f7d2-b3ef-4b6f-86e8-34688eafad9c-kube-api-access-kcfws\") pod \"payload-processing-5b54b7fbb7-g52nf\" (UID: \"65c4f7d2-b3ef-4b6f-86e8-34688eafad9c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:49.551357 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.551245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:49.833219 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.833188 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-g52nf"] Sep 10 04:00:49.835152 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:00:49.835127 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c4f7d2_b3ef_4b6f_86e8_34688eafad9c.slice/crio-7c98957a1ec59aeadccae006f28cd8a41259d90a366831a148237215d170693c WatchSource:0}: Error finding container 7c98957a1ec59aeadccae006f28cd8a41259d90a366831a148237215d170693c: Status 404 returned error can't find the container with id 7c98957a1ec59aeadccae006f28cd8a41259d90a366831a148237215d170693c Sep 10 04:00:49.982531 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.982497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" event={"ID":"2e7d97a7-8e1c-4683-90ab-6e3db06cf623","Type":"ContainerStarted","Data":"1c2fa50becfe799c66e80c23d4b6281a4b3089820282ee687b6552d2a2c9c3dd"} Sep 10 04:00:49.984385 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:49.984307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" event={"ID":"65c4f7d2-b3ef-4b6f-86e8-34688eafad9c","Type":"ContainerStarted","Data":"7c98957a1ec59aeadccae006f28cd8a41259d90a366831a148237215d170693c"} Sep 10 04:00:52.003467 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:52.003356 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" event={"ID":"2e7d97a7-8e1c-4683-90ab-6e3db06cf623","Type":"ContainerStarted","Data":"ad6024f99bfca89e146d69e1fef569f22c09bf3743ba0de7859f8100d23dc5ec"} Sep 10 04:00:52.003914 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:52.003546 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:00:52.004987 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:52.004962 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" event={"ID":"65c4f7d2-b3ef-4b6f-86e8-34688eafad9c","Type":"ContainerStarted","Data":"2f6b7be162444df322fb17131754b56160b0e5ef083709aade3c244d4de4e912"} Sep 10 04:00:52.005054 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:52.005009 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:00:52.021792 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:52.021731 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" podStartSLOduration=2.149782568 podStartE2EDuration="4.021711829s" totalImagesPullingTime="1.871929261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:00:52.01906808 +0000 UTC m=+766.105812644" watchObservedRunningTime="2026-09-10 04:00:52.021711829 +0000 UTC m=+766.108456393" Sep 10 04:00:52.036500 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:52.036446 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" podStartSLOduration=1.207826987 podStartE2EDuration="3.036427653s" totalImagesPullingTime="1.828600666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:00:52.033888473 +0000 UTC m=+766.120633038" watchObservedRunningTime="2026-09-10 04:00:52.036427653 +0000 UTC m=+766.123172216" Sep 10 04:00:58.018102 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:00:58.018071 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85746f7c44-wwh94" Sep 10 04:01:03.014851 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:03.014817 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-g52nf" Sep 10 04:01:47.235245 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.235149 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx"] Sep 10 04:01:47.239130 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.239107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.241584 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.241563 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 04:01:47.242703 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.242573 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 04:01:47.242703 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.242594 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4scvv\"" Sep 10 04:01:47.242894 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.242851 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 10 04:01:47.249577 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.249554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx"] Sep 10 04:01:47.340560 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.340525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.340740 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.340602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpw6c\" (UniqueName: \"kubernetes.io/projected/6895ff3d-0c3b-4773-aeef-71f04d27357c-kube-api-access-zpw6c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.340740 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.340677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.340740 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.340695 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6895ff3d-0c3b-4773-aeef-71f04d27357c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.340740 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.340726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.340885 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.340751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.441458 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.441424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpw6c\" (UniqueName: \"kubernetes.io/projected/6895ff3d-0c3b-4773-aeef-71f04d27357c-kube-api-access-zpw6c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.441637 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.441492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.441637 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.441511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6895ff3d-0c3b-4773-aeef-71f04d27357c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.441637 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.441529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.441637 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.441549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.441637 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.441574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.442008 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.441984 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.442084 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.442010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.442151 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.442078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.443944 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.443915 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6895ff3d-0c3b-4773-aeef-71f04d27357c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.444232 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.444215 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6895ff3d-0c3b-4773-aeef-71f04d27357c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.449324 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.449304 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpw6c\" (UniqueName: \"kubernetes.io/projected/6895ff3d-0c3b-4773-aeef-71f04d27357c-kube-api-access-zpw6c\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx\" (UID: \"6895ff3d-0c3b-4773-aeef-71f04d27357c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.550670 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.550580 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:47.824246 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:47.824217 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx"] Sep 10 04:01:47.825764 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:01:47.825736 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6895ff3d_0c3b_4773_aeef_71f04d27357c.slice/crio-06ed6f195855d152f0e21c6b63f539367da64cbc04044decd9d54026d59706d1 WatchSource:0}: Error finding container 06ed6f195855d152f0e21c6b63f539367da64cbc04044decd9d54026d59706d1: Status 404 returned error can't find the container with id 06ed6f195855d152f0e21c6b63f539367da64cbc04044decd9d54026d59706d1 Sep 10 04:01:48.346317 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:48.346249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" event={"ID":"6895ff3d-0c3b-4773-aeef-71f04d27357c","Type":"ContainerStarted","Data":"06ed6f195855d152f0e21c6b63f539367da64cbc04044decd9d54026d59706d1"} Sep 10 04:01:49.353739 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:49.353694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" event={"ID":"6895ff3d-0c3b-4773-aeef-71f04d27357c","Type":"ContainerStarted","Data":"f2760e5562f9f0429a52d2758fb7df204801dfe4c059c5727fbbd14e4e04590f"} Sep 10 04:01:49.371759 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:49.371705 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" podStartSLOduration=1.347848246 podStartE2EDuration="2.371688653s" totalImagesPullingTime="1.023840407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:01:49.36943962 +0000 UTC m=+823.456184184" watchObservedRunningTime="2026-09-10 04:01:49.371688653 +0000 UTC m=+823.458433216" Sep 10 04:01:57.551215 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:57.551158 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:57.551619 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:57.551248 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:57.563820 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:57.563794 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:01:58.419574 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:01:58.419543 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx" Sep 10 04:02:21.734968 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.734931 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk"] Sep 10 04:02:21.739581 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.739555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.742043 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.742017 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 04:02:21.751479 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.751433 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk"] Sep 10 04:02:21.764499 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.764465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.764675 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.764602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.764675 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.764637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.764801 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.764684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/829679b2-5530-4187-8688-29051464cbcb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.764801 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.764715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.764801 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.764751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49j9\" (UniqueName: \"kubernetes.io/projected/829679b2-5530-4187-8688-29051464cbcb-kube-api-access-n49j9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.865636 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.865596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.865636 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.865638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.865885 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.865664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/829679b2-5530-4187-8688-29051464cbcb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.865885 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.865692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.865885 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.865723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49j9\" (UniqueName: \"kubernetes.io/projected/829679b2-5530-4187-8688-29051464cbcb-kube-api-access-n49j9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.865885 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.865779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.866112 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.866068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.866112 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.866097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.866197 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.866167 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.868036 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.868007 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/829679b2-5530-4187-8688-29051464cbcb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.868216 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.868195 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/829679b2-5530-4187-8688-29051464cbcb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:21.874088 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:21.874062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49j9\" (UniqueName: \"kubernetes.io/projected/829679b2-5530-4187-8688-29051464cbcb-kube-api-access-n49j9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk\" (UID: \"829679b2-5530-4187-8688-29051464cbcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:22.066276 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:22.066188 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:22.340090 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:22.340062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk"] Sep 10 04:02:22.341873 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:02:22.341847 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829679b2_5530_4187_8688_29051464cbcb.slice/crio-70a7132d287207ed175296ee7f64ddaefc3a721bc9d50dda0e8f288143a96ce7 WatchSource:0}: Error finding container 70a7132d287207ed175296ee7f64ddaefc3a721bc9d50dda0e8f288143a96ce7: Status 404 returned error can't find the container with id 70a7132d287207ed175296ee7f64ddaefc3a721bc9d50dda0e8f288143a96ce7 Sep 10 04:02:22.557653 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:22.557623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" event={"ID":"829679b2-5530-4187-8688-29051464cbcb","Type":"ContainerStarted","Data":"70a7132d287207ed175296ee7f64ddaefc3a721bc9d50dda0e8f288143a96ce7"} Sep 10 04:02:23.569557 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:23.569511 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" event={"ID":"829679b2-5530-4187-8688-29051464cbcb","Type":"ContainerStarted","Data":"211efc864d8a2f579c24045c0a930ca29bde74ad9520820561c65cc7b6400810"} Sep 10 04:02:23.587707 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:23.587645 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" podStartSLOduration=2.417566418 podStartE2EDuration="2.587625235s" totalImagesPullingTime="170.058817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:02:23.58526985 +0000 UTC m=+857.672014415" watchObservedRunningTime="2026-09-10 04:02:23.587625235 +0000 UTC m=+857.674369802" Sep 10 04:02:32.067057 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:32.066999 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:32.067512 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:32.067113 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:32.079931 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:32.079904 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:02:32.635405 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:02:32.635374 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk" Sep 10 04:06:03.766598 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:03.766517 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744b9444d8-bsdcr_6dd73a91-672d-4056-b046-9ddaf6f5130e/authorino/0.log" Sep 10 04:06:09.062134 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:09.062098 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-64z86_5c93f3ad-f956-4630-ab3f-224a6feb7d92/manager/0.log" Sep 10 04:06:09.184481 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:09.184445 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-z2psr_de808e0a-5250-4082-8ead-9c32b05341ce/manager/0.log" Sep 10 04:06:09.305794 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:09.305730 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c4575b7dc-89d7w_14e0d64f-7b75-49c9-853f-411f9011f8df/manager/0.log" Sep 10 04:06:09.653781 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:09.653751 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-797557847b-2gtzp_96a19b26-034c-4782-9b8a-a8ca9e307554/copy-manifests/0.log" Sep 10 04:06:09.671802 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:09.671764 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-797557847b-2gtzp_96a19b26-034c-4782-9b8a-a8ca9e307554/manager/0.log" Sep 10 04:06:10.240884 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:10.240854 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-85746f7c44-wwh94_2e7d97a7-8e1c-4683-90ab-6e3db06cf623/maas-api/0.log" Sep 10 04:06:10.343888 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:10.343843 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4kc92_f54121c7-4fb7-42ae-b6e2-8849fb29cca7/postgres/0.log" Sep 10 04:06:11.153152 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:11.153117 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744b9444d8-bsdcr_6dd73a91-672d-4056-b046-9ddaf6f5130e/authorino/0.log" Sep 10 04:06:11.274724 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:11.274692 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-2ds47_7a2f124d-4e25-432a-95aa-fb86b169c938/manager/0.log" Sep 10 04:06:11.382462 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:11.382434 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dqrnd_c2a65d91-2a0e-4c69-afbb-0130b231bd5d/manager/0.log" Sep 10 04:06:11.622739 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:11.622646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-dlfhm_86716209-6114-4b8f-afac-fc08f6ecc768/manager/0.log" Sep 10 04:06:11.850572 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:11.850532 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-vlzzx_987cba77-5659-4f5f-8c8f-ed5b30c83106/manager/0.log" Sep 10 04:06:12.419491 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:12.419454 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcb5c9454-2plsm_9f105076-6819-47c5-a53d-bef1ab04af07/kube-auth-proxy/0.log" Sep 10 04:06:12.864545 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:12.864445 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-g52nf_65c4f7d2-b3ef-4b6f-86e8-34688eafad9c/payload-processing/0.log" Sep 10 04:06:12.980936 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:12.980905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6784b6bdfb-p2vsx_d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61/router/0.log" Sep 10 04:06:13.572113 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:13.572074 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-rwkkx_6895ff3d-0c3b-4773-aeef-71f04d27357c/main/0.log" Sep 10 04:06:13.800625 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:13.800597 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fstgfk_829679b2-5530-4187-8688-29051464cbcb/main/0.log" Sep 10 04:06:19.538589 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.538551 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5qpb6/must-gather-82xrt"] Sep 10 04:06:19.542732 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.542708 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qpb6/must-gather-82xrt" Sep 10 04:06:19.545151 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.545117 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5qpb6\"/\"kube-root-ca.crt\"" Sep 10 04:06:19.545151 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.545132 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5qpb6\"/\"openshift-service-ca.crt\"" Sep 10 04:06:19.545425 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.545215 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5qpb6\"/\"default-dockercfg-fppwb\"" Sep 10 04:06:19.550626 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.550430 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qpb6/must-gather-82xrt"] Sep 10 04:06:19.623785 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.623743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4a0565d-4726-4e4d-ad83-15f35d2a0b28-must-gather-output\") pod \"must-gather-82xrt\" (UID: \"c4a0565d-4726-4e4d-ad83-15f35d2a0b28\") " pod="openshift-must-gather-5qpb6/must-gather-82xrt" Sep 10 04:06:19.623785 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.623786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjh2n\" (UniqueName: \"kubernetes.io/projected/c4a0565d-4726-4e4d-ad83-15f35d2a0b28-kube-api-access-vjh2n\") pod \"must-gather-82xrt\" (UID: \"c4a0565d-4726-4e4d-ad83-15f35d2a0b28\") " pod="openshift-must-gather-5qpb6/must-gather-82xrt" Sep 10 04:06:19.724716 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.724678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4a0565d-4726-4e4d-ad83-15f35d2a0b28-must-gather-output\") pod \"must-gather-82xrt\" (UID: \"c4a0565d-4726-4e4d-ad83-15f35d2a0b28\") " pod="openshift-must-gather-5qpb6/must-gather-82xrt" Sep 10 04:06:19.724716 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.724718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjh2n\" (UniqueName: \"kubernetes.io/projected/c4a0565d-4726-4e4d-ad83-15f35d2a0b28-kube-api-access-vjh2n\") pod \"must-gather-82xrt\" (UID: \"c4a0565d-4726-4e4d-ad83-15f35d2a0b28\") " pod="openshift-must-gather-5qpb6/must-gather-82xrt" Sep 10 04:06:19.725059 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.725040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4a0565d-4726-4e4d-ad83-15f35d2a0b28-must-gather-output\") pod \"must-gather-82xrt\" (UID: \"c4a0565d-4726-4e4d-ad83-15f35d2a0b28\") " pod="openshift-must-gather-5qpb6/must-gather-82xrt" Sep 10 04:06:19.732750 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.732715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjh2n\" (UniqueName: \"kubernetes.io/projected/c4a0565d-4726-4e4d-ad83-15f35d2a0b28-kube-api-access-vjh2n\") pod \"must-gather-82xrt\" (UID: \"c4a0565d-4726-4e4d-ad83-15f35d2a0b28\") " pod="openshift-must-gather-5qpb6/must-gather-82xrt" Sep 10 04:06:19.853425 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:19.853342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qpb6/must-gather-82xrt" Sep 10 04:06:20.125130 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:20.125100 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qpb6/must-gather-82xrt"] Sep 10 04:06:20.126750 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:06:20.126717 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4a0565d_4726_4e4d_ad83_15f35d2a0b28.slice/crio-975be21648a677d327e29f09d16057e8691bd518e1344f6e1f116f9a69d307af WatchSource:0}: Error finding container 975be21648a677d327e29f09d16057e8691bd518e1344f6e1f116f9a69d307af: Status 404 returned error can't find the container with id 975be21648a677d327e29f09d16057e8691bd518e1344f6e1f116f9a69d307af Sep 10 04:06:20.128631 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:20.128607 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 04:06:21.005502 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:21.005427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qpb6/must-gather-82xrt" event={"ID":"c4a0565d-4726-4e4d-ad83-15f35d2a0b28","Type":"ContainerStarted","Data":"975be21648a677d327e29f09d16057e8691bd518e1344f6e1f116f9a69d307af"} Sep 10 04:06:22.017221 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:22.017179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qpb6/must-gather-82xrt" event={"ID":"c4a0565d-4726-4e4d-ad83-15f35d2a0b28","Type":"ContainerStarted","Data":"eccf95f16c028c07cb8b5a25ef5698ea91e19388353c6d3fade1d2990a947f5b"} Sep 10 04:06:22.017716 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:22.017234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qpb6/must-gather-82xrt" event={"ID":"c4a0565d-4726-4e4d-ad83-15f35d2a0b28","Type":"ContainerStarted","Data":"e489a2efc55a64cd33b1cb4bc16c44fe1777570c84a66882e167e1456500024d"} Sep 10 04:06:22.033026 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:22.032964 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5qpb6/must-gather-82xrt" podStartSLOduration=2.2099904280000002 podStartE2EDuration="3.032939992s" totalImagesPullingTime="822.949564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:06:22.031370903 +0000 UTC m=+1096.118115466" watchObservedRunningTime="2026-09-10 04:06:22.032939992 +0000 UTC m=+1096.119684558" Sep 10 04:06:22.615951 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:22.615917 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jmwqm_18f2981a-c311-4911-a567-44284bb8e026/global-pull-secret-syncer/0.log" Sep 10 04:06:22.700121 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:22.700075 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jlhcl_2c477870-a33b-4127-ae85-853dd8e11e71/konnectivity-agent/0.log" Sep 10 04:06:22.745647 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:22.745608 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-114.ec2.internal_9806b07f29bbc4ff6eec20e03f82108e/haproxy/0.log" Sep 10 04:06:27.229804 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:27.229766 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744b9444d8-bsdcr_6dd73a91-672d-4056-b046-9ddaf6f5130e/authorino/0.log" Sep 10 04:06:27.272704 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:27.272672 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-2ds47_7a2f124d-4e25-432a-95aa-fb86b169c938/manager/0.log" Sep 10 04:06:27.303599 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:27.303520 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dqrnd_c2a65d91-2a0e-4c69-afbb-0130b231bd5d/manager/0.log" Sep 10 04:06:27.384374 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:27.384336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-dlfhm_86716209-6114-4b8f-afac-fc08f6ecc768/manager/0.log" Sep 10 04:06:27.459481 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:27.459447 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-vlzzx_987cba77-5659-4f5f-8c8f-ed5b30c83106/manager/0.log" Sep 10 04:06:28.959556 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:28.959521 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_be24ef12-dbaa-4ea9-b055-5054bd058492/alertmanager/0.log" Sep 10 04:06:28.981321 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:28.981192 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_be24ef12-dbaa-4ea9-b055-5054bd058492/config-reloader/0.log" Sep 10 04:06:29.002874 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.002841 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_be24ef12-dbaa-4ea9-b055-5054bd058492/kube-rbac-proxy-web/0.log" Sep 10 04:06:29.026252 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.026220 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_be24ef12-dbaa-4ea9-b055-5054bd058492/kube-rbac-proxy/0.log" Sep 10 04:06:29.046871 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.046829 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_be24ef12-dbaa-4ea9-b055-5054bd058492/kube-rbac-proxy-metric/0.log" Sep 10 04:06:29.067487 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.067456 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_be24ef12-dbaa-4ea9-b055-5054bd058492/prom-label-proxy/0.log" Sep 10 04:06:29.107810 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.107779 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_be24ef12-dbaa-4ea9-b055-5054bd058492/init-config-reloader/0.log" Sep 10 04:06:29.195983 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.195946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fvp48_374b5d7d-e75c-4a9b-8301-eec1cf4a85fa/kube-state-metrics/0.log" Sep 10 04:06:29.214249 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.214168 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fvp48_374b5d7d-e75c-4a9b-8301-eec1cf4a85fa/kube-rbac-proxy-main/0.log" Sep 10 04:06:29.236807 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.236772 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fvp48_374b5d7d-e75c-4a9b-8301-eec1cf4a85fa/kube-rbac-proxy-self/0.log" Sep 10 04:06:29.262265 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.262233 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-858d5cb4b5-rj6qc_f72de098-56a2-4f6e-9635-24982d6cfe3e/metrics-server/0.log" Sep 10 04:06:29.396233 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.396195 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtb6b_264049a8-55b8-4220-a3d9-6054a0bfa34d/node-exporter/0.log" Sep 10 04:06:29.420322 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.420275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtb6b_264049a8-55b8-4220-a3d9-6054a0bfa34d/kube-rbac-proxy/0.log" Sep 10 04:06:29.441862 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.441828 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtb6b_264049a8-55b8-4220-a3d9-6054a0bfa34d/init-textfile/0.log" Sep 10 04:06:29.553119 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.553024 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-j6frq_4085e644-1593-428e-b3f2-662a960bf84e/kube-rbac-proxy-main/0.log" Sep 10 04:06:29.582323 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.581002 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-j6frq_4085e644-1593-428e-b3f2-662a960bf84e/kube-rbac-proxy-self/0.log" Sep 10 04:06:29.623148 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.623113 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-j6frq_4085e644-1593-428e-b3f2-662a960bf84e/openshift-state-metrics/0.log" Sep 10 04:06:29.831419 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.831336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-9rgzm_f1b1cd0d-3367-48f0-b35e-e472bff32e91/prometheus-operator/0.log" Sep 10 04:06:29.865439 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.865402 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-9rgzm_f1b1cd0d-3367-48f0-b35e-e472bff32e91/kube-rbac-proxy/0.log" Sep 10 04:06:29.925784 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.925753 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-765645f455-dt5gx_94a2854a-b630-4786-a5db-f4f0d424a282/telemeter-client/0.log" Sep 10 04:06:29.953338 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.953305 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-765645f455-dt5gx_94a2854a-b630-4786-a5db-f4f0d424a282/reload/0.log" Sep 10 04:06:29.978220 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:29.978176 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-765645f455-dt5gx_94a2854a-b630-4786-a5db-f4f0d424a282/kube-rbac-proxy/0.log" Sep 10 04:06:32.648257 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.648217 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89"] Sep 10 04:06:32.655445 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.655404 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.660567 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.660533 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89"] Sep 10 04:06:32.767980 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.767938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-proc\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.768215 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.767998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-lib-modules\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.768215 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.768045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-sys\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.768215 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.768124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-podres\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.768215 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.768163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zzjm\" (UniqueName: \"kubernetes.io/projected/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-kube-api-access-9zzjm\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.868822 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.868783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-podres\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.869016 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.868846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zzjm\" (UniqueName: \"kubernetes.io/projected/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-kube-api-access-9zzjm\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.869016 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.868924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-podres\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.869016 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.868948 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-proc\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.869016 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.868982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-lib-modules\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.869233 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.869023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-sys\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.869233 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.869057 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-proc\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.869233 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.869119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-sys\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.869233 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.869151 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-lib-modules\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.876956 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.876928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zzjm\" (UniqueName: \"kubernetes.io/projected/a822c8a5-fc71-4ef8-af0f-3c1ff155439c-kube-api-access-9zzjm\") pod \"perf-node-gather-daemonset-l9z89\" (UID: \"a822c8a5-fc71-4ef8-af0f-3c1ff155439c\") " pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:32.939248 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.939162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-m4mkr_c2091742-d9b8-4dcf-8434-fdceed03a21d/download-server/0.log" Sep 10 04:06:32.971131 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:32.971086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:33.286439 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:33.286075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89"] Sep 10 04:06:33.287360 ip-10-0-130-114 kubenswrapper[2581]: W0910 04:06:33.287333 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda822c8a5_fc71_4ef8_af0f_3c1ff155439c.slice/crio-98d022a098dd803d2137e5c64f2a020dd7d201bb93b9bb4cc1349f6690138611 WatchSource:0}: Error finding container 98d022a098dd803d2137e5c64f2a020dd7d201bb93b9bb4cc1349f6690138611: Status 404 returned error can't find the container with id 98d022a098dd803d2137e5c64f2a020dd7d201bb93b9bb4cc1349f6690138611 Sep 10 04:06:34.135188 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:34.135145 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" event={"ID":"a822c8a5-fc71-4ef8-af0f-3c1ff155439c","Type":"ContainerStarted","Data":"3712d1f208f9667b2546ff5ac2bee75e6aeda6d8ba8c7d0116a1c65f8bc3b40d"} Sep 10 04:06:34.135702 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:34.135210 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" event={"ID":"a822c8a5-fc71-4ef8-af0f-3c1ff155439c","Type":"ContainerStarted","Data":"98d022a098dd803d2137e5c64f2a020dd7d201bb93b9bb4cc1349f6690138611"} Sep 10 04:06:34.135702 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:34.135331 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:34.153077 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:34.153009 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" podStartSLOduration=2.152988118 podStartE2EDuration="2.152988118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:06:34.151388789 +0000 UTC m=+1108.238133353" watchObservedRunningTime="2026-09-10 04:06:34.152988118 +0000 UTC m=+1108.239732683" Sep 10 04:06:34.706621 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:34.706587 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hlft4_cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b/dns/0.log" Sep 10 04:06:34.727916 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:34.727888 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hlft4_cdd86512-4fbf-4dbf-b6ed-7976dd3f5d8b/kube-rbac-proxy/0.log" Sep 10 04:06:34.797798 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:34.797743 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5j58k_7904bd49-0bf4-408c-bd29-4122534b2ffe/dns-node-resolver/0.log" Sep 10 04:06:35.380516 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:35.380487 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jthcf_3fef3c33-f7c3-4733-9d77-a4380a911689/node-ca/0.log" Sep 10 04:06:36.407747 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:36.407711 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcb5c9454-2plsm_9f105076-6819-47c5-a53d-bef1ab04af07/kube-auth-proxy/0.log" Sep 10 04:06:36.496219 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:36.496183 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-g52nf_65c4f7d2-b3ef-4b6f-86e8-34688eafad9c/payload-processing/0.log" Sep 10 04:06:36.522967 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:36.522933 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6784b6bdfb-p2vsx_d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61/router/0.log" Sep 10 04:06:37.198939 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:37.198884 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cwnls_a930973d-eaaf-4e09-910f-6692ba283bd1/serve-healthcheck-canary/0.log" Sep 10 04:06:37.705371 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:37.705335 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-qdc2w_fc13a35e-4c61-402a-a875-ec9e25d0b975/insights-operator/1.log" Sep 10 04:06:37.705771 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:37.705458 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-qdc2w_fc13a35e-4c61-402a-a875-ec9e25d0b975/insights-operator/0.log" Sep 10 04:06:37.854925 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:37.854891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlmgn_81d21465-4c2e-45c2-82d5-2dc0fbbe5604/kube-rbac-proxy/0.log" Sep 10 04:06:37.874322 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:37.874292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlmgn_81d21465-4c2e-45c2-82d5-2dc0fbbe5604/exporter/0.log" Sep 10 04:06:37.896646 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:37.896590 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlmgn_81d21465-4c2e-45c2-82d5-2dc0fbbe5604/extractor/0.log" Sep 10 04:06:39.991527 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:39.991495 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-64z86_5c93f3ad-f956-4630-ab3f-224a6feb7d92/manager/0.log" Sep 10 04:06:40.035001 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:40.034966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-z2psr_de808e0a-5250-4082-8ead-9c32b05341ce/manager/0.log" Sep 10 04:06:40.074260 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:40.074231 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c4575b7dc-89d7w_14e0d64f-7b75-49c9-853f-411f9011f8df/manager/0.log" Sep 10 04:06:40.156928 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:40.156899 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5qpb6/perf-node-gather-daemonset-l9z89" Sep 10 04:06:40.206804 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:40.206758 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-797557847b-2gtzp_96a19b26-034c-4782-9b8a-a8ca9e307554/manager/0.log" Sep 10 04:06:40.224312 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:40.224264 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-797557847b-2gtzp_96a19b26-034c-4782-9b8a-a8ca9e307554/copy-manifests/0.log" Sep 10 04:06:41.639363 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:41.639323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4mlvm_8a63a5c9-6cb1-4dc8-80f2-a0660183b9ee/openshift-lws-operator/0.log" Sep 10 04:06:43.353963 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:43.353930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcb5c9454-2plsm_9f105076-6819-47c5-a53d-bef1ab04af07/kube-auth-proxy/0.log" Sep 10 04:06:43.418428 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:43.418393 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-g52nf_65c4f7d2-b3ef-4b6f-86e8-34688eafad9c/payload-processing/0.log" Sep 10 04:06:43.440356 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:43.440329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6784b6bdfb-p2vsx_d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61/router/0.log" Sep 10 04:06:44.608227 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:44.608152 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcb5c9454-2plsm_9f105076-6819-47c5-a53d-bef1ab04af07/kube-auth-proxy/0.log" Sep 10 04:06:44.670096 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:44.670064 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-g52nf_65c4f7d2-b3ef-4b6f-86e8-34688eafad9c/payload-processing/0.log" Sep 10 04:06:44.691010 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:44.690983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6784b6bdfb-p2vsx_d0dcb7aa-e9d3-430c-86a0-5ed0dee78e61/router/0.log" Sep 10 04:06:47.170507 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:47.170472 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-92ltf_21d44376-0129-4670-a02f-069e1c10446e/kube-storage-version-migrator-operator/1.log" Sep 10 04:06:47.171848 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:47.171822 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-92ltf_21d44376-0129-4670-a02f-069e1c10446e/kube-storage-version-migrator-operator/0.log" Sep 10 04:06:48.469776 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.469749 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl45v_9e808c01-d8f7-4a4e-a515-139306ee349a/kube-multus-additional-cni-plugins/0.log" Sep 10 04:06:48.490059 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.490027 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl45v_9e808c01-d8f7-4a4e-a515-139306ee349a/egress-router-binary-copy/0.log" Sep 10 04:06:48.508878 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.508851 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl45v_9e808c01-d8f7-4a4e-a515-139306ee349a/cni-plugins/0.log" Sep 10 04:06:48.527430 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.527405 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl45v_9e808c01-d8f7-4a4e-a515-139306ee349a/bond-cni-plugin/0.log" Sep 10 04:06:48.547018 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.546991 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl45v_9e808c01-d8f7-4a4e-a515-139306ee349a/routeoverride-cni/0.log" Sep 10 04:06:48.566367 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.566344 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl45v_9e808c01-d8f7-4a4e-a515-139306ee349a/whereabouts-cni-bincopy/0.log" Sep 10 04:06:48.586093 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.586065 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cl45v_9e808c01-d8f7-4a4e-a515-139306ee349a/whereabouts-cni/0.log" Sep 10 04:06:48.631516 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.631485 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dkzjx_c1462abc-77ef-4c23-a61d-1608ebe5e587/kube-multus/0.log" Sep 10 04:06:48.826735 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.826646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qbqrq_c4de56fa-4cd4-4d54-84d5-393d7ef36599/network-metrics-daemon/0.log" Sep 10 04:06:48.848333 ip-10-0-130-114 kubenswrapper[2581]: I0910 04:06:48.848302 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qbqrq_c4de56fa-4cd4-4d54-84d5-393d7ef36599/kube-rbac-proxy/0.log"