Jun 11 11:32:39.175165 ip-10-0-129-217 systemd[1]: Starting Kubernetes Kubelet... Jun 11 11:32:39.576629 ip-10-0-129-217 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 11:32:39.576629 ip-10-0-129-217 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 11:32:39.576629 ip-10-0-129-217 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 11:32:39.576629 ip-10-0-129-217 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 11:32:39.576629 ip-10-0-129-217 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 11:32:39.578258 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.578173 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 11:32:39.583111 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583092 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:32:39.583111 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583109 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:32:39.583111 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583113 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583117 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583121 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583123 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583126 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583128 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583131 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583134 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583137 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583140 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583142 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583145 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583147 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583150 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583154 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583157 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583160 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583163 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583165 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583167 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:32:39.583241 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583170 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583172 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583175 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583183 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583186 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583189 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583191 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583194 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583196 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583199 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583201 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583204 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583207 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583209 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583212 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583216 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583225 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583228 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583230 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583233 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:32:39.583809 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583235 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583238 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583240 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583243 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583245 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583248 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583251 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583253 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583256 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583258 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583261 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583263 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583266 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583268 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583270 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583273 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583275 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583278 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583280 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583282 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:32:39.584462 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583284 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583287 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583289 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583292 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583294 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583297 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583300 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583303 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583305 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583313 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583316 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583318 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583321 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583323 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583326 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583330 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583333 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583337 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583340 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:32:39.585056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583343 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583346 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583349 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583352 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583354 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583357 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583360 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583362 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583365 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583367 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583370 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583372 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583375 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583377 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583381 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583384 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583386 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.583389 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584225 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584234 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:32:39.585611 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584237 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584240 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584243 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584246 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584249 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584252 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584254 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584257 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584259 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584262 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584264 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584266 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584269 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584272 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584274 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584277 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584280 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584282 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584285 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584287 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:32:39.586211 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584290 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584293 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584295 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584298 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584300 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584303 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584306 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584308 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584311 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584313 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584317 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584322 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584326 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584329 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584332 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584335 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584343 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584346 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:32:39.586815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584350 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584353 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584356 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584358 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584361 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584364 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584366 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584369 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584371 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584374 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584377 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584379 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584382 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584384 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584387 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584389 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584392 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584394 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584397 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:32:39.587392 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584399 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584402 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584405 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584407 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584410 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584412 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584415 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584418 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584421 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584423 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584426 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584429 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584432 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584434 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584437 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584439 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584442 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584444 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584446 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584449 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:32:39.587980 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584451 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584454 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584456 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584460 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584462 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584465 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584468 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584471 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584473 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584476 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584479 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584481 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584484 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584486 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584490 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584492 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584495 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584499 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584502 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584505 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:32:39.588562 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584926 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584932 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584935 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584938 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584941 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584944 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584946 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584949 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584952 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584954 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584957 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584959 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584962 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584964 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584968 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584972 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584974 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584977 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584980 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:32:39.589080 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584983 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584986 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584989 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584991 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584994 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584996 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.584999 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585001 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585004 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585006 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585009 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585014 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585017 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585020 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585023 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585025 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585028 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585030 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585033 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585036 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:32:39.589549 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585038 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585041 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585043 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585046 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585049 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585051 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585054 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585056 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585059 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585061 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585064 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585067 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585070 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585075 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585078 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585081 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585084 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585087 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585090 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:32:39.590089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585094 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585096 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585099 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585101 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585106 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585108 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585111 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585114 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585116 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585118 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585121 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585124 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585127 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585130 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585132 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585134 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585137 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585139 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585141 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585144 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:32:39.590557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585146 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585148 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585151 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585153 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585155 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585158 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585160 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585162 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585165 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585167 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585170 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585173 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585176 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585178 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585181 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585183 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585190 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585192 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585195 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585197 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:32:39.591058 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585200 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585279 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585290 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585300 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585307 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585318 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585325 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585331 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585338 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585343 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585349 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585352 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585356 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585359 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585362 2560 flags.go:64] FLAG: --cgroup-root="" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585365 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585368 2560 flags.go:64] FLAG: --client-ca-file="" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585371 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585373 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585377 2560 flags.go:64] FLAG: --cluster-domain="" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585380 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585383 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585386 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585391 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 11:32:39.591577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585395 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585398 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585401 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585405 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585408 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585411 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585414 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585417 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585420 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585424 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585427 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585429 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585432 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585435 2560 flags.go:64] FLAG: --enable-server="true" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585438 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585444 2560 flags.go:64] FLAG: --event-burst="100" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585447 2560 flags.go:64] FLAG: --event-qps="50" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585449 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585453 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585456 2560 flags.go:64] FLAG: --eviction-hard="" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585460 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585462 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585465 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585468 2560 flags.go:64] FLAG: --eviction-soft="" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585471 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 11:32:39.592194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585474 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585476 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585479 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585482 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585484 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585487 2560 flags.go:64] FLAG: --feature-gates="" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585497 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585500 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585504 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585507 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585510 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585514 2560 flags.go:64] FLAG: --help="false" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585517 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585520 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585522 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585525 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585528 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585532 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585534 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585537 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585540 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585543 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585546 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585549 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 11:32:39.592971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585552 2560 flags.go:64] FLAG: --kube-reserved="" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585555 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585558 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585561 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585563 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585566 2560 flags.go:64] FLAG: --lock-file="" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585569 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585571 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585575 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585580 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585583 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585585 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585588 2560 flags.go:64] FLAG: --logging-format="text" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585591 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585595 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585598 2560 flags.go:64] FLAG: --manifest-url="" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585601 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585605 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585608 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585614 2560 flags.go:64] FLAG: --max-pods="110" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585617 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585620 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585623 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585626 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585629 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 11:32:39.594039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585631 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585634 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585642 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585645 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585648 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585651 2560 flags.go:64] FLAG: --pod-cidr="" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585654 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585660 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585663 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585666 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585669 2560 flags.go:64] FLAG: --port="10250" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585672 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585675 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dd67fd9f3ed9780c" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585678 2560 flags.go:64] FLAG: --qos-reserved="" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585681 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585684 2560 flags.go:64] FLAG: --register-node="true" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585687 2560 flags.go:64] FLAG: --register-with-taints="" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585690 2560 flags.go:64] FLAG: --registry-burst="10" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585693 2560 flags.go:64] FLAG: --registry-qps="5" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585696 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585698 2560 flags.go:64] FLAG: --reserved-memory="" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585702 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585705 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585708 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585711 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 11:32:39.595107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585714 2560 flags.go:64] FLAG: --runonce="false" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585717 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585720 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585723 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585725 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585728 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585731 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585734 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585737 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585739 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585742 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585745 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585747 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585750 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585753 2560 flags.go:64] FLAG: --system-cgroups="" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585756 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585761 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585764 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585766 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585770 2560 flags.go:64] FLAG: --tls-min-version="" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585773 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585775 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585778 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585781 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585783 2560 flags.go:64] FLAG: --v="2" Jun 11 11:32:39.596222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585787 2560 flags.go:64] FLAG: --version="false" Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585791 2560 flags.go:64] FLAG: --vmodule="" Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585794 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.585798 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585946 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585950 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585953 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585957 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585961 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585964 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585966 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585969 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585972 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585974 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585977 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585979 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585982 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585984 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585986 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585989 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:32:39.597106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585992 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585994 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.585997 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586000 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586003 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586005 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586008 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586010 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586013 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586015 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586018 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586020 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586022 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586025 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586027 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586030 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586033 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586035 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586038 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586040 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:32:39.597693 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586043 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586046 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586048 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586051 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586054 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586056 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586059 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586061 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586064 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586066 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586069 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586071 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586073 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586076 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586078 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586084 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586087 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586089 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586093 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586096 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:32:39.598616 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586099 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586101 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586104 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586106 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586109 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586111 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586113 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586116 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586118 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586121 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586123 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586125 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586128 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586130 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586133 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586135 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586138 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586142 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586145 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586148 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:32:39.599320 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586150 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586153 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586155 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586158 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586160 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586162 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586165 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586167 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586170 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586172 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586175 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586177 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586180 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586182 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586185 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586187 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586191 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586194 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586197 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:32:39.599978 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586201 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586204 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586207 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.586209 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.586972 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.595204 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.595227 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.595255 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.595269 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595358 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595366 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595372 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595376 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595380 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595384 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:32:39.600459 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595388 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595393 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595397 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595401 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595405 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595409 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595413 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595418 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595422 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595426 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595430 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595434 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595438 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595442 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595447 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595451 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595455 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595459 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595464 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595468 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:32:39.600856 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595472 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595476 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595480 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595486 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595490 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595495 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595499 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595503 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595507 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595511 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595515 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595519 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595524 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595528 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595532 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595536 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595540 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595544 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595548 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:32:39.601382 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595552 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595556 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595561 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595565 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595569 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595574 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595580 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595585 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595591 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595595 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595600 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595604 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595609 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595613 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595617 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595621 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595626 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595631 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595636 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:32:39.601898 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595640 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595646 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595652 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595656 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595660 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595665 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595669 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595673 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595678 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595684 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595689 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595695 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595699 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595703 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595707 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595711 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595715 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595720 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595724 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:32:39.602516 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595727 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595732 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595736 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595740 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595744 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595748 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595753 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595757 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595761 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595765 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595771 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595775 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595780 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595784 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595788 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:32:39.603025 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.595792 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.595801 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596029 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596040 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596045 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596050 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596055 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596060 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596065 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596069 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596074 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596078 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596082 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596087 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596091 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:32:39.603418 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596096 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596100 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596104 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596109 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596114 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596118 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596121 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596126 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596130 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596133 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596138 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596142 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596147 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596151 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596156 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596161 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596165 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596169 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596173 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:32:39.603879 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596177 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596181 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596185 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596189 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596193 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596198 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596202 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596206 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596209 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596214 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596217 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596221 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596225 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596229 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596232 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596236 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596239 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596243 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596247 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:32:39.604356 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596251 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596257 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596264 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596270 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596274 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596279 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596283 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596288 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596292 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596296 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596301 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596306 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596310 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596314 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596318 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596323 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596327 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596331 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596336 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596340 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:32:39.605089 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596343 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596348 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596352 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596356 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596360 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596364 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596368 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596373 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596377 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596381 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596385 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596389 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596395 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596401 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596406 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596411 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596415 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596420 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596424 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596428 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:32:39.605807 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596432 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596437 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596441 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596446 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596450 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596457 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596462 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:39.596467 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.596475 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.596659 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.599696 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.601387 2560 server.go:1019] "Starting client certificate rotation" Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.601485 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 11:32:39.606604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.601520 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 11:32:39.607013 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.605185 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 11:32:39.608661 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.608642 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 11:32:39.623628 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.623608 2560 log.go:25] "Validated CRI v1 runtime API" Jun 11 11:32:39.626750 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.626734 2560 log.go:25] "Validated CRI v1 image API" Jun 11 11:32:39.627557 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.627530 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 11:32:39.631076 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.631058 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 11:32:39.631432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.631401 2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87094b28-8725-4a57-b50a-0301ed7865d6:/dev/nvme0n1p4 d4c650ef-418f-403b-96b8-a764b9adee36:/dev/nvme0n1p3] Jun 11 11:32:39.631476 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.631433 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 11:32:39.636642 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.636532 2560 manager.go:216] Machine: {Timestamp:2026-06-11 11:32:39.636022562 +0000 UTC m=+0.340030261 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099736 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec231515f29e49d36a9771865cfe72f0 SystemUUID:ec231515-f29e-49d3-6a97-71865cfe72f0 BootID:b7d3e83a-44db-42b5-9e68-869537dd8b61 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7d:61:cb:ff:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7d:61:cb:ff:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:de:93:ad:a7:7b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 11:32:39.636642 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.636637 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 11:32:39.636758 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.636720 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 11:32:39.639671 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.639640 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 11:32:39.639813 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.639674 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-217.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 11:32:39.640620 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.640610 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 11:32:39.640654 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.640623 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 11:32:39.640654 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.640632 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 11:32:39.641476 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.641465 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 11:32:39.642702 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.642692 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 11:32:39.646457 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.646445 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 11 11:32:39.646583 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.646573 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 11:32:39.646621 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.646612 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 11 11:32:39.646650 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.646643 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 11:32:39.646677 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.646662 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 11:32:39.646713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.646677 2560 kubelet.go:398] "Adding apiserver pod source" Jun 11 11:32:39.646713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.646689 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 11:32:39.647181 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.647169 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 11:32:39.647233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.647187 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 11:32:39.649643 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.649628 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 11:32:39.651375 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.651361 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 11:32:39.651427 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.651392 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 11:32:39.652642 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652629 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 11:32:39.652706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652650 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 11:32:39.652706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652660 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 11:32:39.652706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652668 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 11:32:39.652706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652678 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 11:32:39.652706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652683 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 11:32:39.652706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652691 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 11:32:39.652706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652696 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 11:32:39.653069 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652715 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 11:32:39.653069 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652721 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 11:32:39.653069 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652736 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 11:32:39.653069 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.652742 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 11:32:39.653550 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.653537 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 11:32:39.653591 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.653553 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 11:32:39.656849 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.656834 2560 server.go:1268] "Started kubelet" Jun 11 11:32:39.656970 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.656939 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 11:32:39.657109 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.657040 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 11:32:39.657172 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.657134 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 11:32:39.658115 ip-10-0-129-217 systemd[1]: Started Kubernetes Kubelet. Jun 11 11:32:39.662784 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.662734 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-217.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 11:32:39.662784 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.662781 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 11 11:32:39.662974 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.662946 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 11:32:39.662974 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.662948 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 11:32:39.665571 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.665545 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 11:32:39.665655 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.665629 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 11:32:39.666399 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.665526 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-217.ec2.internal.18b8038dad3db39d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-217.ec2.internal,UID:ip-10-0-129-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-217.ec2.internal,},FirstTimestamp:2026-06-11 11:32:39.656805277 +0000 UTC m=+0.360812976,LastTimestamp:2026-06-11 11:32:39.656805277 +0000 UTC m=+0.360812976,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-217.ec2.internal,}" Jun 11 11:32:39.672135 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.672116 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 11:32:39.672238 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.672139 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 11:32:39.672238 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.672211 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:39.672848 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.672828 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 11:32:39.672942 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.672852 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 11:32:39.673000 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.672992 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 11 11:32:39.673053 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673002 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 11 11:32:39.673053 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673002 2560 factory.go:55] Registering systemd factory Jun 11 11:32:39.673053 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673026 2560 factory.go:223] Registration of the systemd container factory successfully Jun 11 11:32:39.673352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673151 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 11:32:39.673352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673261 2560 factory.go:153] Registering CRI-O factory Jun 11 11:32:39.673352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673274 2560 factory.go:223] Registration of the crio container factory successfully Jun 11 11:32:39.673352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673318 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 11:32:39.673352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673345 2560 factory.go:103] Registering Raw factory Jun 11 11:32:39.673352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673357 2560 manager.go:1196] Started watching for new ooms in manager Jun 11 11:32:39.673816 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.673791 2560 manager.go:349] Starting recovery of all containers Jun 11 11:32:39.678281 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.678251 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 11:32:39.678367 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.678273 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 11:32:39.684140 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.684024 2560 manager.go:354] Recovery completed Jun 11 11:32:39.688594 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.688582 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:32:39.690390 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.690363 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:32:39.690465 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.690409 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:32:39.690465 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.690425 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:32:39.691026 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.691010 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 11:32:39.691092 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.691027 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 11:32:39.691092 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.691044 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 11 11:32:39.691092 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.691044 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:32:39.692701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.692247 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:32:39.692701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.692280 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:32:39.692701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.692311 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:32:39.692841 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.692740 2560 policy_none.go:49] "None policy: Start" Jun 11 11:32:39.692841 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.692777 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 11:32:39.692841 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.692790 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 11:32:39.693916 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.693905 2560 policy_none.go:47] "Start" Jun 11 11:32:39.704341 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.704275 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-217.ec2.internal.18b8038daf3e2c5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-217.ec2.internal,UID:ip-10-0-129-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-217.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-217.ec2.internal,},FirstTimestamp:2026-06-11 11:32:39.690390619 +0000 UTC m=+0.394398330,LastTimestamp:2026-06-11 11:32:39.690390619 +0000 UTC m=+0.394398330,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-217.ec2.internal,}" Jun 11 11:32:39.720035 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.719969 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-217.ec2.internal.18b8038daf3e9183 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-217.ec2.internal,UID:ip-10-0-129-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-217.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-217.ec2.internal,},FirstTimestamp:2026-06-11 11:32:39.690416515 +0000 UTC m=+0.394424215,LastTimestamp:2026-06-11 11:32:39.690416515 +0000 UTC m=+0.394424215,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-217.ec2.internal,}" Jun 11 11:32:39.729493 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.729477 2560 manager.go:337] "Starting Device Plugin manager" Jun 11 11:32:39.729589 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.729514 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 11:32:39.729589 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.729527 2560 server.go:87] "Starting device plugin registration server" Jun 11 11:32:39.729775 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.729765 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 11:32:39.730023 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.729778 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 11:32:39.730023 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.729918 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 11:32:39.730023 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.730014 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 11:32:39.730023 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.730024 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 11:32:39.730706 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.730677 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 11:32:39.730783 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.730734 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:39.735002 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.733074 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-217.ec2.internal.18b8038daf3ec879 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-217.ec2.internal,UID:ip-10-0-129-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-217.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-217.ec2.internal,},FirstTimestamp:2026-06-11 11:32:39.690430585 +0000 UTC m=+0.394438285,LastTimestamp:2026-06-11 11:32:39.690430585 +0000 UTC m=+0.394438285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-217.ec2.internal,}" Jun 11 11:32:39.735002 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.733934 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hx42t" Jun 11 11:32:39.744324 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.744307 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hx42t" Jun 11 11:32:39.751691 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.746045 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-217.ec2.internal.18b8038daf3e2c5b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-217.ec2.internal.18b8038daf3e2c5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-217.ec2.internal,UID:ip-10-0-129-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-217.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-217.ec2.internal,},FirstTimestamp:2026-06-11 11:32:39.690390619 +0000 UTC m=+0.394398330,LastTimestamp:2026-06-11 11:32:39.692263651 +0000 UTC m=+0.396271353,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-217.ec2.internal,}" Jun 11 11:32:39.753977 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.753953 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 11:32:39.755308 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.755291 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 11:32:39.755377 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.755338 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 11:32:39.755377 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.755361 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 11:32:39.755475 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.755399 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 11:32:39.757813 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.757796 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:32:39.830130 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.830071 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:32:39.831321 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.831303 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:32:39.831381 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.831341 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:32:39.831381 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.831355 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:32:39.831381 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.831378 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.841554 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.841532 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.841614 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.841554 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-217.ec2.internal\": node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:39.856068 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.856045 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal"] Jun 11 11:32:39.856130 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.856106 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:32:39.856920 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.856901 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:32:39.857001 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.856932 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:32:39.857001 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.856942 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:32:39.858331 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.858319 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:32:39.858483 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.858470 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.858527 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.858499 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:32:39.859071 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.859053 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:32:39.859139 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.859087 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:32:39.859139 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.859098 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:32:39.859139 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.859055 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:32:39.859242 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.859154 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:32:39.859242 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.859168 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:32:39.860385 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.860369 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.860432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.860399 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:32:39.861093 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.861076 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:32:39.861187 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.861107 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:32:39.861187 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.861117 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:32:39.894118 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.894097 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:39.896584 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.896563 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-217.ec2.internal\" not found" node="ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.901121 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.901103 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-217.ec2.internal\" not found" node="ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.974013 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.973972 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45fd46cdb00075c41be9450fd694dc7c-config\") pod \"kube-apiserver-proxy-ip-10-0-129-217.ec2.internal\" (UID: \"45fd46cdb00075c41be9450fd694dc7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.974013 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.974011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9b4cc43de3e9e696a83953c85e36d46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal\" (UID: \"d9b4cc43de3e9e696a83953c85e36d46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.974213 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:39.974037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9b4cc43de3e9e696a83953c85e36d46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal\" (UID: \"d9b4cc43de3e9e696a83953c85e36d46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:39.995164 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:39.995136 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:40.074922 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.074886 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9b4cc43de3e9e696a83953c85e36d46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal\" (UID: \"d9b4cc43de3e9e696a83953c85e36d46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.074922 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.074918 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9b4cc43de3e9e696a83953c85e36d46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal\" (UID: \"d9b4cc43de3e9e696a83953c85e36d46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.075129 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.074936 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45fd46cdb00075c41be9450fd694dc7c-config\") pod \"kube-apiserver-proxy-ip-10-0-129-217.ec2.internal\" (UID: \"45fd46cdb00075c41be9450fd694dc7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.075129 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.074992 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9b4cc43de3e9e696a83953c85e36d46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal\" (UID: \"d9b4cc43de3e9e696a83953c85e36d46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.075129 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.075000 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9b4cc43de3e9e696a83953c85e36d46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal\" (UID: \"d9b4cc43de3e9e696a83953c85e36d46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.075129 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.075042 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45fd46cdb00075c41be9450fd694dc7c-config\") pod \"kube-apiserver-proxy-ip-10-0-129-217.ec2.internal\" (UID: \"45fd46cdb00075c41be9450fd694dc7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.096022 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.095965 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:40.196801 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.196773 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:40.201896 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.201861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.206654 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.206637 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.297383 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.297339 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:40.397983 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.397908 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-217.ec2.internal\" not found" Jun 11 11:32:40.486638 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.486613 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:32:40.534654 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.534629 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:32:40.572530 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.572500 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.600963 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.600935 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 11:32:40.601585 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.601088 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 11:32:40.601585 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.601093 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 11:32:40.601585 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.601104 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 11:32:40.601585 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.601115 2560 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a40f8121fe7154dd2af16302447d5718-1c4814b770cbb56d.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.129.217:59310->44.196.100.59:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.601585 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.601148 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" Jun 11 11:32:40.640462 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.640437 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 11:32:40.647577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.647559 2560 apiserver.go:52] "Watching apiserver" Jun 11 11:32:40.663051 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.663021 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 11:32:40.663386 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.663365 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs","openshift-multus/multus-additional-cni-plugins-7cptv","openshift-multus/multus-l42bh","openshift-network-diagnostics/network-check-target-6n7lf","openshift-network-operator/iptables-alerter-j2spn","openshift-cluster-node-tuning-operator/tuned-vvflm","openshift-dns/node-resolver-qvm9q","openshift-image-registry/node-ca-s6gz4","openshift-multus/network-metrics-daemon-w59m5","openshift-ovn-kubernetes/ovnkube-node-c4rbm","kube-system/global-pull-secret-syncer-fxm9p","kube-system/konnectivity-agent-898tl"] Jun 11 11:32:40.664842 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.664802 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:40.664934 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.664908 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:40.665896 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.665860 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.667116 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.667097 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.668479 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.668459 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.669662 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.669645 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.670384 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.670361 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 11:32:40.670470 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.670367 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 11:32:40.670470 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.670408 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 11:32:40.670746 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.670729 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:40.670825 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.670787 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:40.672079 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.672067 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.672496 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.672468 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 11:32:40.675196 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.675176 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.676012 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.675722 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.677461 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.677440 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.678394 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41d8809e-95af-4f01-aca2-7b36c577b865-cni-binary-copy\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.678476 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.678476 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678417 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-sys-fs\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.678476 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-system-cni-dir\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.678476 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678463 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-cni-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.678602 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-sys\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.678602 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-log-socket\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.678602 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-hostroot\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.678602 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-lib-modules\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.678602 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678564 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-kubelet\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.678602 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678586 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-cni-bin\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.678602 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678603 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41d8809e-95af-4f01-aca2-7b36c577b865-multus-daemon-config\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgc7\" (UniqueName: \"kubernetes.io/projected/41d8809e-95af-4f01-aca2-7b36c577b865-kube-api-access-jxgc7\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-systemd-units\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-cni-bin\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-env-overrides\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678703 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-etc-kubernetes\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678775 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovnkube-config\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678794 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovn-node-metrics-cert\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc2gh\" (UniqueName: \"kubernetes.io/projected/f118d35e-a4dd-433d-a14c-9c26a4695c2c-kube-api-access-sc2gh\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-netns\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.678856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678891 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gt8m\" (UniqueName: \"kubernetes.io/projected/8228dc0e-7573-43b0-a60b-e93a41563026-kube-api-access-4gt8m\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-ovn\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678935 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-cni-netd\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678972 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f118d35e-a4dd-433d-a14c-9c26a4695c2c-iptables-alerter-script\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.678993 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-os-release\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.678990 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679013 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysctl-d\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovnkube-script-lib\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679073 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpt5m\" (UniqueName: \"kubernetes.io/projected/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-kube-api-access-gpt5m\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679089 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f118d35e-a4dd-433d-a14c-9c26a4695c2c-host-slash\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-socket-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.679460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679185 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-cni-multus\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-kubernetes\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-run\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8228dc0e-7573-43b0-a60b-e93a41563026-etc-tuned\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-var-lib-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-os-release\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679302 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-socket-dir-parent\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679326 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysctl-conf\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-run-netns\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2dc9\" (UniqueName: \"kubernetes.io/projected/111958e3-6ee9-4ad1-8492-63eec7bd967f-kube-api-access-r2dc9\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgmj4\" (UniqueName: \"kubernetes.io/projected/9d37760a-114d-46e7-9333-26f83577bb7e-kube-api-access-dgmj4\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-conf-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-modprobe-d\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-cnibin\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-kubelet\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679465 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysconfig\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679480 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-systemd\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-var-lib-kubelet\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-multus-certs\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-slash\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679556 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-systemd\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-etc-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679644 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-registration-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-cnibin\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-system-cni-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-host\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679712 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8228dc0e-7573-43b0-a60b-e93a41563026-tmp\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679741 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-device-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679807 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.680691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-node-log\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.681175 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-k8s-cni-cncf-io\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.681175 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkxg5\" (UniqueName: \"kubernetes.io/projected/7e1f5764-f329-441a-8b48-0809878ca25f-kube-api-access-pkxg5\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:40.681175 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.679935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.681175 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.680148 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-898tl" Jun 11 11:32:40.688548 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.688527 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 11:32:40.689037 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.689017 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 11:32:40.689300 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.689288 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 11:32:40.689604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.689585 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 11:32:40.690843 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:40.690818 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fd46cdb00075c41be9450fd694dc7c.slice/crio-a4e0566dbeda18a15d301e51dbd21cfe1be92b515f310e4587357fe4895bed6d WatchSource:0}: Error finding container a4e0566dbeda18a15d301e51dbd21cfe1be92b515f310e4587357fe4895bed6d: Status 404 returned error can't find the container with id a4e0566dbeda18a15d301e51dbd21cfe1be92b515f310e4587357fe4895bed6d Jun 11 11:32:40.691187 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:40.691172 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b4cc43de3e9e696a83953c85e36d46.slice/crio-9cc1cf1a8cce6ee7068df7f42ba11806899f6cce55ab16efedae9e10c9dd9da6 WatchSource:0}: Error finding container 9cc1cf1a8cce6ee7068df7f42ba11806899f6cce55ab16efedae9e10c9dd9da6: Status 404 returned error can't find the container with id 9cc1cf1a8cce6ee7068df7f42ba11806899f6cce55ab16efedae9e10c9dd9da6 Jun 11 11:32:40.697665 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.697650 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-89gz6\"" Jun 11 11:32:40.697813 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.697786 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 11:32:40.699924 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.699903 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 11:32:40.700145 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.699903 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 11:32:40.702807 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.702790 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 11:32:40.702930 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.702831 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:32:40.703004 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.702987 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 11:32:40.703114 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703039 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 11:32:40.703218 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703193 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 11:32:40.703432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703412 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 11:32:40.703432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703456 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:32:40.703432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703466 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rtgmb\"" Jun 11 11:32:40.703432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703489 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 11:32:40.703432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703547 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 11:32:40.703432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703646 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 11:32:40.703432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703670 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 11:32:40.703432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.703722 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 11:32:40.704149 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.704075 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 11:32:40.704690 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.704528 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 11:32:40.704690 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.704575 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-99c2v\"" Jun 11 11:32:40.704690 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.704584 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-68xtr\"" Jun 11 11:32:40.704690 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.704651 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 11:32:40.704878 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.704743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wqmsw\"" Jun 11 11:32:40.705060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.705044 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ghg6q\"" Jun 11 11:32:40.705141 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.705094 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v2nmd\"" Jun 11 11:32:40.705313 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.705187 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 11:32:40.709846 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.709831 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2jl8j\"" Jun 11 11:32:40.747000 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.746953 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 11:27:39 +0000 UTC" deadline="2027-12-05 05:51:50.082290751 +0000 UTC" Jun 11 11:32:40.747000 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.746996 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13002h19m9.335297637s" Jun 11 11:32:40.747125 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.747069 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 11:32:40.747178 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.747156 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 11:32:40.747593 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.747580 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r46qp\"" Jun 11 11:32:40.759321 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.759281 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" event={"ID":"45fd46cdb00075c41be9450fd694dc7c","Type":"ContainerStarted","Data":"a4e0566dbeda18a15d301e51dbd21cfe1be92b515f310e4587357fe4895bed6d"} Jun 11 11:32:40.760280 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.760260 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" event={"ID":"d9b4cc43de3e9e696a83953c85e36d46","Type":"ContainerStarted","Data":"9cc1cf1a8cce6ee7068df7f42ba11806899f6cce55ab16efedae9e10c9dd9da6"} Jun 11 11:32:40.760425 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.760411 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 11:32:40.774045 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.774029 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 11:32:40.780318 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780300 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-netns\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.780367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780329 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.780367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780346 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gt8m\" (UniqueName: \"kubernetes.io/projected/8228dc0e-7573-43b0-a60b-e93a41563026-kube-api-access-4gt8m\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.780367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-ovn\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.780473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780419 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-netns\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.780508 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780478 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.780552 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-cni-netd\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.781134 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780922 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-cni-netd\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.781134 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780935 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-ovn\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.781134 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.780929 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f118d35e-a4dd-433d-a14c-9c26a4695c2c-iptables-alerter-script\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.781134 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-os-release\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.781134 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781097 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-os-release\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.781417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysctl-d\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.781417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781202 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.781417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovnkube-script-lib\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.781417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781268 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpt5m\" (UniqueName: \"kubernetes.io/projected/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-kube-api-access-gpt5m\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.781417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f118d35e-a4dd-433d-a14c-9c26a4695c2c-host-slash\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.781417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31891d8d-f705-46ba-97a0-8434dd96a1a0-host\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.781417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:40.781417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-socket-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781457 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-cni-multus\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781485 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-kubernetes\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-run\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8228dc0e-7573-43b0-a60b-e93a41563026-etc-tuned\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781545 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f118d35e-a4dd-433d-a14c-9c26a4695c2c-iptables-alerter-script\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f118d35e-a4dd-433d-a14c-9c26a4695c2c-host-slash\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.781665 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:40.781755 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781715 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-kubernetes\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.782170 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.781769 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:32:41.281718931 +0000 UTC m=+1.985726621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:40.782170 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-run\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.782170 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.781843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-socket-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.782313 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782174 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782372 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782427 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-cni-multus\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-var-lib-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-os-release\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782560 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-socket-dir-parent\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31891d8d-f705-46ba-97a0-8434dd96a1a0-serviceca\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-tmp-dir\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysctl-conf\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782671 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-run-netns\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dc9\" (UniqueName: \"kubernetes.io/projected/111958e3-6ee9-4ad1-8492-63eec7bd967f-kube-api-access-r2dc9\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782720 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgmj4\" (UniqueName: \"kubernetes.io/projected/9d37760a-114d-46e7-9333-26f83577bb7e-kube-api-access-dgmj4\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-conf-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-modprobe-d\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-hosts-file\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-cnibin\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-kubelet\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.783713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782890 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysconfig\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-systemd\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-var-lib-kubelet\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.782991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c99f213-6cd1-4c2f-966d-f15153a79e7d-konnectivity-ca\") pod \"konnectivity-agent-898tl\" (UID: \"1c99f213-6cd1-4c2f-966d-f15153a79e7d\") " pod="kube-system/konnectivity-agent-898tl" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783017 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-multus-certs\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783032 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovnkube-script-lib\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-slash\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783100 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-slash\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-systemd\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-etc-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783349 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783401 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-registration-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783410 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-var-lib-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-cnibin\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-system-cni-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783476 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-os-release\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.784580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783486 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-host\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-socket-dir-parent\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783546 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-host\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783563 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8228dc0e-7573-43b0-a60b-e93a41563026-tmp\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783605 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-conf-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783783 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-run-netns\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783808 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-registration-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783859 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-multus-certs\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783936 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysctl-d\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.783973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysctl-conf\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784009 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784037 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-sysconfig\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784047 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-device-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-var-lib-kubelet\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784078 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-cnibin\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.785297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784148 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-system-cni-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784200 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-systemd\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784208 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-device-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-modprobe-d\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-etc-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784309 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-cnibin\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784429 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-kubelet\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784488 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-etc-systemd\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-node-log\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784635 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxzz2\" (UniqueName: \"kubernetes.io/projected/31891d8d-f705-46ba-97a0-8434dd96a1a0-kube-api-access-bxzz2\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784948 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-node-log\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.784994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-k8s-cni-cncf-io\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785024 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a97b11c1-5f78-445c-abb6-f256b3df4283-kubelet-config\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785047 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpq9k\" (UniqueName: \"kubernetes.io/projected/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-kube-api-access-mpq9k\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.785984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785073 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkxg5\" (UniqueName: \"kubernetes.io/projected/7e1f5764-f329-441a-8b48-0809878ca25f-kube-api-access-pkxg5\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785092 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-run-k8s-cni-cncf-io\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785231 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41d8809e-95af-4f01-aca2-7b36c577b865-cni-binary-copy\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785249 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785266 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-59xmb" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785304 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-sys-fs\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-system-cni-dir\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785345 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785361 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-cni-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-sys\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-log-socket\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785408 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/111958e3-6ee9-4ad1-8492-63eec7bd967f-sys-fs\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785471 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d37760a-114d-46e7-9333-26f83577bb7e-system-cni-dir\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785485 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-multus-cni-dir\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-hostroot\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785533 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-log-socket\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.786619 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785546 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-lib-modules\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785561 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d37760a-114d-46e7-9333-26f83577bb7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-kubelet\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785669 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-lib-modules\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c99f213-6cd1-4c2f-966d-f15153a79e7d-agent-certs\") pod \"konnectivity-agent-898tl\" (UID: \"1c99f213-6cd1-4c2f-966d-f15153a79e7d\") " pod="kube-system/konnectivity-agent-898tl" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785640 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-kubelet\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8228dc0e-7573-43b0-a60b-e93a41563026-sys\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785575 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-hostroot\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-cni-bin\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41d8809e-95af-4f01-aca2-7b36c577b865-multus-daemon-config\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785759 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-host-var-lib-cni-bin\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785768 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgc7\" (UniqueName: \"kubernetes.io/projected/41d8809e-95af-4f01-aca2-7b36c577b865-kube-api-access-jxgc7\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785777 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41d8809e-95af-4f01-aca2-7b36c577b865-cni-binary-copy\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785791 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-systemd-units\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-cni-bin\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785837 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-systemd-units\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785777 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8228dc0e-7573-43b0-a60b-e93a41563026-etc-tuned\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-env-overrides\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-host-cni-bin\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a97b11c1-5f78-445c-abb6-f256b3df4283-dbus\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.785956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-etc-kubernetes\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786003 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41d8809e-95af-4f01-aca2-7b36c577b865-etc-kubernetes\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovnkube-config\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786074 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-run-openvswitch\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovn-node-metrics-cert\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786142 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc2gh\" (UniqueName: \"kubernetes.io/projected/f118d35e-a4dd-433d-a14c-9c26a4695c2c-kube-api-access-sc2gh\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41d8809e-95af-4f01-aca2-7b36c577b865-multus-daemon-config\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786286 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-env-overrides\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786442 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8228dc0e-7573-43b0-a60b-e93a41563026-tmp\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.787686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.786507 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovnkube-config\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.788067 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.788050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-ovn-node-metrics-cert\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.793835 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.793818 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-59xmb" Jun 11 11:32:40.800715 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.800696 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2dc9\" (UniqueName: \"kubernetes.io/projected/111958e3-6ee9-4ad1-8492-63eec7bd967f-kube-api-access-r2dc9\") pod \"aws-ebs-csi-driver-node-7lmxs\" (UID: \"111958e3-6ee9-4ad1-8492-63eec7bd967f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.800830 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.800801 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpt5m\" (UniqueName: \"kubernetes.io/projected/a2149b2c-27c4-4438-b7b6-3b7d2d565abf-kube-api-access-gpt5m\") pod \"ovnkube-node-c4rbm\" (UID: \"a2149b2c-27c4-4438-b7b6-3b7d2d565abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:40.800911 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.800839 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgmj4\" (UniqueName: \"kubernetes.io/projected/9d37760a-114d-46e7-9333-26f83577bb7e-kube-api-access-dgmj4\") pod \"multus-additional-cni-plugins-7cptv\" (UID: \"9d37760a-114d-46e7-9333-26f83577bb7e\") " pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.801368 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.801352 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gt8m\" (UniqueName: \"kubernetes.io/projected/8228dc0e-7573-43b0-a60b-e93a41563026-kube-api-access-4gt8m\") pod \"tuned-vvflm\" (UID: \"8228dc0e-7573-43b0-a60b-e93a41563026\") " pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:40.813008 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.812985 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:32:40.813008 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.813004 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:32:40.813008 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.813013 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ftzmn for pod openshift-network-diagnostics/network-check-target-6n7lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:40.813221 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.813066 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn podName:67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:41.313050999 +0000 UTC m=+2.017058686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ftzmn" (UniqueName: "kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn") pod "network-check-target-6n7lf" (UID: "67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:40.813586 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.813569 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc2gh\" (UniqueName: \"kubernetes.io/projected/f118d35e-a4dd-433d-a14c-9c26a4695c2c-kube-api-access-sc2gh\") pod \"iptables-alerter-j2spn\" (UID: \"f118d35e-a4dd-433d-a14c-9c26a4695c2c\") " pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:40.815989 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.815971 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgc7\" (UniqueName: \"kubernetes.io/projected/41d8809e-95af-4f01-aca2-7b36c577b865-kube-api-access-jxgc7\") pod \"multus-l42bh\" (UID: \"41d8809e-95af-4f01-aca2-7b36c577b865\") " pod="openshift-multus/multus-l42bh" Jun 11 11:32:40.817718 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.817701 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkxg5\" (UniqueName: \"kubernetes.io/projected/7e1f5764-f329-441a-8b48-0809878ca25f-kube-api-access-pkxg5\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:40.886465 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c99f213-6cd1-4c2f-966d-f15153a79e7d-agent-certs\") pod \"konnectivity-agent-898tl\" (UID: \"1c99f213-6cd1-4c2f-966d-f15153a79e7d\") " pod="kube-system/konnectivity-agent-898tl" Jun 11 11:32:40.886636 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a97b11c1-5f78-445c-abb6-f256b3df4283-dbus\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.886636 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31891d8d-f705-46ba-97a0-8434dd96a1a0-host\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.886636 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31891d8d-f705-46ba-97a0-8434dd96a1a0-serviceca\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.886636 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886565 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-tmp-dir\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.886636 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-hosts-file\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886635 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31891d8d-f705-46ba-97a0-8434dd96a1a0-host\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886683 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c99f213-6cd1-4c2f-966d-f15153a79e7d-konnectivity-ca\") pod \"konnectivity-agent-898tl\" (UID: \"1c99f213-6cd1-4c2f-966d-f15153a79e7d\") " pod="kube-system/konnectivity-agent-898tl" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886692 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a97b11c1-5f78-445c-abb6-f256b3df4283-dbus\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886736 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886744 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-hosts-file\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886764 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxzz2\" (UniqueName: \"kubernetes.io/projected/31891d8d-f705-46ba-97a0-8434dd96a1a0-kube-api-access-bxzz2\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a97b11c1-5f78-445c-abb6-f256b3df4283-kubelet-config\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpq9k\" (UniqueName: \"kubernetes.io/projected/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-kube-api-access-mpq9k\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.886835 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:40.886926 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:40.886912 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret podName:a97b11c1-5f78-445c-abb6-f256b3df4283 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:41.386893356 +0000 UTC m=+2.090901046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret") pod "global-pull-secret-syncer-fxm9p" (UID: "a97b11c1-5f78-445c-abb6-f256b3df4283") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:40.887242 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.886942 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a97b11c1-5f78-445c-abb6-f256b3df4283-kubelet-config\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:40.887242 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.887034 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-tmp-dir\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.887299 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.887253 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c99f213-6cd1-4c2f-966d-f15153a79e7d-konnectivity-ca\") pod \"konnectivity-agent-898tl\" (UID: \"1c99f213-6cd1-4c2f-966d-f15153a79e7d\") " pod="kube-system/konnectivity-agent-898tl" Jun 11 11:32:40.887685 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.887661 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31891d8d-f705-46ba-97a0-8434dd96a1a0-serviceca\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.888980 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.888961 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c99f213-6cd1-4c2f-966d-f15153a79e7d-agent-certs\") pod \"konnectivity-agent-898tl\" (UID: \"1c99f213-6cd1-4c2f-966d-f15153a79e7d\") " pod="kube-system/konnectivity-agent-898tl" Jun 11 11:32:40.909666 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.909643 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpq9k\" (UniqueName: \"kubernetes.io/projected/be25bbe1-df37-40cc-8eb0-e7d7114f24b8-kube-api-access-mpq9k\") pod \"node-resolver-qvm9q\" (UID: \"be25bbe1-df37-40cc-8eb0-e7d7114f24b8\") " pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:40.910555 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.910536 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxzz2\" (UniqueName: \"kubernetes.io/projected/31891d8d-f705-46ba-97a0-8434dd96a1a0-kube-api-access-bxzz2\") pod \"node-ca-s6gz4\" (UID: \"31891d8d-f705-46ba-97a0-8434dd96a1a0\") " pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:40.988469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.988395 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" Jun 11 11:32:40.993329 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:40.993310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7cptv" Jun 11 11:32:40.997106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:40.997081 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111958e3_6ee9_4ad1_8492_63eec7bd967f.slice/crio-6d11c876972b2efc48535f662752c1be4582d8e2ae88e58b4636dc6b8a26b686 WatchSource:0}: Error finding container 6d11c876972b2efc48535f662752c1be4582d8e2ae88e58b4636dc6b8a26b686: Status 404 returned error can't find the container with id 6d11c876972b2efc48535f662752c1be4582d8e2ae88e58b4636dc6b8a26b686 Jun 11 11:32:41.001358 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:41.001335 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d37760a_114d_46e7_9333_26f83577bb7e.slice/crio-f5eb0036e62edfef8ba10f5b2e3d3b67bd0fd72b736c4cd9c773cb5d024158b7 WatchSource:0}: Error finding container f5eb0036e62edfef8ba10f5b2e3d3b67bd0fd72b736c4cd9c773cb5d024158b7: Status 404 returned error can't find the container with id f5eb0036e62edfef8ba10f5b2e3d3b67bd0fd72b736c4cd9c773cb5d024158b7 Jun 11 11:32:41.001439 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.001389 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l42bh" Jun 11 11:32:41.007228 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.007201 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:32:41.008904 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:41.008882 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d8809e_95af_4f01_aca2_7b36c577b865.slice/crio-41d8dd952c770ca3aa2f7924e7a7bd6db5b701024f008118f96e19fa6754745f WatchSource:0}: Error finding container 41d8dd952c770ca3aa2f7924e7a7bd6db5b701024f008118f96e19fa6754745f: Status 404 returned error can't find the container with id 41d8dd952c770ca3aa2f7924e7a7bd6db5b701024f008118f96e19fa6754745f Jun 11 11:32:41.012144 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.012129 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j2spn" Jun 11 11:32:41.017023 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:41.016999 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2149b2c_27c4_4438_b7b6_3b7d2d565abf.slice/crio-6d13469481ad8813ac9ed4f68ca6b3870e1773a38f0daf262f2f2d30c3aa7614 WatchSource:0}: Error finding container 6d13469481ad8813ac9ed4f68ca6b3870e1773a38f0daf262f2f2d30c3aa7614: Status 404 returned error can't find the container with id 6d13469481ad8813ac9ed4f68ca6b3870e1773a38f0daf262f2f2d30c3aa7614 Jun 11 11:32:41.017428 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.017410 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvflm" Jun 11 11:32:41.021003 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:41.020980 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf118d35e_a4dd_433d_a14c_9c26a4695c2c.slice/crio-f3d15de80139a6e6edafa74112bd1ca529b079c1f451e15994dcdc47d2e91a42 WatchSource:0}: Error finding container f3d15de80139a6e6edafa74112bd1ca529b079c1f451e15994dcdc47d2e91a42: Status 404 returned error can't find the container with id f3d15de80139a6e6edafa74112bd1ca529b079c1f451e15994dcdc47d2e91a42 Jun 11 11:32:41.022940 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.022925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qvm9q" Jun 11 11:32:41.027348 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:41.025718 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8228dc0e_7573_43b0_a60b_e93a41563026.slice/crio-4cab4c2f215becae82870ed28a89c92b24bc564299251a1de5d5415272227928 WatchSource:0}: Error finding container 4cab4c2f215becae82870ed28a89c92b24bc564299251a1de5d5415272227928: Status 404 returned error can't find the container with id 4cab4c2f215becae82870ed28a89c92b24bc564299251a1de5d5415272227928 Jun 11 11:32:41.028397 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.028352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s6gz4" Jun 11 11:32:41.032375 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:41.032350 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe25bbe1_df37_40cc_8eb0_e7d7114f24b8.slice/crio-97df4e4eb64e93c73e9b151d2fde1cab423bdfa1fc45a26188caa3515dc663aa WatchSource:0}: Error finding container 97df4e4eb64e93c73e9b151d2fde1cab423bdfa1fc45a26188caa3515dc663aa: Status 404 returned error can't find the container with id 97df4e4eb64e93c73e9b151d2fde1cab423bdfa1fc45a26188caa3515dc663aa Jun 11 11:32:41.032841 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.032822 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-898tl" Jun 11 11:32:41.036230 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:41.036211 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31891d8d_f705_46ba_97a0_8434dd96a1a0.slice/crio-7e0afbd214fb66d378651cb6adadfcb8125bb861d360bab20ac075a741e6fba3 WatchSource:0}: Error finding container 7e0afbd214fb66d378651cb6adadfcb8125bb861d360bab20ac075a741e6fba3: Status 404 returned error can't find the container with id 7e0afbd214fb66d378651cb6adadfcb8125bb861d360bab20ac075a741e6fba3 Jun 11 11:32:41.040829 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:32:41.040811 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c99f213_6cd1_4c2f_966d_f15153a79e7d.slice/crio-7be0aceb96e59dd9061b748ba54ee495b64f985178d727e86ca3f33dc25cac90 WatchSource:0}: Error finding container 7be0aceb96e59dd9061b748ba54ee495b64f985178d727e86ca3f33dc25cac90: Status 404 returned error can't find the container with id 7be0aceb96e59dd9061b748ba54ee495b64f985178d727e86ca3f33dc25cac90 Jun 11 11:32:41.121883 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.121832 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:32:41.289048 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.288923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:41.289298 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:41.289113 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:41.289298 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:41.289205 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:32:42.289181724 +0000 UTC m=+2.993189430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:41.389341 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.389308 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:41.389341 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.389347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:41.389514 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:41.389466 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:41.389514 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:41.389512 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret podName:a97b11c1-5f78-445c-abb6-f256b3df4283 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:42.389499328 +0000 UTC m=+3.093507013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret") pod "global-pull-secret-syncer-fxm9p" (UID: "a97b11c1-5f78-445c-abb6-f256b3df4283") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:41.389763 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:41.389749 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:32:41.389829 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:41.389768 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:32:41.389829 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:41.389777 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ftzmn for pod openshift-network-diagnostics/network-check-target-6n7lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:41.389829 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:41.389809 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn podName:67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:42.389800128 +0000 UTC m=+3.093807813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftzmn" (UniqueName: "kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn") pod "network-check-target-6n7lf" (UID: "67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:41.780079 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.780039 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-898tl" event={"ID":"1c99f213-6cd1-4c2f-966d-f15153a79e7d","Type":"ContainerStarted","Data":"7be0aceb96e59dd9061b748ba54ee495b64f985178d727e86ca3f33dc25cac90"} Jun 11 11:32:41.784218 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.784186 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s6gz4" event={"ID":"31891d8d-f705-46ba-97a0-8434dd96a1a0","Type":"ContainerStarted","Data":"7e0afbd214fb66d378651cb6adadfcb8125bb861d360bab20ac075a741e6fba3"} Jun 11 11:32:41.790918 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.790888 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qvm9q" event={"ID":"be25bbe1-df37-40cc-8eb0-e7d7114f24b8","Type":"ContainerStarted","Data":"97df4e4eb64e93c73e9b151d2fde1cab423bdfa1fc45a26188caa3515dc663aa"} Jun 11 11:32:41.792965 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.792939 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvflm" event={"ID":"8228dc0e-7573-43b0-a60b-e93a41563026","Type":"ContainerStarted","Data":"4cab4c2f215becae82870ed28a89c92b24bc564299251a1de5d5415272227928"} Jun 11 11:32:41.796442 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.796414 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 11:27:40 +0000 UTC" deadline="2028-01-06 03:56:12.787582852 +0000 UTC" Jun 11 11:32:41.796442 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.796445 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13768h23m30.99114272s" Jun 11 11:32:41.797280 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.797254 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"6d13469481ad8813ac9ed4f68ca6b3870e1773a38f0daf262f2f2d30c3aa7614"} Jun 11 11:32:41.807181 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.807155 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l42bh" event={"ID":"41d8809e-95af-4f01-aca2-7b36c577b865","Type":"ContainerStarted","Data":"41d8dd952c770ca3aa2f7924e7a7bd6db5b701024f008118f96e19fa6754745f"} Jun 11 11:32:41.818159 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.818094 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cptv" event={"ID":"9d37760a-114d-46e7-9333-26f83577bb7e","Type":"ContainerStarted","Data":"f5eb0036e62edfef8ba10f5b2e3d3b67bd0fd72b736c4cd9c773cb5d024158b7"} Jun 11 11:32:41.823205 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.823171 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j2spn" event={"ID":"f118d35e-a4dd-433d-a14c-9c26a4695c2c","Type":"ContainerStarted","Data":"f3d15de80139a6e6edafa74112bd1ca529b079c1f451e15994dcdc47d2e91a42"} Jun 11 11:32:41.827883 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.827442 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" event={"ID":"111958e3-6ee9-4ad1-8492-63eec7bd967f","Type":"ContainerStarted","Data":"6d11c876972b2efc48535f662752c1be4582d8e2ae88e58b4636dc6b8a26b686"} Jun 11 11:32:41.922523 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:41.922490 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:32:42.300957 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:42.300916 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:42.301133 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.301067 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:42.301133 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.301131 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:32:44.301112208 +0000 UTC m=+5.005119898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:42.402417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:42.401523 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:42.402417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:42.401573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:42.402417 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.401803 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:42.402417 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.401897 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret podName:a97b11c1-5f78-445c-abb6-f256b3df4283 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:44.401849888 +0000 UTC m=+5.105857594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret") pod "global-pull-secret-syncer-fxm9p" (UID: "a97b11c1-5f78-445c-abb6-f256b3df4283") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:42.402417 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.402020 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:32:42.402417 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.402034 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:32:42.402417 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.402047 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ftzmn for pod openshift-network-diagnostics/network-check-target-6n7lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:42.402417 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.402084 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn podName:67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:44.40207257 +0000 UTC m=+5.106080258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftzmn" (UniqueName: "kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn") pod "network-check-target-6n7lf" (UID: "67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:42.755743 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:42.755705 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:42.755958 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.755896 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:42.756596 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:42.756330 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:42.756596 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.756422 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:42.756596 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:42.756483 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:42.756596 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:42.756550 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:42.797076 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:42.797010 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 11:27:40 +0000 UTC" deadline="2028-03-16 09:43:32.687682332 +0000 UTC" Jun 11 11:32:42.797076 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:42.797046 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15454h10m49.890641211s" Jun 11 11:32:43.063921 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:43.063818 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:32:43.231103 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:43.231059 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:32:44.318590 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:44.318100 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:44.318590 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.318248 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:44.318590 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.318301 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:32:48.318286513 +0000 UTC m=+9.022294199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:44.419049 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:44.418935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:44.419242 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:44.419061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:44.419242 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.419230 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:44.419345 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.419291 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret podName:a97b11c1-5f78-445c-abb6-f256b3df4283 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:48.419273202 +0000 UTC m=+9.123280902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret") pod "global-pull-secret-syncer-fxm9p" (UID: "a97b11c1-5f78-445c-abb6-f256b3df4283") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:44.419716 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.419696 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:32:44.419808 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.419724 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:32:44.419808 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.419737 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ftzmn for pod openshift-network-diagnostics/network-check-target-6n7lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:44.419808 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.419779 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn podName:67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:48.419765087 +0000 UTC m=+9.123772788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftzmn" (UniqueName: "kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn") pod "network-check-target-6n7lf" (UID: "67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:44.756357 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:44.756321 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:44.756523 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.756456 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:44.756918 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:44.756894 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:44.757022 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.756996 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:44.757099 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:44.757059 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:44.757160 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:44.757141 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:46.756327 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:46.756291 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:46.756721 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:46.756435 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:46.756721 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:46.756499 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:46.756721 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:46.756573 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:46.756721 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:46.756620 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:46.756721 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:46.756700 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:48.355179 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:48.355140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:48.355616 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.355332 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:48.355616 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.355410 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:32:56.355388737 +0000 UTC m=+17.059396442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:48.456950 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:48.456040 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:48.456950 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:48.456094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:48.456950 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.456359 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:48.456950 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.456419 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret podName:a97b11c1-5f78-445c-abb6-f256b3df4283 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:56.45640545 +0000 UTC m=+17.160413136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret") pod "global-pull-secret-syncer-fxm9p" (UID: "a97b11c1-5f78-445c-abb6-f256b3df4283") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:48.456950 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.456810 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:32:48.456950 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.456831 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:32:48.456950 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.456843 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ftzmn for pod openshift-network-diagnostics/network-check-target-6n7lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:48.456950 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.456910 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn podName:67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77 nodeName:}" failed. No retries permitted until 2026-06-11 11:32:56.456895058 +0000 UTC m=+17.160902748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftzmn" (UniqueName: "kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn") pod "network-check-target-6n7lf" (UID: "67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:48.755942 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:48.755910 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:48.755942 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:48.755939 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:48.756225 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:48.755910 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:48.756225 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.756039 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:48.756225 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.756102 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:48.756225 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:48.756169 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:50.756010 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:50.755971 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:50.756454 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:50.756117 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:50.756454 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:50.756197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:50.756454 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:50.756263 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:50.756454 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:50.756322 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:50.756454 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:50.756387 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:52.756420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:52.756377 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:52.756420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:52.756405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:52.756964 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:52.756511 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:52.756964 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:52.756523 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:52.756964 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:52.756616 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:52.756964 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:52.756699 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:54.756700 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:54.756473 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:54.757176 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:54.756478 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:54.757176 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:54.756802 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:54.757176 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:54.756844 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:54.757176 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:54.756493 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:54.757176 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:54.756948 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:56.417503 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:56.417465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:56.417947 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.417631 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:56.417947 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.417704 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:33:12.417687396 +0000 UTC m=+33.121695085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:32:56.518028 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:56.517988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:56.518028 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:56.518034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:56.518271 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.518142 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:56.518271 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.518157 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:32:56.518271 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.518173 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:32:56.518271 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.518185 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ftzmn for pod openshift-network-diagnostics/network-check-target-6n7lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:56.518271 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.518207 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret podName:a97b11c1-5f78-445c-abb6-f256b3df4283 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:12.518190735 +0000 UTC m=+33.222198424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret") pod "global-pull-secret-syncer-fxm9p" (UID: "a97b11c1-5f78-445c-abb6-f256b3df4283") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:32:56.518271 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.518223 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn podName:67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:12.518212859 +0000 UTC m=+33.222220562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftzmn" (UniqueName: "kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn") pod "network-check-target-6n7lf" (UID: "67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:32:56.755668 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:56.755635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:56.755668 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:56.755673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:56.755901 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:56.755731 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:56.755901 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.755744 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:32:56.755901 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.755809 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:56.755901 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:56.755852 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:58.755990 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:58.755944 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:32:58.756539 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:58.755957 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:32:58.756539 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:58.756071 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:32:58.756539 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:58.756186 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:32:58.756539 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:32:58.755965 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:32:58.756539 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:32:58.756278 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:00.756533 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:00.756091 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:00.756533 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:00.756135 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:00.756533 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:00.756211 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:00.756533 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:00.756230 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:00.756533 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:00.756324 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:00.756533 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:00.756407 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:01.887771 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:01.887565 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" event={"ID":"45fd46cdb00075c41be9450fd694dc7c","Type":"ContainerStarted","Data":"9ce30880db2bc1ad0eda6a1e4b42d16505564c906d5e22aa074b954bdfd84ec1"} Jun 11 11:33:01.889190 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:01.889165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvflm" event={"ID":"8228dc0e-7573-43b0-a60b-e93a41563026","Type":"ContainerStarted","Data":"414c0f943f1c29e3f04f3a1fe1122f9be7e94cbd53c9fc68d454fd97096641c0"} Jun 11 11:33:01.890958 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:01.890930 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"e9fa058b34d51ed16f1ac76588e0cbb18d3936cc71ec97a8a04ff2656850a020"} Jun 11 11:33:01.891080 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:01.891013 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"2358f1cda2ccb3a9e1ab0ebc66a5a54c5a66644fef96e9871ac22872f25b55bb"} Jun 11 11:33:01.892394 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:01.892364 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l42bh" event={"ID":"41d8809e-95af-4f01-aca2-7b36c577b865","Type":"ContainerStarted","Data":"3d582db3cf3b1476ca6e6c36c8ec25bc016bb176d5d62b133832ad2dfb78c5d7"} Jun 11 11:33:01.904764 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:01.904720 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-217.ec2.internal" podStartSLOduration=21.904707943 podStartE2EDuration="21.904707943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:01.904296734 +0000 UTC m=+22.608304441" watchObservedRunningTime="2026-06-11 11:33:01.904707943 +0000 UTC m=+22.608715650" Jun 11 11:33:01.925253 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:01.925204 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l42bh" podStartSLOduration=2.242632231 podStartE2EDuration="22.925188061s" totalImagesPullingTime="20.68255583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:01.924818213 +0000 UTC m=+22.628825933" watchObservedRunningTime="2026-06-11 11:33:01.925188061 +0000 UTC m=+22.629195768" Jun 11 11:33:01.948145 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:01.948071 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vvflm" podStartSLOduration=1.616934788 podStartE2EDuration="21.948053256s" totalImagesPullingTime="20.331118468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:01.94782153 +0000 UTC m=+22.651829239" watchObservedRunningTime="2026-06-11 11:33:01.948053256 +0000 UTC m=+22.652060964" Jun 11 11:33:02.756246 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.756124 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:02.756396 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.756246 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:02.756396 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:02.756366 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:02.756507 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.756252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:02.756507 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:02.756242 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:02.756589 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:02.756503 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:02.895840 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.895805 2560 generic.go:356] "Generic (PLEG): container finished" podID="d9b4cc43de3e9e696a83953c85e36d46" containerID="46f464338e0a0f06115a8ebe0a621c0b9b5526975db14ab8cced56eec86bd519" exitCode=0 Jun 11 11:33:02.896373 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.895904 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" event={"ID":"d9b4cc43de3e9e696a83953c85e36d46","Type":"ContainerDied","Data":"46f464338e0a0f06115a8ebe0a621c0b9b5526975db14ab8cced56eec86bd519"} Jun 11 11:33:02.896373 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.896138 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" Jun 11 11:33:02.897595 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.897571 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j2spn" event={"ID":"f118d35e-a4dd-433d-a14c-9c26a4695c2c","Type":"ContainerStarted","Data":"a9e3cda6c6cc2fc601497879db162049d8548731071c922d0b626fa9df30a4e6"} Jun 11 11:33:02.899183 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.899124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" event={"ID":"111958e3-6ee9-4ad1-8492-63eec7bd967f","Type":"ContainerStarted","Data":"df70e7eb7fadfd4b2a1a22fc282aec82a5cf724f6b2c8bef9c38fc5b84867d3c"} Jun 11 11:33:02.900637 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.900612 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-898tl" event={"ID":"1c99f213-6cd1-4c2f-966d-f15153a79e7d","Type":"ContainerStarted","Data":"2fa2a6369fff0b92163000a151ea7eae785370be2ab6e2d5eace2bd0767fc7c0"} Jun 11 11:33:02.902333 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.902313 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s6gz4" event={"ID":"31891d8d-f705-46ba-97a0-8434dd96a1a0","Type":"ContainerStarted","Data":"165fb7143bac17db260bb5bda5993b6f8155618d75cae797573f19fd9d538794"} Jun 11 11:33:02.903839 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.903815 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qvm9q" event={"ID":"be25bbe1-df37-40cc-8eb0-e7d7114f24b8","Type":"ContainerStarted","Data":"14a6c338c45e180f9ad67f53eb0b205d6c17d91d8a3e1acb446b6fe7f96c5e5f"} Jun 11 11:33:02.906985 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.906954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"8755affaff83498fc1453303ec6463af9eeff38b20216bea56fd85c6ffd26f54"} Jun 11 11:33:02.907083 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.907030 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"e375ff0ccfb31b270abbc060e8f24646bcb28c827cf1adb295340e97bf586357"} Jun 11 11:33:02.907145 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.907082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"ab3b3d04915f8f3f3f4676cf82ab015a815ee76e1aaf2a5d9cbc4f8220e78bfc"} Jun 11 11:33:02.907145 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.907129 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"fb5c2a50ccb05a76e4ab4b0ca9f6f0a998dc28cfe6d6ce480ddb4e9ee8386b1e"} Jun 11 11:33:02.908580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.908559 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d37760a-114d-46e7-9333-26f83577bb7e" containerID="ff325e1e2b5d27c9eacba18143c6689cc9461e40bcb5d76bc271fc77257182ca" exitCode=0 Jun 11 11:33:02.908680 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.908653 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cptv" event={"ID":"9d37760a-114d-46e7-9333-26f83577bb7e","Type":"ContainerDied","Data":"ff325e1e2b5d27c9eacba18143c6689cc9461e40bcb5d76bc271fc77257182ca"} Jun 11 11:33:02.914008 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.913987 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal"] Jun 11 11:33:02.914317 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.914300 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 11:33:02.948701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.948648 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j2spn" podStartSLOduration=2.66054457 podStartE2EDuration="22.948629514s" totalImagesPullingTime="20.288084944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:02.948170161 +0000 UTC m=+23.652177869" watchObservedRunningTime="2026-06-11 11:33:02.948629514 +0000 UTC m=+23.652637230" Jun 11 11:33:02.980209 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:02.980159 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s6gz4" podStartSLOduration=2.659472203 podStartE2EDuration="22.980145007s" totalImagesPullingTime="20.320672804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:02.978570448 +0000 UTC m=+23.682578157" watchObservedRunningTime="2026-06-11 11:33:02.980145007 +0000 UTC m=+23.684152715" Jun 11 11:33:03.141988 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.141940 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qvm9q" podStartSLOduration=7.497693818 podStartE2EDuration="23.14192404s" totalImagesPullingTime="15.644230222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:03.115477256 +0000 UTC m=+23.819484965" watchObservedRunningTime="2026-06-11 11:33:03.14192404 +0000 UTC m=+23.845931749" Jun 11 11:33:03.492469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.492441 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 11:33:03.743440 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.743329 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T11:33:03.492459465Z","UUID":"54ba75d7-bd3a-409f-8105-9cca4622c1f1","Handler":null,"Name":"","Endpoint":""} Jun 11 11:33:03.744952 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.744928 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 11:33:03.745077 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.744974 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 11:33:03.914107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.914070 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" event={"ID":"d9b4cc43de3e9e696a83953c85e36d46","Type":"ContainerStarted","Data":"b82247edabb7586e37556172bfc85a412e97e65960cd2183d4070c25e50aeba1"} Jun 11 11:33:03.916981 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.916942 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" event={"ID":"111958e3-6ee9-4ad1-8492-63eec7bd967f","Type":"ContainerStarted","Data":"de7e81ca524d796e94b0d38cd9e10ceedcfcc5b847052982f5fc85a5f256472b"} Jun 11 11:33:03.945401 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.945349 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-898tl" podStartSLOduration=8.309327254 podStartE2EDuration="23.945332466s" totalImagesPullingTime="15.636005212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:03.141545864 +0000 UTC m=+23.845553572" watchObservedRunningTime="2026-06-11 11:33:03.945332466 +0000 UTC m=+24.649340176" Jun 11 11:33:03.946231 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:03.946168 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-217.ec2.internal" podStartSLOduration=1.946151957 podStartE2EDuration="1.946151957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:03.945485738 +0000 UTC m=+24.649493427" watchObservedRunningTime="2026-06-11 11:33:03.946151957 +0000 UTC m=+24.650159666" Jun 11 11:33:04.755697 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:04.755673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:04.755697 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:04.755691 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:04.755954 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:04.755694 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:04.755954 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:04.755798 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:04.755954 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:04.755899 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:04.756091 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:04.755992 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:04.923636 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:04.923556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"a0b8860dde1304615a79bb67254bd87ca8a0604b1bd7b1fadbbab19892da650b"} Jun 11 11:33:04.925779 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:04.925749 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" event={"ID":"111958e3-6ee9-4ad1-8492-63eec7bd967f","Type":"ContainerStarted","Data":"adba25a36b6810e332680a40bd690b187e99b83d31b298bdcf1e7ac4ec6ac041"} Jun 11 11:33:04.946349 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:04.946299 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7lmxs" podStartSLOduration=3.372261806 podStartE2EDuration="25.946284415s" totalImagesPullingTime="22.574022609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:04.9460346 +0000 UTC m=+25.650042300" watchObservedRunningTime="2026-06-11 11:33:04.946284415 +0000 UTC m=+25.650292124" Jun 11 11:33:05.521051 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:05.521008 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-898tl" Jun 11 11:33:05.521713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:05.521690 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-898tl" Jun 11 11:33:06.756529 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:06.756500 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:06.756913 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:06.756505 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:06.756913 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:06.756598 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:06.756913 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:06.756686 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:06.756913 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:06.756505 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:06.756913 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:06.756767 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:06.939167 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:06.939085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" event={"ID":"a2149b2c-27c4-4438-b7b6-3b7d2d565abf","Type":"ContainerStarted","Data":"e5c26778d75cad4d588c65a357239f179963309dd749a557f648f8e7d5a24b65"} Jun 11 11:33:06.939466 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:06.939385 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:33:06.939466 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:06.939445 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:33:06.955853 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:06.955815 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:33:06.972781 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:06.972449 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" podStartSLOduration=7.339545358 podStartE2EDuration="27.972426313s" totalImagesPullingTime="20.632880955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:06.971395957 +0000 UTC m=+27.675403693" watchObservedRunningTime="2026-06-11 11:33:06.972426313 +0000 UTC m=+27.676434022" Jun 11 11:33:07.941886 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:07.941843 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:33:07.959100 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:07.959074 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:33:08.755890 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:08.755832 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:08.756058 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:08.755841 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:08.756058 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:08.756011 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:08.756191 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:08.756074 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:08.756191 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:08.755848 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:08.756191 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:08.756179 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:09.003465 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:09.003435 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxm9p"] Jun 11 11:33:09.003978 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:09.003552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:09.003978 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:09.003656 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:09.006814 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:09.006753 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6n7lf"] Jun 11 11:33:09.006936 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:09.006857 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:09.007004 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:09.006982 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:09.007396 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:09.007376 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w59m5"] Jun 11 11:33:09.007467 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:09.007457 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:09.007550 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:09.007534 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:09.947521 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:09.947334 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d37760a-114d-46e7-9333-26f83577bb7e" containerID="ec0a938af33b96c5b6ab0bddbde9dd41ff9d46aadeab914434e1273dc5cd0241" exitCode=0 Jun 11 11:33:09.947719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:09.947413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cptv" event={"ID":"9d37760a-114d-46e7-9333-26f83577bb7e","Type":"ContainerDied","Data":"ec0a938af33b96c5b6ab0bddbde9dd41ff9d46aadeab914434e1273dc5cd0241"} Jun 11 11:33:10.756085 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:10.756055 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:10.756085 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:10.756076 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:10.756489 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:10.756083 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:10.756489 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:10.756182 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:10.756489 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:10.756268 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:10.756489 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:10.756366 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:10.953194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:10.953161 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d37760a-114d-46e7-9333-26f83577bb7e" containerID="89027eba9b95c005aa429cf41ee047c3fafeff9f3fe2271c88d22ba19fd41a7d" exitCode=0 Jun 11 11:33:10.953346 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:10.953200 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cptv" event={"ID":"9d37760a-114d-46e7-9333-26f83577bb7e","Type":"ContainerDied","Data":"89027eba9b95c005aa429cf41ee047c3fafeff9f3fe2271c88d22ba19fd41a7d"} Jun 11 11:33:10.996651 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:10.996624 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-898tl" Jun 11 11:33:10.996769 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:10.996739 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 11:33:10.997241 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:10.997226 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-898tl" Jun 11 11:33:11.957496 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:11.957466 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d37760a-114d-46e7-9333-26f83577bb7e" containerID="61fa2846cc1608b7bc7702b0a5d317a70d4d12996d0bddcc87ae41522ce43749" exitCode=0 Jun 11 11:33:11.957839 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:11.957519 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cptv" event={"ID":"9d37760a-114d-46e7-9333-26f83577bb7e","Type":"ContainerDied","Data":"61fa2846cc1608b7bc7702b0a5d317a70d4d12996d0bddcc87ae41522ce43749"} Jun 11 11:33:12.440203 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:12.440168 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:12.440377 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.440309 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:12.440447 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.440378 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:33:44.440359458 +0000 UTC m=+65.144367144 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:12.540673 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:12.540636 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:12.540848 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:12.540683 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:12.540848 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.540800 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:12.540848 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.540816 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:33:12.540848 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.540838 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:33:12.540848 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.540848 2560 projected.go:196] Error preparing data for projected volume kube-api-access-ftzmn for pod openshift-network-diagnostics/network-check-target-6n7lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:12.540848 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.540852 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret podName:a97b11c1-5f78-445c-abb6-f256b3df4283 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:44.540836857 +0000 UTC m=+65.244844544 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret") pod "global-pull-secret-syncer-fxm9p" (UID: "a97b11c1-5f78-445c-abb6-f256b3df4283") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:12.541161 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.540907 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn podName:67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:44.540893368 +0000 UTC m=+65.244901058 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftzmn" (UniqueName: "kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn") pod "network-check-target-6n7lf" (UID: "67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:12.756668 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:12.756586 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:12.756824 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:12.756587 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:12.756824 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.756731 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:12.756824 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.756765 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:12.756824 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:12.756587 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:12.757057 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:12.756893 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:14.755774 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:14.755675 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:14.755774 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:14.755721 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:14.756298 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:14.755797 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:14.756298 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:14.755819 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxm9p" podUID="a97b11c1-5f78-445c-abb6-f256b3df4283" Jun 11 11:33:14.756298 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:14.755919 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n7lf" podUID="67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77" Jun 11 11:33:14.756298 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:14.756008 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:33:15.585218 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.585024 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-217.ec2.internal" event="NodeReady" Jun 11 11:33:15.585480 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.585332 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 11:33:15.627920 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.627885 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c68fc7468-mj6d7"] Jun 11 11:33:15.672553 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.672524 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c68fc7468-mj6d7"] Jun 11 11:33:15.672731 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.672565 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fqm4h"] Jun 11 11:33:15.672731 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.672669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.677832 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.677651 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 11:33:15.677832 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.677657 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9jtnw\"" Jun 11 11:33:15.677832 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.677779 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 11:33:15.677832 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.677834 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 11:33:15.683185 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.683163 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 11:33:15.685412 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.685387 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc"] Jun 11 11:33:15.685544 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.685521 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fqm4h" Jun 11 11:33:15.689143 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.689125 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8npjn\"" Jun 11 11:33:15.689335 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.689318 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 11:33:15.689389 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.689362 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 11:33:15.689456 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.689319 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 11:33:15.705587 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.705559 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fdfcd"] Jun 11 11:33:15.705732 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.705690 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:15.708542 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.708518 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 11:33:15.708689 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.708554 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 11:33:15.708689 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.708518 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4jlkw\"" Jun 11 11:33:15.729587 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.729559 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fqm4h"] Jun 11 11:33:15.729746 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.729596 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc"] Jun 11 11:33:15.729746 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.729620 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdfcd"] Jun 11 11:33:15.729746 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.729677 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.732574 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.732551 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 11:33:15.732706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.732551 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hp5rt\"" Jun 11 11:33:15.732781 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.732556 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 11:33:15.763194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763163 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-certificates\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.763194 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763194 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9spt\" (UniqueName: \"kubernetes.io/projected/85986698-ac25-4de0-b5cc-fdee5ab9e607-kube-api-access-p9spt\") pod \"ingress-canary-fqm4h\" (UID: \"85986698-ac25-4de0-b5cc-fdee5ab9e607\") " pod="openshift-ingress-canary/ingress-canary-fqm4h" Jun 11 11:33:15.763639 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zmsm\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-kube-api-access-6zmsm\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.763639 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763232 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-trusted-ca\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.763639 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763321 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be369cd3-bfe3-4e14-b8ae-2808a470bf33-ca-trust-extracted\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.763830 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-image-registry-private-configuration\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.763924 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-installation-pull-secrets\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.763984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763928 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-bound-sa-token\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.763984 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.763970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85986698-ac25-4de0-b5cc-fdee5ab9e607-cert\") pod \"ingress-canary-fqm4h\" (UID: \"85986698-ac25-4de0-b5cc-fdee5ab9e607\") " pod="openshift-ingress-canary/ingress-canary-fqm4h" Jun 11 11:33:15.764078 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.764030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.832963 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.832923 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:15.864840 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.864747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-trusted-ca\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.864840 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.864809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be369cd3-bfe3-4e14-b8ae-2808a470bf33-ca-trust-extracted\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.865095 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.864848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-image-registry-private-configuration\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.866201 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866172 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-trusted-ca\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.866484 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866442 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be369cd3-bfe3-4e14-b8ae-2808a470bf33-ca-trust-extracted\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.866571 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866511 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-installation-pull-secrets\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.866571 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866559 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmqwr\" (UniqueName: \"kubernetes.io/projected/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-kube-api-access-xmqwr\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.866672 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866590 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-config-volume\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.866672 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866617 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-tmp-dir\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.866672 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b824e753-c7d4-4355-8f4e-ea34bcb92f01-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:15.866672 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866657 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:15.866822 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-bound-sa-token\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.866822 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85986698-ac25-4de0-b5cc-fdee5ab9e607-cert\") pod \"ingress-canary-fqm4h\" (UID: \"85986698-ac25-4de0-b5cc-fdee5ab9e607\") " pod="openshift-ingress-canary/ingress-canary-fqm4h" Jun 11 11:33:15.866822 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866812 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.866963 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.866963 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-certificates\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.866963 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866934 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9spt\" (UniqueName: \"kubernetes.io/projected/85986698-ac25-4de0-b5cc-fdee5ab9e607-kube-api-access-p9spt\") pod \"ingress-canary-fqm4h\" (UID: \"85986698-ac25-4de0-b5cc-fdee5ab9e607\") " pod="openshift-ingress-canary/ingress-canary-fqm4h" Jun 11 11:33:15.866963 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.866957 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zmsm\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-kube-api-access-6zmsm\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.867117 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:15.867087 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:33:15.867117 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:15.867101 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:33:15.867200 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:15.867157 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:16.367142947 +0000 UTC m=+37.071150632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:33:15.867649 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.867623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-certificates\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.871231 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.871203 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-installation-pull-secrets\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.871337 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.871203 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-image-registry-private-configuration\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.871337 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.871269 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85986698-ac25-4de0-b5cc-fdee5ab9e607-cert\") pod \"ingress-canary-fqm4h\" (UID: \"85986698-ac25-4de0-b5cc-fdee5ab9e607\") " pod="openshift-ingress-canary/ingress-canary-fqm4h" Jun 11 11:33:15.877041 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.877013 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-bound-sa-token\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.878088 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.878060 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zmsm\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-kube-api-access-6zmsm\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:15.878416 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.878397 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9spt\" (UniqueName: \"kubernetes.io/projected/85986698-ac25-4de0-b5cc-fdee5ab9e607-kube-api-access-p9spt\") pod \"ingress-canary-fqm4h\" (UID: \"85986698-ac25-4de0-b5cc-fdee5ab9e607\") " pod="openshift-ingress-canary/ingress-canary-fqm4h" Jun 11 11:33:15.927444 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.927407 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:15.967327 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.967283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmqwr\" (UniqueName: \"kubernetes.io/projected/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-kube-api-access-xmqwr\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.967327 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.967329 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-config-volume\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.967566 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.967352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-tmp-dir\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.967566 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.967375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b824e753-c7d4-4355-8f4e-ea34bcb92f01-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:15.967566 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.967395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:15.967566 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.967428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.967566 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:15.967549 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:33:15.967772 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:15.967590 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:15.967772 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:15.967635 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:16.467615743 +0000 UTC m=+37.171623445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:33:15.967772 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:15.967661 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:16.467644332 +0000 UTC m=+37.171652032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:33:15.967772 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.967703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-tmp-dir\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.967996 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.967974 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-config-volume\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.968036 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.968023 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b824e753-c7d4-4355-8f4e-ea34bcb92f01-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:15.978370 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.978343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmqwr\" (UniqueName: \"kubernetes.io/projected/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-kube-api-access-xmqwr\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:15.994775 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:15.994743 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fqm4h" Jun 11 11:33:16.274210 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.273933 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fqm4h"] Jun 11 11:33:16.277506 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:33:16.277481 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85986698_ac25_4de0_b5cc_fdee5ab9e607.slice/crio-e4aba24d9fe981cab8f18fd0ef6dd96370c839bff1706d821f61f95267541398 WatchSource:0}: Error finding container e4aba24d9fe981cab8f18fd0ef6dd96370c839bff1706d821f61f95267541398: Status 404 returned error can't find the container with id e4aba24d9fe981cab8f18fd0ef6dd96370c839bff1706d821f61f95267541398 Jun 11 11:33:16.371065 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.370999 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:16.371161 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:16.371140 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:33:16.371194 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:16.371164 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:33:16.371236 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:16.371217 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:17.371202051 +0000 UTC m=+38.075209737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:33:16.471947 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.471915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:16.472110 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.471955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:16.472110 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:16.472065 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:33:16.472110 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:16.472070 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:16.472220 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:16.472130 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:17.472112825 +0000 UTC m=+38.176120514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:33:16.472220 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:16.472146 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:17.472137883 +0000 UTC m=+38.176145572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:33:16.756318 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.756286 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:16.756464 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.756327 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:16.756464 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.756286 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:16.759278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.759255 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 11:33:16.759278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.759264 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-shl4d\"" Jun 11 11:33:16.759466 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.759300 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 11:33:16.759466 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.759359 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxm4w\"" Jun 11 11:33:16.759539 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.759480 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 11:33:16.759539 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.759527 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 11:33:16.973040 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.972993 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fqm4h" event={"ID":"85986698-ac25-4de0-b5cc-fdee5ab9e607","Type":"ContainerStarted","Data":"e4aba24d9fe981cab8f18fd0ef6dd96370c839bff1706d821f61f95267541398"} Jun 11 11:33:16.976115 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.976089 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d37760a-114d-46e7-9333-26f83577bb7e" containerID="e7298360e2f6f5367ec5cdc7333c1c8b44ebf94e0317b4c057f96ab726434625" exitCode=0 Jun 11 11:33:16.976258 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:16.976123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cptv" event={"ID":"9d37760a-114d-46e7-9333-26f83577bb7e","Type":"ContainerDied","Data":"e7298360e2f6f5367ec5cdc7333c1c8b44ebf94e0317b4c057f96ab726434625"} Jun 11 11:33:17.380049 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:17.379967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:17.380216 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:17.380135 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:33:17.380216 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:17.380159 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:33:17.380314 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:17.380221 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:19.380206061 +0000 UTC m=+40.084213747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:33:17.480575 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:17.480536 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:17.480813 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:17.480597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:17.480813 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:17.480661 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:33:17.480813 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:17.480721 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:19.480708754 +0000 UTC m=+40.184716440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:33:17.480813 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:17.480721 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:17.480813 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:17.480787 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:19.480766282 +0000 UTC m=+40.184773968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:33:17.981918 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:17.981889 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d37760a-114d-46e7-9333-26f83577bb7e" containerID="020405b2b47fea70d079db23d9e83b587483324fd6a47ee429f9614f0079d6b5" exitCode=0 Jun 11 11:33:17.982292 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:17.981935 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cptv" event={"ID":"9d37760a-114d-46e7-9333-26f83577bb7e","Type":"ContainerDied","Data":"020405b2b47fea70d079db23d9e83b587483324fd6a47ee429f9614f0079d6b5"} Jun 11 11:33:18.985707 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:18.985670 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fqm4h" event={"ID":"85986698-ac25-4de0-b5cc-fdee5ab9e607","Type":"ContainerStarted","Data":"1dd447e9dd66432a69a97fc36a0dff8a4fa0d4f190b401686611ab93500e8ce6"} Jun 11 11:33:18.989086 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:18.989062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cptv" event={"ID":"9d37760a-114d-46e7-9333-26f83577bb7e","Type":"ContainerStarted","Data":"eaaa764b6bc59f9516324901a2ec40b8667b8697c90248a8ebf640ef3e36f535"} Jun 11 11:33:19.003757 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.003703 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fqm4h" podStartSLOduration=1.6186402819999999 podStartE2EDuration="4.003688197s" totalImagesPullingTime="2.385047915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:19.00257746 +0000 UTC m=+39.706585167" watchObservedRunningTime="2026-06-11 11:33:19.003688197 +0000 UTC m=+39.707695904" Jun 11 11:33:19.027185 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.027131 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7cptv" podStartSLOduration=7.934632539 podStartE2EDuration="40.027115741s" totalImagesPullingTime="32.092483202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:19.026223491 +0000 UTC m=+39.730231200" watchObservedRunningTime="2026-06-11 11:33:19.027115741 +0000 UTC m=+39.731123445" Jun 11 11:33:19.161034 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.161003 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:19.266358 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.266267 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:19.359061 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.359029 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:19.397065 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.397031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:19.397238 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:19.397202 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:33:19.397238 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:19.397220 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:33:19.397348 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:19.397289 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:23.39726892 +0000 UTC m=+44.101276627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:33:19.457103 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.457042 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:19.498467 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.498428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:19.498467 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.498471 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:19.498712 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:19.498570 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:19.498712 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:19.498621 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:23.498608477 +0000 UTC m=+44.202616163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:33:19.498712 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:19.498623 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:33:19.498712 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:19.498683 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:23.498665677 +0000 UTC m=+44.202673364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:33:19.553577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.553494 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:19.654172 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:19.654126 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:20.063581 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:20.063552 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:20.160802 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:20.160761 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:20.499921 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:20.499891 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:20.558885 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:20.558832 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:21.293698 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:21.293662 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:21.394375 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:21.394336 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:21.706521 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:21.706474 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:21.801219 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:21.801191 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:23.429884 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:23.429825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:23.430243 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:23.429975 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:33:23.430243 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:23.429993 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:33:23.430243 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:23.430046 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:31.430031365 +0000 UTC m=+52.134039055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:33:23.530689 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:23.530652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:23.530689 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:23.530689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:23.530948 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:23.530810 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:23.530948 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:23.530816 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:33:23.530948 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:23.530862 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:31.530849296 +0000 UTC m=+52.234856982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:33:23.530948 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:23.530904 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:31.53088446 +0000 UTC m=+52.234892161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:33:24.997000 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:24.996962 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:25.098004 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:25.097968 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:26.858962 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:26.858922 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:26.929439 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:26.929406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:26.982723 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:26.982690 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:29.833283 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:29.833245 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:29.895762 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:29.895716 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:31.491111 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:31.491066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:31.491631 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:31.491202 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:33:31.491631 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:31.491219 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:33:31.491631 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:31.491273 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:47.491256527 +0000 UTC m=+68.195264212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:33:31.591562 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:31.591518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:31.591562 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:31.591569 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:31.591765 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:31.591657 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:33:31.591765 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:31.591671 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:31.591765 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:31.591725 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:47.591707963 +0000 UTC m=+68.295715649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:33:31.591765 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:31.591739 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:47.591732665 +0000 UTC m=+68.295740354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:33:37.749835 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:37.749784 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:37.807009 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:37.806955 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:39.967352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:39.967319 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4rbm" Jun 11 11:33:40.127617 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:40.127576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:40.223564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:40.223473 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:41.285452 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:41.285414 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:41.385828 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:41.385795 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:41.486990 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:41.486956 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:41.879663 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:41.879626 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:41.977487 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:41.977453 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:42.077569 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:42.077537 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:42.168404 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:42.168369 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:42.353595 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:42.353549 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:42.735521 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:42.735481 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:42.792524 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:42.792492 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:44.489818 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.489776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:33:44.492671 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.492654 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 11:33:44.500581 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:44.500558 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 11:33:44.500648 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:44.500637 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:34:48.500617162 +0000 UTC m=+129.204624867 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : secret "metrics-daemon-secret" not found Jun 11 11:33:44.590232 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.590196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:44.590232 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.590233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:44.593203 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.593186 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 11:33:44.593247 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.593227 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 11:33:44.603783 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.603755 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 11:33:44.605296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.605278 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a97b11c1-5f78-445c-abb6-f256b3df4283-original-pull-secret\") pod \"global-pull-secret-syncer-fxm9p\" (UID: \"a97b11c1-5f78-445c-abb6-f256b3df4283\") " pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:44.614117 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.614096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftzmn\" (UniqueName: \"kubernetes.io/projected/67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77-kube-api-access-ftzmn\") pod \"network-check-target-6n7lf\" (UID: \"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77\") " pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:44.666230 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.666193 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxm9p" Jun 11 11:33:44.674062 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.674037 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-shl4d\"" Jun 11 11:33:44.682212 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.682187 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:44.828798 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.828766 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxm9p"] Jun 11 11:33:44.832357 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:33:44.832330 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97b11c1_5f78_445c_abb6_f256b3df4283.slice/crio-476ce5e721e97616c6812a8e0c80a0f81aa6ac260321c2dbd4538389885abba6 WatchSource:0}: Error finding container 476ce5e721e97616c6812a8e0c80a0f81aa6ac260321c2dbd4538389885abba6: Status 404 returned error can't find the container with id 476ce5e721e97616c6812a8e0c80a0f81aa6ac260321c2dbd4538389885abba6 Jun 11 11:33:44.857827 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:44.857798 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6n7lf"] Jun 11 11:33:44.861106 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:33:44.861075 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ab9b32_d70f_4ae3_bf9d_c36a69b8dd77.slice/crio-2ba8efb7f6116043d8533a020893c88043339c24a6ea2ef7b31d27715105f7ae WatchSource:0}: Error finding container 2ba8efb7f6116043d8533a020893c88043339c24a6ea2ef7b31d27715105f7ae: Status 404 returned error can't find the container with id 2ba8efb7f6116043d8533a020893c88043339c24a6ea2ef7b31d27715105f7ae Jun 11 11:33:45.049831 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:45.049732 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6n7lf" event={"ID":"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77","Type":"ContainerStarted","Data":"2ba8efb7f6116043d8533a020893c88043339c24a6ea2ef7b31d27715105f7ae"} Jun 11 11:33:45.050922 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:45.050897 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxm9p" event={"ID":"a97b11c1-5f78-445c-abb6-f256b3df4283","Type":"ContainerStarted","Data":"476ce5e721e97616c6812a8e0c80a0f81aa6ac260321c2dbd4538389885abba6"} Jun 11 11:33:46.301850 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:46.301768 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:47.513854 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:47.513772 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:33:47.514392 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:47.513907 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:33:47.514392 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:47.513923 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:33:47.514392 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:47.513999 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:19.513978917 +0000 UTC m=+100.217986606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:33:47.614300 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:47.614261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:33:47.614511 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:47.614309 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:33:47.614511 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:47.614432 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:33:47.614511 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:47.614449 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:47.614511 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:47.614504 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:19.614486512 +0000 UTC m=+100.318494218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:33:47.614736 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:33:47.614520 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:19.614514018 +0000 UTC m=+100.318521703 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:33:50.065890 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:50.065826 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6n7lf" event={"ID":"67ab9b32-d70f-4ae3-bf9d-c36a69b8dd77","Type":"ContainerStarted","Data":"3b0f24ec702d4e25c3dda028a912ed7452b9b1b5a9c5458651bc81ee6ad96124"} Jun 11 11:33:50.066328 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:50.065948 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:33:50.067369 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:50.067347 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxm9p" event={"ID":"a97b11c1-5f78-445c-abb6-f256b3df4283","Type":"ContainerStarted","Data":"7db5826bcc5202400b2a207fd0898dab3caba0b60ba0c87a4345f4151c0b01ea"} Jun 11 11:33:50.083601 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:50.083553 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6n7lf" podStartSLOduration=65.669485304 podStartE2EDuration="1m10.08353958s" totalImagesPullingTime="4.414054276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:50.083188288 +0000 UTC m=+70.787195997" watchObservedRunningTime="2026-06-11 11:33:50.08353958 +0000 UTC m=+70.787547288" Jun 11 11:33:50.101469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:50.101417 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fxm9p" podStartSLOduration=65.654180018 podStartE2EDuration="1m10.101400179s" totalImagesPullingTime="4.447220161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:50.10059109 +0000 UTC m=+70.804598797" watchObservedRunningTime="2026-06-11 11:33:50.101400179 +0000 UTC m=+70.805407888" Jun 11 11:33:53.582806 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:53.582772 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:53.644405 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:53.644343 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:55.367630 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:55.367597 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:55.422945 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:55.422918 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:59.194306 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:59.194181 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:33:59.252515 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:33:59.252476 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:34:02.991354 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:02.991293 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:34:03.091996 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:03.091962 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:34:19.357396 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:19.357362 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:34:19.426305 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:19.426274 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:34:19.548667 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:19.548626 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:34:19.548823 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:19.548777 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:34:19.548823 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:19.548795 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:34:19.548922 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:19.548861 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:35:23.548845 +0000 UTC m=+164.252852686 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:34:19.649543 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:19.649515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:34:19.649678 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:19.649553 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:34:19.649678 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:19.649650 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:34:19.649678 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:19.649655 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:34:19.649777 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:19.649695 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:35:23.649682413 +0000 UTC m=+164.353690099 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:34:19.649777 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:19.649714 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:35:23.649701165 +0000 UTC m=+164.353708850 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:34:21.072418 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:21.072393 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6n7lf" Jun 11 11:34:48.557448 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:34:48.557405 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:34:48.558005 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:48.557566 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 11:34:48.558005 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:34:48.557634 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:36:50.557616725 +0000 UTC m=+251.261624431 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : secret "metrics-daemon-secret" not found Jun 11 11:35:18.684128 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:18.684082 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" podUID="be369cd3-bfe3-4e14-b8ae-2808a470bf33" Jun 11 11:35:18.715316 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:18.715275 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" podUID="b824e753-c7d4-4355-8f4e-ea34bcb92f01" Jun 11 11:35:18.739623 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:18.739587 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fdfcd" podUID="d3bcc4fc-3cc9-4baa-865e-6ea851f98f89" Jun 11 11:35:19.276150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:35:19.276123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:35:19.276311 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:35:19.276123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdfcd" Jun 11 11:35:19.776200 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:19.776159 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:35:23.615742 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:35:23.615701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:35:23.616158 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:23.615829 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 11:35:23.616158 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:23.615842 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c68fc7468-mj6d7: secret "image-registry-tls" not found Jun 11 11:35:23.616158 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:23.615930 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls podName:be369cd3-bfe3-4e14-b8ae-2808a470bf33 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:25.615906237 +0000 UTC m=+286.319913924 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls") pod "image-registry-5c68fc7468-mj6d7" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33") : secret "image-registry-tls" not found Jun 11 11:35:23.716378 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:35:23.716327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:35:23.716378 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:35:23.716384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:35:23.716495 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:23.716467 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:35:23.716495 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:23.716469 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 11:35:23.716558 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:23.716522 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls podName:d3bcc4fc-3cc9-4baa-865e-6ea851f98f89 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:25.716509895 +0000 UTC m=+286.420517580 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls") pod "dns-default-fdfcd" (UID: "d3bcc4fc-3cc9-4baa-865e-6ea851f98f89") : secret "dns-default-metrics-tls" not found Jun 11 11:35:23.716558 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:35:23.716536 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert podName:b824e753-c7d4-4355-8f4e-ea34bcb92f01 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:25.716530163 +0000 UTC m=+286.420537849 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-2gbcc" (UID: "b824e753-c7d4-4355-8f4e-ea34bcb92f01") : secret "networking-console-plugin-cert" not found Jun 11 11:35:32.756159 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:35:32.756064 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:35:33.755945 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:35:33.755904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:36:50.559852 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:36:50.559804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:36:50.560453 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:36:50.559961 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 11:36:50.560453 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:36:50.560039 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs podName:7e1f5764-f329-441a-8b48-0809878ca25f nodeName:}" failed. No retries permitted until 2026-06-11 11:38:52.560016916 +0000 UTC m=+373.264024615 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs") pod "network-metrics-daemon-w59m5" (UID: "7e1f5764-f329-441a-8b48-0809878ca25f") : secret "metrics-daemon-secret" not found Jun 11 11:37:03.366987 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.366906 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq"] Jun 11 11:37:03.370381 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.370359 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467"] Jun 11 11:37:03.370564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.370543 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.373031 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.373010 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 11:37:03.373136 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.373054 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.373136 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.373108 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kc4j2\"" Jun 11 11:37:03.373136 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.373121 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:37:03.373280 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.373262 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 11:37:03.373387 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.373369 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 11:37:03.376597 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.376579 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 11:37:03.376997 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.376982 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 11:37:03.377950 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.377928 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 11:37:03.378049 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.377928 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 11:37:03.378049 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.377934 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m2qbr\"" Jun 11 11:37:03.381255 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.381235 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467"] Jun 11 11:37:03.386764 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.386743 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq"] Jun 11 11:37:03.454237 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.454196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q64dz\" (UniqueName: \"kubernetes.io/projected/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-kube-api-access-q64dz\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.454237 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.454241 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhtns\" (UniqueName: \"kubernetes.io/projected/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-kube-api-access-vhtns\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.454461 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.454263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.454461 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.454289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.454461 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.454331 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.454461 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.454384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.459252 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.459228 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4"] Jun 11 11:37:03.462077 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.462059 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.462379 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.462353 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2"] Jun 11 11:37:03.464437 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.464418 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 11:37:03.464512 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.464467 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 11:37:03.464512 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.464500 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 11:37:03.464765 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.464750 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6fhsn\"" Jun 11 11:37:03.464816 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.464786 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:37:03.464990 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.464976 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv"] Jun 11 11:37:03.465085 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.465069 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2" Jun 11 11:37:03.467176 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.467157 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:37:03.467235 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.467176 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fkjnz\"" Jun 11 11:37:03.467235 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.467201 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 11:37:03.467631 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.467614 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv" Jun 11 11:37:03.470801 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.470782 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gm89p\"" Jun 11 11:37:03.471553 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.471534 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4"] Jun 11 11:37:03.475385 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.475365 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2"] Jun 11 11:37:03.476354 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.476334 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv"] Jun 11 11:37:03.555226 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q64dz\" (UniqueName: \"kubernetes.io/projected/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-kube-api-access-q64dz\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.555226 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555232 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntj7v\" (UniqueName: \"kubernetes.io/projected/a7683dec-c29b-48cd-b04e-71c92642b429-kube-api-access-ntj7v\") pod \"volume-data-source-validator-78dd696465-dzwz2\" (UID: \"a7683dec-c29b-48cd-b04e-71c92642b429\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2" Jun 11 11:37:03.555469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b82d93-3852-47f0-a5e1-c2a7105f201b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.555469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555286 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.555469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555337 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhtns\" (UniqueName: \"kubernetes.io/projected/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-kube-api-access-vhtns\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.555469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz62k\" (UniqueName: \"kubernetes.io/projected/d2b82d93-3852-47f0-a5e1-c2a7105f201b-kube-api-access-xz62k\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.555469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.555469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2b82d93-3852-47f0-a5e1-c2a7105f201b-config\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.555469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp49t\" (UniqueName: \"kubernetes.io/projected/47faa7a9-1510-458e-bd40-8ce1465caf92-kube-api-access-rp49t\") pod \"network-check-source-dbd9cf844-pp4wv\" (UID: \"47faa7a9-1510-458e-bd40-8ce1465caf92\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv" Jun 11 11:37:03.555783 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555486 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.555783 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.555544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.555783 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:03.555610 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:03.555783 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:03.555670 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls podName:8e5443ca-7265-4da1-9a68-1dfde8ac8d64 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:04.055656221 +0000 UTC m=+264.759663907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5w467" (UID: "8e5443ca-7265-4da1-9a68-1dfde8ac8d64") : secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:03.556094 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.556077 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.556134 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.556077 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.557696 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.557676 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.563930 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.563905 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q64dz\" (UniqueName: \"kubernetes.io/projected/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-kube-api-access-q64dz\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:03.564031 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.563961 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhtns\" (UniqueName: \"kubernetes.io/projected/3d463a97-4a7d-4130-9ab7-dd3bde06cd39-kube-api-access-vhtns\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kfjlq\" (UID: \"3d463a97-4a7d-4130-9ab7-dd3bde06cd39\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.620543 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.620463 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:03.656558 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.656517 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntj7v\" (UniqueName: \"kubernetes.io/projected/a7683dec-c29b-48cd-b04e-71c92642b429-kube-api-access-ntj7v\") pod \"volume-data-source-validator-78dd696465-dzwz2\" (UID: \"a7683dec-c29b-48cd-b04e-71c92642b429\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2" Jun 11 11:37:03.656719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.656576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b82d93-3852-47f0-a5e1-c2a7105f201b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.656719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.656646 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz62k\" (UniqueName: \"kubernetes.io/projected/d2b82d93-3852-47f0-a5e1-c2a7105f201b-kube-api-access-xz62k\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.656719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.656674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2b82d93-3852-47f0-a5e1-c2a7105f201b-config\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.656719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.656698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp49t\" (UniqueName: \"kubernetes.io/projected/47faa7a9-1510-458e-bd40-8ce1465caf92-kube-api-access-rp49t\") pod \"network-check-source-dbd9cf844-pp4wv\" (UID: \"47faa7a9-1510-458e-bd40-8ce1465caf92\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv" Jun 11 11:37:03.657230 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.657212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2b82d93-3852-47f0-a5e1-c2a7105f201b-config\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.659036 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.659016 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b82d93-3852-47f0-a5e1-c2a7105f201b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.664276 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.664251 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz62k\" (UniqueName: \"kubernetes.io/projected/d2b82d93-3852-47f0-a5e1-c2a7105f201b-kube-api-access-xz62k\") pod \"service-ca-operator-6bc5ff68f5-fwnw4\" (UID: \"d2b82d93-3852-47f0-a5e1-c2a7105f201b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.665008 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.664990 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp49t\" (UniqueName: \"kubernetes.io/projected/47faa7a9-1510-458e-bd40-8ce1465caf92-kube-api-access-rp49t\") pod \"network-check-source-dbd9cf844-pp4wv\" (UID: \"47faa7a9-1510-458e-bd40-8ce1465caf92\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv" Jun 11 11:37:03.665356 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.665339 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntj7v\" (UniqueName: \"kubernetes.io/projected/a7683dec-c29b-48cd-b04e-71c92642b429-kube-api-access-ntj7v\") pod \"volume-data-source-validator-78dd696465-dzwz2\" (UID: \"a7683dec-c29b-48cd-b04e-71c92642b429\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2" Jun 11 11:37:03.680310 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.680287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" Jun 11 11:37:03.708249 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.708210 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:03.773148 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.773104 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" Jun 11 11:37:03.780306 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.780280 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2" Jun 11 11:37:03.786370 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.786344 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv" Jun 11 11:37:03.809104 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.809061 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq"] Jun 11 11:37:03.813038 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:03.813002 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d463a97_4a7d_4130_9ab7_dd3bde06cd39.slice/crio-9f97a885d09aea78fb98efdf9b00fc42763b9350aa6030116a407f317c6be6c0 WatchSource:0}: Error finding container 9f97a885d09aea78fb98efdf9b00fc42763b9350aa6030116a407f317c6be6c0: Status 404 returned error can't find the container with id 9f97a885d09aea78fb98efdf9b00fc42763b9350aa6030116a407f317c6be6c0 Jun 11 11:37:03.923573 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.923442 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4"] Jun 11 11:37:03.926157 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:03.926131 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b82d93_3852_47f0_a5e1_c2a7105f201b.slice/crio-f9fd2cce5435ec87ed21f160dcff1050ffe97a191344b1ee8057a9cbb1ef3584 WatchSource:0}: Error finding container f9fd2cce5435ec87ed21f160dcff1050ffe97a191344b1ee8057a9cbb1ef3584: Status 404 returned error can't find the container with id f9fd2cce5435ec87ed21f160dcff1050ffe97a191344b1ee8057a9cbb1ef3584 Jun 11 11:37:03.935861 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.935838 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2"] Jun 11 11:37:03.938288 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:03.938259 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7683dec_c29b_48cd_b04e_71c92642b429.slice/crio-bc897a0f4c9592d6474a785bb78d821e12936ec9b10a12bac64eb91526e0de5c WatchSource:0}: Error finding container bc897a0f4c9592d6474a785bb78d821e12936ec9b10a12bac64eb91526e0de5c: Status 404 returned error can't find the container with id bc897a0f4c9592d6474a785bb78d821e12936ec9b10a12bac64eb91526e0de5c Jun 11 11:37:03.955246 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:03.955224 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv"] Jun 11 11:37:03.957581 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:03.957556 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47faa7a9_1510_458e_bd40_8ce1465caf92.slice/crio-36661a144bb0542dcbe284e5041eec1ce90de56d84edbce254aeca645e7cbd62 WatchSource:0}: Error finding container 36661a144bb0542dcbe284e5041eec1ce90de56d84edbce254aeca645e7cbd62: Status 404 returned error can't find the container with id 36661a144bb0542dcbe284e5041eec1ce90de56d84edbce254aeca645e7cbd62 Jun 11 11:37:04.059709 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:04.059670 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:04.059845 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:04.059816 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:04.059917 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:04.059896 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls podName:8e5443ca-7265-4da1-9a68-1dfde8ac8d64 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:05.059880116 +0000 UTC m=+265.763887802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5w467" (UID: "8e5443ca-7265-4da1-9a68-1dfde8ac8d64") : secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:04.519975 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:04.519265 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv" event={"ID":"47faa7a9-1510-458e-bd40-8ce1465caf92","Type":"ContainerStarted","Data":"fd5ccadaa83b6f65ed668a3db0bb90094ed1e7400ee1d46b3fc1ddf8eb862295"} Jun 11 11:37:04.519975 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:04.519327 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv" event={"ID":"47faa7a9-1510-458e-bd40-8ce1465caf92","Type":"ContainerStarted","Data":"36661a144bb0542dcbe284e5041eec1ce90de56d84edbce254aeca645e7cbd62"} Jun 11 11:37:04.521105 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:04.520986 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2" event={"ID":"a7683dec-c29b-48cd-b04e-71c92642b429","Type":"ContainerStarted","Data":"bc897a0f4c9592d6474a785bb78d821e12936ec9b10a12bac64eb91526e0de5c"} Jun 11 11:37:04.522740 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:04.522675 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" event={"ID":"d2b82d93-3852-47f0-a5e1-c2a7105f201b","Type":"ContainerStarted","Data":"f9fd2cce5435ec87ed21f160dcff1050ffe97a191344b1ee8057a9cbb1ef3584"} Jun 11 11:37:04.524516 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:04.524493 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" event={"ID":"3d463a97-4a7d-4130-9ab7-dd3bde06cd39","Type":"ContainerStarted","Data":"9f97a885d09aea78fb98efdf9b00fc42763b9350aa6030116a407f317c6be6c0"} Jun 11 11:37:05.070454 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:05.070366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:05.070622 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:05.070520 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:05.070622 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:05.070615 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls podName:8e5443ca-7265-4da1-9a68-1dfde8ac8d64 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:07.070593718 +0000 UTC m=+267.774601407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5w467" (UID: "8e5443ca-7265-4da1-9a68-1dfde8ac8d64") : secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:06.533412 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.533319 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" event={"ID":"d2b82d93-3852-47f0-a5e1-c2a7105f201b","Type":"ContainerStarted","Data":"e8e35dea7213613cc856de8770e544c831333f9dbda8f390e93fb14283337ca9"} Jun 11 11:37:06.534878 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.534832 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" event={"ID":"3d463a97-4a7d-4130-9ab7-dd3bde06cd39","Type":"ContainerStarted","Data":"5d3c246cb92e840ff53134583034d08b28ef20d16a6a2458d320cc01ffc48a3a"} Jun 11 11:37:06.536238 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.536215 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2" event={"ID":"a7683dec-c29b-48cd-b04e-71c92642b429","Type":"ContainerStarted","Data":"ef24b5b60b7ec304450e037c566b799b1b4de385b9eb81b67dececafce3e4e89"} Jun 11 11:37:06.549393 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.549347 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" podStartSLOduration=1.310084914 podStartE2EDuration="3.549328266s" totalImagesPullingTime="2.239243352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:06.548845855 +0000 UTC m=+267.252853578" watchObservedRunningTime="2026-06-11 11:37:06.549328266 +0000 UTC m=+267.253335976" Jun 11 11:37:06.549856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.549828 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pp4wv" podStartSLOduration=3.5498173570000002 podStartE2EDuration="3.549817357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:04.536642584 +0000 UTC m=+265.240650292" watchObservedRunningTime="2026-06-11 11:37:06.549817357 +0000 UTC m=+267.253825069" Jun 11 11:37:06.564628 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.564580 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" podStartSLOduration=1.214225512 podStartE2EDuration="3.564565103s" totalImagesPullingTime="2.350339591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:06.563178836 +0000 UTC m=+267.267186546" watchObservedRunningTime="2026-06-11 11:37:06.564565103 +0000 UTC m=+267.268572811" Jun 11 11:37:06.578759 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.578709 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dzwz2" podStartSLOduration=1.361117245 podStartE2EDuration="3.578691492s" totalImagesPullingTime="2.217574247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:06.57810345 +0000 UTC m=+267.282111158" watchObservedRunningTime="2026-06-11 11:37:06.578691492 +0000 UTC m=+267.282699199" Jun 11 11:37:06.650054 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.650016 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:06.704750 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:06.704718 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:07.087129 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.087090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:07.087317 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:07.087291 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:07.087391 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:07.087380 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls podName:8e5443ca-7265-4da1-9a68-1dfde8ac8d64 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:11.087358791 +0000 UTC m=+271.791366503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5w467" (UID: "8e5443ca-7265-4da1-9a68-1dfde8ac8d64") : secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:07.116713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.116664 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:07.145146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.145104 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt"] Jun 11 11:37:07.148711 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.148691 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" Jun 11 11:37:07.151041 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.151019 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 11:37:07.152004 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.151981 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7fhss\"" Jun 11 11:37:07.152122 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.151981 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 11:37:07.155065 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.155041 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt"] Jun 11 11:37:07.213514 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.213480 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:07.288085 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.288043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll5sn\" (UniqueName: \"kubernetes.io/projected/0d47ea3e-0c86-4e15-a637-36f1077f2171-kube-api-access-ll5sn\") pod \"migrator-955ffdf5f-b49gt\" (UID: \"0d47ea3e-0c86-4e15-a637-36f1077f2171\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" Jun 11 11:37:07.314316 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.314283 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:07.388633 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.388540 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll5sn\" (UniqueName: \"kubernetes.io/projected/0d47ea3e-0c86-4e15-a637-36f1077f2171-kube-api-access-ll5sn\") pod \"migrator-955ffdf5f-b49gt\" (UID: \"0d47ea3e-0c86-4e15-a637-36f1077f2171\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" Jun 11 11:37:07.408853 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.408821 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll5sn\" (UniqueName: \"kubernetes.io/projected/0d47ea3e-0c86-4e15-a637-36f1077f2171-kube-api-access-ll5sn\") pod \"migrator-955ffdf5f-b49gt\" (UID: \"0d47ea3e-0c86-4e15-a637-36f1077f2171\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" Jun 11 11:37:07.458810 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.458776 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" Jun 11 11:37:07.586003 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.585972 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt"] Jun 11 11:37:07.588815 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:07.588789 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d47ea3e_0c86_4e15_a637_36f1077f2171.slice/crio-f261d492b8ce5c859ccde9efa394e85202430251ba58c9b5f83b22f72549410f WatchSource:0}: Error finding container f261d492b8ce5c859ccde9efa394e85202430251ba58c9b5f83b22f72549410f: Status 404 returned error can't find the container with id f261d492b8ce5c859ccde9efa394e85202430251ba58c9b5f83b22f72549410f Jun 11 11:37:07.590494 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.590473 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:07.652962 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:07.652920 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:08.025338 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:08.025260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:08.313432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:08.313342 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:08.378322 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:08.378279 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:08.550703 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:08.550652 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" event={"ID":"0d47ea3e-0c86-4e15-a637-36f1077f2171","Type":"ContainerStarted","Data":"f261d492b8ce5c859ccde9efa394e85202430251ba58c9b5f83b22f72549410f"} Jun 11 11:37:09.555580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.555548 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" event={"ID":"0d47ea3e-0c86-4e15-a637-36f1077f2171","Type":"ContainerStarted","Data":"6c848f878bf75594c7ad63370921200f67e95f8a2a5ea3a25cdb13f0844284be"} Jun 11 11:37:09.555985 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.555598 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" event={"ID":"0d47ea3e-0c86-4e15-a637-36f1077f2171","Type":"ContainerStarted","Data":"bca18c3813fa250da2e4f3d5830314676ea46f8b0bc2fc324424ae233bb747ec"} Jun 11 11:37:09.569810 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.569755 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-b49gt" podStartSLOduration=1.297267478 podStartE2EDuration="2.569736991s" totalImagesPullingTime="1.272469513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:09.569321989 +0000 UTC m=+270.273329699" watchObservedRunningTime="2026-06-11 11:37:09.569736991 +0000 UTC m=+270.273744700" Jun 11 11:37:09.640026 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.639986 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:09.691623 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.691589 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:09.903470 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.903436 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-tmjkn"] Jun 11 11:37:09.906544 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.906525 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:09.909182 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.909161 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 11:37:09.909182 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.909171 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 11:37:09.909319 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.909185 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vqp9j\"" Jun 11 11:37:09.909319 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.909171 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 11:37:09.909903 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.909888 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 11:37:09.913644 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.913626 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-tmjkn"] Jun 11 11:37:09.945060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.945022 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:09.998223 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:09.998196 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:10.009388 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.009365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/331a6dbe-ff12-4979-b66d-d24e8aa90197-signing-key\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.009498 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.009405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22cbv\" (UniqueName: \"kubernetes.io/projected/331a6dbe-ff12-4979-b66d-d24e8aa90197-kube-api-access-22cbv\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.009536 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.009499 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/331a6dbe-ff12-4979-b66d-d24e8aa90197-signing-cabundle\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.110495 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.110461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/331a6dbe-ff12-4979-b66d-d24e8aa90197-signing-key\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.110691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.110516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22cbv\" (UniqueName: \"kubernetes.io/projected/331a6dbe-ff12-4979-b66d-d24e8aa90197-kube-api-access-22cbv\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.110691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.110584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/331a6dbe-ff12-4979-b66d-d24e8aa90197-signing-cabundle\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.111231 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.111207 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/331a6dbe-ff12-4979-b66d-d24e8aa90197-signing-cabundle\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.113125 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.113103 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/331a6dbe-ff12-4979-b66d-d24e8aa90197-signing-key\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.120158 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.120138 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22cbv\" (UniqueName: \"kubernetes.io/projected/331a6dbe-ff12-4979-b66d-d24e8aa90197-kube-api-access-22cbv\") pod \"service-ca-7d74d578b8-tmjkn\" (UID: \"331a6dbe-ff12-4979-b66d-d24e8aa90197\") " pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.166697 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.166619 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qvm9q_be25bbe1-df37-40cc-8eb0-e7d7114f24b8/dns-node-resolver/0.log" Jun 11 11:37:10.215929 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.215896 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" Jun 11 11:37:10.347632 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.347602 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-tmjkn"] Jun 11 11:37:10.350912 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:10.350861 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331a6dbe_ff12_4979_b66d_d24e8aa90197.slice/crio-69f2e5944b94baccaa29f5f4cc7163cd59d8b2f6b4d6f099ad16c32ddfda0ca1 WatchSource:0}: Error finding container 69f2e5944b94baccaa29f5f4cc7163cd59d8b2f6b4d6f099ad16c32ddfda0ca1: Status 404 returned error can't find the container with id 69f2e5944b94baccaa29f5f4cc7163cd59d8b2f6b4d6f099ad16c32ddfda0ca1 Jun 11 11:37:10.561235 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.561195 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" event={"ID":"331a6dbe-ff12-4979-b66d-d24e8aa90197","Type":"ContainerStarted","Data":"9eced497db7e0764068a85fbe04482d54f36248673766d1d2d4c9b73bbadd6bb"} Jun 11 11:37:10.561657 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.561287 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" event={"ID":"331a6dbe-ff12-4979-b66d-d24e8aa90197","Type":"ContainerStarted","Data":"69f2e5944b94baccaa29f5f4cc7163cd59d8b2f6b4d6f099ad16c32ddfda0ca1"} Jun 11 11:37:10.579172 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.579119 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-tmjkn" podStartSLOduration=1.579104015 podStartE2EDuration="1.579104015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:10.578322519 +0000 UTC m=+271.282330226" watchObservedRunningTime="2026-06-11 11:37:10.579104015 +0000 UTC m=+271.283111722" Jun 11 11:37:10.814254 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:10.814170 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:11.119536 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:11.119440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:11.119685 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:11.119595 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:11.119685 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:11.119661 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls podName:8e5443ca-7265-4da1-9a68-1dfde8ac8d64 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:19.119646484 +0000 UTC m=+279.823654170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5w467" (UID: "8e5443ca-7265-4da1-9a68-1dfde8ac8d64") : secret "cluster-monitoring-operator-tls" not found Jun 11 11:37:11.340103 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:11.340055 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:11.525655 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:11.525618 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:11.566202 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:11.566179 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s6gz4_31891d8d-f705-46ba-97a0-8434dd96a1a0/node-ca/0.log" Jun 11 11:37:11.602881 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:11.602828 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:11.676299 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:11.676263 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:11.777622 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:11.777530 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:11.878890 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:11.878843 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:12.029691 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:12.029610 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:12.367465 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:12.367388 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fqm4h_85986698-ac25-4de0-b5cc-fdee5ab9e607/serve-healthcheck-canary/0.log" Jun 11 11:37:12.567045 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:12.567018 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-b49gt_0d47ea3e-0c86-4e15-a637-36f1077f2171/migrator/0.log" Jun 11 11:37:12.767149 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:12.767116 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-b49gt_0d47ea3e-0c86-4e15-a637-36f1077f2171/graceful-termination/0.log" Jun 11 11:37:12.967181 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:12.967151 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kfjlq_3d463a97-4a7d-4130-9ab7-dd3bde06cd39/kube-storage-version-migrator-operator/0.log" Jun 11 11:37:13.025352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:13.025249 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:13.429907 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:13.429859 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:13.637082 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:13.636984 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:13.834593 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:13.834556 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:13.965261 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:13.965228 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:14.046033 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:14.046000 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:14.245290 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:14.245214 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:15.256510 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:15.256477 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:15.311257 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:15.311223 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:15.433005 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:15.432970 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:15.629150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:15.629057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:15.833003 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:15.832861 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:15.896198 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:15.896108 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:16.025365 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:16.025325 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:16.315108 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:16.315071 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:16.367517 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:16.367483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:17.032100 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:17.032065 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:17.433509 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:17.433480 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:17.534219 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:17.534187 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:17.635644 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:17.635600 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:17.828017 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:17.827919 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:17.886029 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:17.885999 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:18.230961 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:18.230930 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:18.632609 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:18.632524 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:19.047803 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:19.047752 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:19.187413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:19.187376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:19.189963 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:19.189943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e5443ca-7265-4da1-9a68-1dfde8ac8d64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5w467\" (UID: \"8e5443ca-7265-4da1-9a68-1dfde8ac8d64\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:19.286248 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:19.286196 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" Jun 11 11:37:19.417486 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:19.417454 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467"] Jun 11 11:37:19.420417 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:19.420389 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5443ca_7265_4da1_9a68_1dfde8ac8d64.slice/crio-7249a650ea99f34f95d19264c7bbb171eddfe551af330e0f0dd18fe06339f845 WatchSource:0}: Error finding container 7249a650ea99f34f95d19264c7bbb171eddfe551af330e0f0dd18fe06339f845: Status 404 returned error can't find the container with id 7249a650ea99f34f95d19264c7bbb171eddfe551af330e0f0dd18fe06339f845 Jun 11 11:37:19.590761 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:19.590681 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" event={"ID":"8e5443ca-7265-4da1-9a68-1dfde8ac8d64","Type":"ContainerStarted","Data":"7249a650ea99f34f95d19264c7bbb171eddfe551af330e0f0dd18fe06339f845"} Jun 11 11:37:19.630976 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:19.630947 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:20.037546 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:20.037507 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:20.149440 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:20.149404 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:20.434217 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:20.434184 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:20.635220 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:20.635181 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:21.225899 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:21.225851 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:21.484338 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:21.484234 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:21.585601 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:21.585570 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:21.607584 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:21.607543 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" event={"ID":"8e5443ca-7265-4da1-9a68-1dfde8ac8d64","Type":"ContainerStarted","Data":"2972d308197d0f19a3a7ad72f7369bc3a1fca25922ce54af80e77e621c7292a9"} Jun 11 11:37:21.626333 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:21.626279 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5w467" podStartSLOduration=16.887235922 podStartE2EDuration="18.62626227s" totalImagesPullingTime="1.739026348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:21.62555015 +0000 UTC m=+282.329557859" watchObservedRunningTime="2026-06-11 11:37:21.62626227 +0000 UTC m=+282.330269978" Jun 11 11:37:21.647060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:21.647009 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:21.831967 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:21.831861 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:22.029083 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:22.029048 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:22.227042 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:22.227012 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:22.277397 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:22.277360 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fdfcd" podUID="d3bcc4fc-3cc9-4baa-865e-6ea851f98f89" Jun 11 11:37:22.277526 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:22.277367 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" podUID="b824e753-c7d4-4355-8f4e-ea34bcb92f01" Jun 11 11:37:22.286043 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:22.286017 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:22.429749 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:22.429713 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:22.611107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:22.611025 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:37:22.611249 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:22.611118 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdfcd" Jun 11 11:37:25.634045 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.634006 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:37:25.636437 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.636412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"image-registry-5c68fc7468-mj6d7\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:37:25.734632 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.734581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:37:25.734804 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.734645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:37:25.737168 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.737144 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3bcc4fc-3cc9-4baa-865e-6ea851f98f89-metrics-tls\") pod \"dns-default-fdfcd\" (UID: \"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89\") " pod="openshift-dns/dns-default-fdfcd" Jun 11 11:37:25.737274 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.737205 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b824e753-c7d4-4355-8f4e-ea34bcb92f01-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-2gbcc\" (UID: \"b824e753-c7d4-4355-8f4e-ea34bcb92f01\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:37:25.860101 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.860065 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9jtnw\"" Jun 11 11:37:25.867096 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.867064 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:37:25.914500 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.914436 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4jlkw\"" Jun 11 11:37:25.914707 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.914577 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hp5rt\"" Jun 11 11:37:25.922852 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.922822 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" Jun 11 11:37:25.923005 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:25.922837 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdfcd" Jun 11 11:37:26.008749 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.008659 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c68fc7468-mj6d7"] Jun 11 11:37:26.011204 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:26.011161 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe369cd3_bfe3_4e14_b8ae_2808a470bf33.slice/crio-6a65b7eb2e8d235ba891addfb6472bb0c9aa3e12d1f4d93587c6405215c0c2a2 WatchSource:0}: Error finding container 6a65b7eb2e8d235ba891addfb6472bb0c9aa3e12d1f4d93587c6405215c0c2a2: Status 404 returned error can't find the container with id 6a65b7eb2e8d235ba891addfb6472bb0c9aa3e12d1f4d93587c6405215c0c2a2 Jun 11 11:37:26.101491 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.101459 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc"] Jun 11 11:37:26.104568 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:26.104540 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb824e753_c7d4_4355_8f4e_ea34bcb92f01.slice/crio-0a4b1c7e14ae42f450ae902885fdc584c4c14bbf95fff462eab23457e14e3fef WatchSource:0}: Error finding container 0a4b1c7e14ae42f450ae902885fdc584c4c14bbf95fff462eab23457e14e3fef: Status 404 returned error can't find the container with id 0a4b1c7e14ae42f450ae902885fdc584c4c14bbf95fff462eab23457e14e3fef Jun 11 11:37:26.107822 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.107798 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdfcd"] Jun 11 11:37:26.112056 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:26.112032 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3bcc4fc_3cc9_4baa_865e_6ea851f98f89.slice/crio-a8fbbc3498396069abd6e37a3d8908673dd350cf4c3bdab626e28a1924bbb771 WatchSource:0}: Error finding container a8fbbc3498396069abd6e37a3d8908673dd350cf4c3bdab626e28a1924bbb771: Status 404 returned error can't find the container with id a8fbbc3498396069abd6e37a3d8908673dd350cf4c3bdab626e28a1924bbb771 Jun 11 11:37:26.629367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.629312 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdfcd" event={"ID":"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89","Type":"ContainerStarted","Data":"a8fbbc3498396069abd6e37a3d8908673dd350cf4c3bdab626e28a1924bbb771"} Jun 11 11:37:26.632727 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.632659 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" event={"ID":"b824e753-c7d4-4355-8f4e-ea34bcb92f01","Type":"ContainerStarted","Data":"0a4b1c7e14ae42f450ae902885fdc584c4c14bbf95fff462eab23457e14e3fef"} Jun 11 11:37:26.634758 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.634680 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" event={"ID":"be369cd3-bfe3-4e14-b8ae-2808a470bf33","Type":"ContainerStarted","Data":"f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269"} Jun 11 11:37:26.634758 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.634728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" event={"ID":"be369cd3-bfe3-4e14-b8ae-2808a470bf33","Type":"ContainerStarted","Data":"6a65b7eb2e8d235ba891addfb6472bb0c9aa3e12d1f4d93587c6405215c0c2a2"} Jun 11 11:37:26.635259 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.634843 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:37:26.656900 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:26.656752 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" podStartSLOduration=286.656735571 podStartE2EDuration="4m46.656735571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:26.656236664 +0000 UTC m=+287.360244372" watchObservedRunningTime="2026-06-11 11:37:26.656735571 +0000 UTC m=+287.360743278" Jun 11 11:37:28.230321 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.230285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:28.330356 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.330318 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:28.395300 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.395270 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:28.642732 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.642640 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdfcd" event={"ID":"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89","Type":"ContainerStarted","Data":"290cda40b7f729ce5d71991ffd5d1796f6de59ccc2a0baf6f76fdd20fddc5db4"} Jun 11 11:37:28.642732 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.642702 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdfcd" event={"ID":"d3bcc4fc-3cc9-4baa-865e-6ea851f98f89","Type":"ContainerStarted","Data":"7a0043597e09b6f4991fce61d99c39e9977cd4327ac7dc176386c4c4cdac4c4c"} Jun 11 11:37:28.642964 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.642760 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fdfcd" Jun 11 11:37:28.644198 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.644167 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" event={"ID":"b824e753-c7d4-4355-8f4e-ea34bcb92f01","Type":"ContainerStarted","Data":"4cca20880ef7c9cb5baa49bdc4097549c104c58a60eeb27f6b4e239ffa9c745c"} Jun 11 11:37:28.662918 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.662855 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fdfcd" podStartSLOduration=252.07762225 podStartE2EDuration="4m13.662841562s" totalImagesPullingTime="1.585219312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:28.661330796 +0000 UTC m=+289.365338527" watchObservedRunningTime="2026-06-11 11:37:28.662841562 +0000 UTC m=+289.366849269" Jun 11 11:37:28.678259 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.678212 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-2gbcc" podStartSLOduration=278.128176176 podStartE2EDuration="4m39.67820146s" totalImagesPullingTime="1.550025284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:32:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:28.677717099 +0000 UTC m=+289.381724806" watchObservedRunningTime="2026-06-11 11:37:28.67820146 +0000 UTC m=+289.382209165" Jun 11 11:37:28.721255 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.721221 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:28.910835 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.910801 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:28.967093 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:28.967062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:29.109043 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:29.109012 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:29.713618 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:29.713582 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:29.914408 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:29.914373 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:30.548122 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:30.548088 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:30.648908 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:30.648848 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:30.715657 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:30.715607 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:31.834579 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.834538 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph"] Jun 11 11:37:31.837962 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.837942 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" Jun 11 11:37:31.838712 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.838686 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rq7qz"] Jun 11 11:37:31.840797 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.840777 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-r9ntw\"" Jun 11 11:37:31.841235 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.841217 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:31.841489 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.841462 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 11:37:31.847426 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.847401 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 11:37:31.847608 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.847584 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 11:37:31.847696 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.847678 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 11:37:31.847759 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.847743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6rv8k\"" Jun 11 11:37:31.847810 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.847678 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 11:37:31.860203 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.860161 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph"] Jun 11 11:37:31.861621 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.861596 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rq7qz"] Jun 11 11:37:31.980120 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.980080 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgdh\" (UniqueName: \"kubernetes.io/projected/94b11cda-e619-41b3-930d-091ef0ac5308-kube-api-access-ncgdh\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:31.980313 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.980123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94b11cda-e619-41b3-930d-091ef0ac5308-crio-socket\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:31.980313 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.980163 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d13de5a-0e53-44af-a953-e9c4a138d261-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qlcph\" (UID: \"1d13de5a-0e53-44af-a953-e9c4a138d261\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" Jun 11 11:37:31.980313 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.980181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b11cda-e619-41b3-930d-091ef0ac5308-data-volume\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:31.980313 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.980226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94b11cda-e619-41b3-930d-091ef0ac5308-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:31.980313 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:31.980281 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94b11cda-e619-41b3-930d-091ef0ac5308-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.081438 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.081406 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d13de5a-0e53-44af-a953-e9c4a138d261-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qlcph\" (UID: \"1d13de5a-0e53-44af-a953-e9c4a138d261\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" Jun 11 11:37:32.081438 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.081446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b11cda-e619-41b3-930d-091ef0ac5308-data-volume\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.081708 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.081492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94b11cda-e619-41b3-930d-091ef0ac5308-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.081708 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.081530 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94b11cda-e619-41b3-930d-091ef0ac5308-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.081708 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.081570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgdh\" (UniqueName: \"kubernetes.io/projected/94b11cda-e619-41b3-930d-091ef0ac5308-kube-api-access-ncgdh\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.081708 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.081597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94b11cda-e619-41b3-930d-091ef0ac5308-crio-socket\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.081708 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.081689 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94b11cda-e619-41b3-930d-091ef0ac5308-crio-socket\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.081941 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.081895 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b11cda-e619-41b3-930d-091ef0ac5308-data-volume\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.082193 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.082167 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94b11cda-e619-41b3-930d-091ef0ac5308-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.083914 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.083883 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94b11cda-e619-41b3-930d-091ef0ac5308-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.084018 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.083990 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d13de5a-0e53-44af-a953-e9c4a138d261-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qlcph\" (UID: \"1d13de5a-0e53-44af-a953-e9c4a138d261\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" Jun 11 11:37:32.096844 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.096789 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgdh\" (UniqueName: \"kubernetes.io/projected/94b11cda-e619-41b3-930d-091ef0ac5308-kube-api-access-ncgdh\") pod \"insights-runtime-extractor-rq7qz\" (UID: \"94b11cda-e619-41b3-930d-091ef0ac5308\") " pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.105205 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.105179 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:32.148314 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.148281 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" Jun 11 11:37:32.153765 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.153748 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rq7qz" Jun 11 11:37:32.211814 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.211747 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:32.293655 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.293624 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph"] Jun 11 11:37:32.294508 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:32.294477 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d13de5a_0e53_44af_a953_e9c4a138d261.slice/crio-b483093c3fc950b2a1767f13885e24dd659ff401b28a4ad82db0d5098c0808cf WatchSource:0}: Error finding container b483093c3fc950b2a1767f13885e24dd659ff401b28a4ad82db0d5098c0808cf: Status 404 returned error can't find the container with id b483093c3fc950b2a1767f13885e24dd659ff401b28a4ad82db0d5098c0808cf Jun 11 11:37:32.312108 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.312086 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rq7qz"] Jun 11 11:37:32.315823 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:32.315802 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b11cda_e619_41b3_930d_091ef0ac5308.slice/crio-ed112d272360e24585fadfad0e9282d37efbad9e9ce410e5a2beeb9bf5291648 WatchSource:0}: Error finding container ed112d272360e24585fadfad0e9282d37efbad9e9ce410e5a2beeb9bf5291648: Status 404 returned error can't find the container with id ed112d272360e24585fadfad0e9282d37efbad9e9ce410e5a2beeb9bf5291648 Jun 11 11:37:32.660975 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.660936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rq7qz" event={"ID":"94b11cda-e619-41b3-930d-091ef0ac5308","Type":"ContainerStarted","Data":"ea8c86ce451e7489cbc633ab8cbec1d1e6eceeffbea2da39164b090b7ae17242"} Jun 11 11:37:32.661148 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.660996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rq7qz" event={"ID":"94b11cda-e619-41b3-930d-091ef0ac5308","Type":"ContainerStarted","Data":"ed112d272360e24585fadfad0e9282d37efbad9e9ce410e5a2beeb9bf5291648"} Jun 11 11:37:32.662002 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:32.661982 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" event={"ID":"1d13de5a-0e53-44af-a953-e9c4a138d261","Type":"ContainerStarted","Data":"b483093c3fc950b2a1767f13885e24dd659ff401b28a4ad82db0d5098c0808cf"} Jun 11 11:37:33.027486 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:33.027421 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:33.121464 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:33.121421 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:33.667917 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:33.667877 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rq7qz" event={"ID":"94b11cda-e619-41b3-930d-091ef0ac5308","Type":"ContainerStarted","Data":"99fb6545f9e757b4643fa64e3d8422ddb42dfa125b66373e695c52f563c80478"} Jun 11 11:37:33.669528 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:33.669500 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" event={"ID":"1d13de5a-0e53-44af-a953-e9c4a138d261","Type":"ContainerStarted","Data":"efd1b80627bcdb1174d62a84acda2af2be95512561887a25256efb5a3a1d3fda"} Jun 11 11:37:33.669671 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:33.669646 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" Jun 11 11:37:33.675021 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:33.674997 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" Jun 11 11:37:33.685035 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:33.684988 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qlcph" podStartSLOduration=1.616690988 podStartE2EDuration="2.684976258s" totalImagesPullingTime="1.06828527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:33.683755395 +0000 UTC m=+294.387763119" watchObservedRunningTime="2026-06-11 11:37:33.684976258 +0000 UTC m=+294.388983965" Jun 11 11:37:34.674156 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.674107 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:34.675112 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.675076 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rq7qz" event={"ID":"94b11cda-e619-41b3-930d-091ef0ac5308","Type":"ContainerStarted","Data":"28a8b2079868a0b62f846ae3245d69e3703a3aa5824abe1b2f4d924b7709cb14"} Jun 11 11:37:34.696005 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.695955 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rq7qz" podStartSLOduration=1.665878728 podStartE2EDuration="3.695937494s" totalImagesPullingTime="2.030058766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:37:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:34.693760579 +0000 UTC m=+295.397768286" watchObservedRunningTime="2026-06-11 11:37:34.695937494 +0000 UTC m=+295.399945201" Jun 11 11:37:34.715434 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.715352 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cpckr"] Jun 11 11:37:34.718505 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.718485 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:34.721188 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.721168 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 11:37:34.721274 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.721233 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 11:37:34.721321 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.721293 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 11:37:34.726210 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.722106 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bpbmp\"" Jun 11 11:37:34.730133 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.730108 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cpckr"] Jun 11 11:37:34.751941 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.751909 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:34.905964 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.905930 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:34.906119 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.905973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf585238-6055-4edf-9d7d-a91a88694962-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:34.906119 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.906066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:34.906243 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:34.906152 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdrlm\" (UniqueName: \"kubernetes.io/projected/cf585238-6055-4edf-9d7d-a91a88694962-kube-api-access-fdrlm\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.007217 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.007119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.007217 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.007161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf585238-6055-4edf-9d7d-a91a88694962-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.007217 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.007201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.007484 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.007248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdrlm\" (UniqueName: \"kubernetes.io/projected/cf585238-6055-4edf-9d7d-a91a88694962-kube-api-access-fdrlm\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.007484 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:35.007298 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 11:37:35.007484 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:35.007379 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-tls podName:cf585238-6055-4edf-9d7d-a91a88694962 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:35.507358982 +0000 UTC m=+296.211366684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-cpckr" (UID: "cf585238-6055-4edf-9d7d-a91a88694962") : secret "prometheus-operator-tls" not found Jun 11 11:37:35.008012 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.007949 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf585238-6055-4edf-9d7d-a91a88694962-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.009743 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.009721 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.015995 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.015974 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdrlm\" (UniqueName: \"kubernetes.io/projected/cf585238-6055-4edf-9d7d-a91a88694962-kube-api-access-fdrlm\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.131203 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.131166 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:35.512516 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.512461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.514983 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.514954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf585238-6055-4edf-9d7d-a91a88694962-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-cpckr\" (UID: \"cf585238-6055-4edf-9d7d-a91a88694962\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.631594 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.631558 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" Jun 11 11:37:35.763118 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:35.763042 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-cpckr"] Jun 11 11:37:35.768557 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:35.768515 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf585238_6055_4edf_9d7d_a91a88694962.slice/crio-e4b9514578e3109b7bff6aa51ad902e481ab4571307091d664f283a7c1514a29 WatchSource:0}: Error finding container e4b9514578e3109b7bff6aa51ad902e481ab4571307091d664f283a7c1514a29: Status 404 returned error can't find the container with id e4b9514578e3109b7bff6aa51ad902e481ab4571307091d664f283a7c1514a29 Jun 11 11:37:36.682946 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:36.682902 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" event={"ID":"cf585238-6055-4edf-9d7d-a91a88694962","Type":"ContainerStarted","Data":"e4b9514578e3109b7bff6aa51ad902e481ab4571307091d664f283a7c1514a29"} Jun 11 11:37:36.756965 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:36.756920 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w59m5" podUID="7e1f5764-f329-441a-8b48-0809878ca25f" Jun 11 11:37:37.195754 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:37.195718 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:37.688408 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:37.688367 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" event={"ID":"cf585238-6055-4edf-9d7d-a91a88694962","Type":"ContainerStarted","Data":"3057235be97467a34c6197c3f92620a7d3dfc34d3d7eaf05fefa027a2fea9070"} Jun 11 11:37:37.688593 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:37.688428 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" event={"ID":"cf585238-6055-4edf-9d7d-a91a88694962","Type":"ContainerStarted","Data":"186fe4ddeff845382127a486b3dad31f034da0274e256818ea38371e64b7f5c5"} Jun 11 11:37:37.705445 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:37.705398 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-cpckr" podStartSLOduration=2.559744775 podStartE2EDuration="3.705382637s" totalImagesPullingTime="1.145637862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:37.703962535 +0000 UTC m=+298.407970242" watchObservedRunningTime="2026-06-11 11:37:37.705382637 +0000 UTC m=+298.409390344" Jun 11 11:37:38.650085 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:38.650054 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fdfcd" Jun 11 11:37:39.698293 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:39.698266 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 11:37:39.806532 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:39.806387 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:39.922104 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:39.922070 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.024567 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.024464 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.069559 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.069522 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8kzfv"] Jun 11 11:37:40.072732 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.072714 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.075579 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.075556 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 11:37:40.075700 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.075557 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bxb27\"" Jun 11 11:37:40.075996 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.075982 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 11:37:40.076085 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.076048 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 11:37:40.116673 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.116639 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.151052 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151006 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.151233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.151233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151087 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-metrics-client-ca\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.151233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-sys\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.151233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g928h\" (UniqueName: \"kubernetes.io/projected/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-kube-api-access-g928h\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.151233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151232 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-wtmp\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.151508 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151264 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-tls\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.151508 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-root\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.151508 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.151328 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-textfile\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.205021 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.204984 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.252230 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252230 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252228 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-metrics-client-ca\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-sys\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g928h\" (UniqueName: \"kubernetes.io/projected/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-kube-api-access-g928h\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-wtmp\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-tls\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252403 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-root\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-textfile\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252820 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:40.252751 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 11:37:40.252820 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252790 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-root\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.252820 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:40.252810 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-tls podName:5b399f3d-5fa4-4814-8b97-9867ba27a5e7 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:40.75279449 +0000 UTC m=+301.456802189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-tls") pod "node-exporter-8kzfv" (UID: "5b399f3d-5fa4-4814-8b97-9867ba27a5e7") : secret "node-exporter-tls" not found Jun 11 11:37:40.252820 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252747 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-textfile\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.253055 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252907 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.253055 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.252950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-wtmp\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.253055 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.253013 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-metrics-client-ca\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.253204 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.253060 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-sys\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.254981 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.254952 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.261860 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.261837 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g928h\" (UniqueName: \"kubernetes.io/projected/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-kube-api-access-g928h\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.305198 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.305116 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.405187 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.405153 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.504552 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.504516 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.577926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.577820 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.640208 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.640165 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:40.755442 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.755410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-tls\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.757806 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.757788 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b399f3d-5fa4-4814-8b97-9867ba27a5e7-node-exporter-tls\") pod \"node-exporter-8kzfv\" (UID: \"5b399f3d-5fa4-4814-8b97-9867ba27a5e7\") " pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:40.984241 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:40.984189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kzfv" Jun 11 11:37:41.002790 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:41.002756 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b399f3d_5fa4_4814_8b97_9867ba27a5e7.slice/crio-4bfcc0a8d2bb5285445b05fd6a5f7b5f0495365f883238d8cc84e59be5368182 WatchSource:0}: Error finding container 4bfcc0a8d2bb5285445b05fd6a5f7b5f0495365f883238d8cc84e59be5368182: Status 404 returned error can't find the container with id 4bfcc0a8d2bb5285445b05fd6a5f7b5f0495365f883238d8cc84e59be5368182 Jun 11 11:37:41.008282 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.005109 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 11:37:41.031643 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.031615 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:41.110182 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.110140 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:41.364040 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.363955 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8cb6786d-hvlf2"] Jun 11 11:37:41.367655 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.367626 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.371479 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.371454 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 11:37:41.372409 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.372387 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 11:37:41.372812 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.372794 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 11:37:41.372975 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.372955 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 11:37:41.373433 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.373408 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 11:37:41.373546 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.373529 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 11:37:41.373648 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.373631 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 11:37:41.373762 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.373721 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dn2f5\"" Jun 11 11:37:41.382195 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.382175 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 11:37:41.391070 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.391046 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8cb6786d-hvlf2"] Jun 11 11:37:41.461190 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.461149 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-oauth-serving-cert\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.461374 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.461210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-trusted-ca-bundle\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.461374 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.461262 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmf4\" (UniqueName: \"kubernetes.io/projected/8d57a56b-c0d8-4143-a518-d8610674fe50-kube-api-access-7gmf4\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.461374 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.461300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-service-ca\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.461374 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.461328 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-console-config\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.461584 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.461396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-serving-cert\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.461584 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.461425 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-oauth-config\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.562795 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.562751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-oauth-serving-cert\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.562982 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.562814 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-trusted-ca-bundle\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.562982 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.562843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmf4\" (UniqueName: \"kubernetes.io/projected/8d57a56b-c0d8-4143-a518-d8610674fe50-kube-api-access-7gmf4\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.563197 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.563177 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-service-ca\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.563288 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.563207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-console-config\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.563288 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.563266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-serving-cert\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.563396 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.563291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-oauth-config\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.563664 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.563632 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-oauth-serving-cert\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.563827 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.563802 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-trusted-ca-bundle\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.563956 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.563932 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-service-ca\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.564262 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.564235 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-console-config\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.566159 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.566138 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-oauth-config\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.566547 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.566519 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-serving-cert\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.572076 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.572051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmf4\" (UniqueName: \"kubernetes.io/projected/8d57a56b-c0d8-4143-a518-d8610674fe50-kube-api-access-7gmf4\") pod \"console-7d8cb6786d-hvlf2\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.680734 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.680684 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:41.705764 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.705730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kzfv" event={"ID":"5b399f3d-5fa4-4814-8b97-9867ba27a5e7","Type":"ContainerStarted","Data":"4bfcc0a8d2bb5285445b05fd6a5f7b5f0495365f883238d8cc84e59be5368182"} Jun 11 11:37:41.933304 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:41.933278 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8cb6786d-hvlf2"] Jun 11 11:37:41.936299 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:41.936269 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d57a56b_c0d8_4143_a518_d8610674fe50.slice/crio-97fd323f1e57a49a286de236c2138e5e18bf508b16467f3cd67c016b559aafee WatchSource:0}: Error finding container 97fd323f1e57a49a286de236c2138e5e18bf508b16467f3cd67c016b559aafee: Status 404 returned error can't find the container with id 97fd323f1e57a49a286de236c2138e5e18bf508b16467f3cd67c016b559aafee Jun 11 11:37:42.033690 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.033662 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d89764ddf-jw2sz"] Jun 11 11:37:42.036966 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.036944 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.040037 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.040011 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 11:37:42.040138 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.040040 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 11:37:42.040138 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.040054 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-25sqv\"" Jun 11 11:37:42.040138 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.040125 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 11:37:42.040330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.040315 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 11:37:42.040378 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.040327 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 11:37:42.040378 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.040362 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ekkbrgotktp4i\"" Jun 11 11:37:42.050407 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.050384 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d89764ddf-jw2sz"] Jun 11 11:37:42.068078 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.068041 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-grpc-tls\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.068219 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.068089 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.068219 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.068119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n2n8\" (UniqueName: \"kubernetes.io/projected/fd5f149b-480b-4126-983f-50b9a5660bcc-kube-api-access-6n2n8\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.068330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.068227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.068330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.068257 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-tls\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.068330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.068284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.068478 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.068354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5f149b-480b-4126-983f-50b9a5660bcc-metrics-client-ca\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.068478 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.068402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.086928 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.086894 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:42.169075 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.169035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-tls\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.169296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.169083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.169296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.169127 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5f149b-480b-4126-983f-50b9a5660bcc-metrics-client-ca\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.169296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.169169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.169296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.169189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-grpc-tls\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.169296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.169207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.169296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.169222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n2n8\" (UniqueName: \"kubernetes.io/projected/fd5f149b-480b-4126-983f-50b9a5660bcc-kube-api-access-6n2n8\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.169296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.169276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.170381 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.170354 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5f149b-480b-4126-983f-50b9a5660bcc-metrics-client-ca\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.172283 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.172234 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.172398 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.172340 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-tls\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.172398 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.172376 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-grpc-tls\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.172482 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.172454 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.172724 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.172707 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.172796 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.172781 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd5f149b-480b-4126-983f-50b9a5660bcc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.177943 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.177921 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n2n8\" (UniqueName: \"kubernetes.io/projected/fd5f149b-480b-4126-983f-50b9a5660bcc-kube-api-access-6n2n8\") pod \"thanos-querier-d89764ddf-jw2sz\" (UID: \"fd5f149b-480b-4126-983f-50b9a5660bcc\") " pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.380534 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.380429 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:42.531653 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.531538 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d89764ddf-jw2sz"] Jun 11 11:37:42.536253 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:42.536217 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5f149b_480b_4126_983f_50b9a5660bcc.slice/crio-a1d78dd57d7f5532c45a7e78d3bf28b3e7840a22781a1b11287803489651d6e6 WatchSource:0}: Error finding container a1d78dd57d7f5532c45a7e78d3bf28b3e7840a22781a1b11287803489651d6e6: Status 404 returned error can't find the container with id a1d78dd57d7f5532c45a7e78d3bf28b3e7840a22781a1b11287803489651d6e6 Jun 11 11:37:42.711225 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.711187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8cb6786d-hvlf2" event={"ID":"8d57a56b-c0d8-4143-a518-d8610674fe50","Type":"ContainerStarted","Data":"97fd323f1e57a49a286de236c2138e5e18bf508b16467f3cd67c016b559aafee"} Jun 11 11:37:42.713027 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.712994 2560 generic.go:356] "Generic (PLEG): container finished" podID="5b399f3d-5fa4-4814-8b97-9867ba27a5e7" containerID="df34ffa497652a7fe82896a5df7ee87723a61a40fbd23ce8084d67b45e0ee0b8" exitCode=0 Jun 11 11:37:42.713166 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.713041 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kzfv" event={"ID":"5b399f3d-5fa4-4814-8b97-9867ba27a5e7","Type":"ContainerDied","Data":"df34ffa497652a7fe82896a5df7ee87723a61a40fbd23ce8084d67b45e0ee0b8"} Jun 11 11:37:42.714456 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.714424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" event={"ID":"fd5f149b-480b-4126-983f-50b9a5660bcc","Type":"ContainerStarted","Data":"a1d78dd57d7f5532c45a7e78d3bf28b3e7840a22781a1b11287803489651d6e6"} Jun 11 11:37:42.991439 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:42.991327 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:43.093564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:43.093523 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:43.652345 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:43.652263 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:43.721728 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:43.721239 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kzfv" event={"ID":"5b399f3d-5fa4-4814-8b97-9867ba27a5e7","Type":"ContainerStarted","Data":"f98557038e6049d11e49f5fdb6cfd26b268798b096b742f3122a00a07093e2e7"} Jun 11 11:37:43.721728 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:43.721342 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kzfv" event={"ID":"5b399f3d-5fa4-4814-8b97-9867ba27a5e7","Type":"ContainerStarted","Data":"4e5abdef2d0190833110a737f253cca38f4bcc54a1d2f6e643b456dee4a3155e"} Jun 11 11:37:43.742972 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:43.742911 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8kzfv" podStartSLOduration=2.820383349 podStartE2EDuration="3.742891088s" totalImagesPullingTime="843.073658ms" totalInitContainerRuntime="79.434081ms" isStatefulPod=true podCreationTimestamp="2026-06-11 11:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:43.741364528 +0000 UTC m=+304.445372236" watchObservedRunningTime="2026-06-11 11:37:43.742891088 +0000 UTC m=+304.446898795" Jun 11 11:37:43.789882 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:43.789825 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:44.534196 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.534147 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:44.597719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.597683 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:44.795226 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.795144 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:44.852398 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.852361 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wjrps"] Jun 11 11:37:44.855352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.855327 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:44.858330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.857916 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 11:37:44.858330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.858177 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ptrjv\"" Jun 11 11:37:44.865409 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.865353 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wjrps"] Jun 11 11:37:44.870586 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.870547 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:44.889646 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.889619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tvsw\" (UniqueName: \"kubernetes.io/projected/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-kube-api-access-9tvsw\") pod \"monitoring-plugin-76b68cc874-wjrps\" (UID: \"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:44.889779 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.889677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wjrps\" (UID: \"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:44.990578 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.990543 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tvsw\" (UniqueName: \"kubernetes.io/projected/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-kube-api-access-9tvsw\") pod \"monitoring-plugin-76b68cc874-wjrps\" (UID: \"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:44.990742 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.990607 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wjrps\" (UID: \"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:44.990813 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:44.990787 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 11:37:44.990892 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:37:44.990862 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-monitoring-plugin-cert podName:f8db2e64-00fd-43b5-9c80-6fd0fbf110c7 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:45.490841456 +0000 UTC m=+306.194849153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-wjrps" (UID: "f8db2e64-00fd-43b5-9c80-6fd0fbf110c7") : secret "monitoring-plugin-cert" not found Jun 11 11:37:44.999509 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:44.999473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tvsw\" (UniqueName: \"kubernetes.io/projected/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-kube-api-access-9tvsw\") pod \"monitoring-plugin-76b68cc874-wjrps\" (UID: \"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:45.234475 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.234432 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:45.492990 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.492964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wjrps\" (UID: \"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:45.495363 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.495339 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8db2e64-00fd-43b5-9c80-6fd0fbf110c7-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wjrps\" (UID: \"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:45.730574 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.730532 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" event={"ID":"fd5f149b-480b-4126-983f-50b9a5660bcc","Type":"ContainerStarted","Data":"30b6432ffdb08e0784451227a576080567d987339117648e669bef0767c4f717"} Jun 11 11:37:45.731025 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.730606 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" event={"ID":"fd5f149b-480b-4126-983f-50b9a5660bcc","Type":"ContainerStarted","Data":"5a6093d5daf82b6ee7831cbae9604cefd14c602e3aa565a964307971b0c5d45d"} Jun 11 11:37:45.731025 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.730638 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" event={"ID":"fd5f149b-480b-4126-983f-50b9a5660bcc","Type":"ContainerStarted","Data":"df52c9fbe6e62b90a6f1a127682eb041f913f23ee021d4163d1ecb7ada4209be"} Jun 11 11:37:45.731969 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.731940 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8cb6786d-hvlf2" event={"ID":"8d57a56b-c0d8-4143-a518-d8610674fe50","Type":"ContainerStarted","Data":"184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25"} Jun 11 11:37:45.753354 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.753263 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8cb6786d-hvlf2" podStartSLOduration=1.365440933 podStartE2EDuration="4.753244535s" totalImagesPullingTime="3.387803602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:45.752676174 +0000 UTC m=+306.456683881" watchObservedRunningTime="2026-06-11 11:37:45.753244535 +0000 UTC m=+306.457252244" Jun 11 11:37:45.767653 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.767627 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:45.872658 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.872623 2560 patch_prober.go:28] interesting pod/image-registry-5c68fc7468-mj6d7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 11:37:45.872798 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.872690 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" podUID="be369cd3-bfe3-4e14-b8ae-2808a470bf33" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 11:37:45.897246 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:45.897221 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wjrps"] Jun 11 11:37:45.899703 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:45.899674 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8db2e64_00fd_43b5_9c80_6fd0fbf110c7.slice/crio-bcc4949fc4ae73da674d5a594fc25294c076340356fd5667a3ab410687c65ac5 WatchSource:0}: Error finding container bcc4949fc4ae73da674d5a594fc25294c076340356fd5667a3ab410687c65ac5: Status 404 returned error can't find the container with id bcc4949fc4ae73da674d5a594fc25294c076340356fd5667a3ab410687c65ac5 Jun 11 11:37:46.281540 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:46.281492 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:46.742678 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:46.742637 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" event={"ID":"fd5f149b-480b-4126-983f-50b9a5660bcc","Type":"ContainerStarted","Data":"37d171a752fe817cf86b2e514078319dbab469daa3cfeebc6850708364292b72"} Jun 11 11:37:46.743183 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:46.742774 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" event={"ID":"fd5f149b-480b-4126-983f-50b9a5660bcc","Type":"ContainerStarted","Data":"3221f3d58107550f1c968a32250707e588253f7543e0993424053d880507aa68"} Jun 11 11:37:46.743183 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:46.742834 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" event={"ID":"fd5f149b-480b-4126-983f-50b9a5660bcc","Type":"ContainerStarted","Data":"565889f4480e19cc773be9276bfd401fde9b0b0d287df88a3daa89ddab506845"} Jun 11 11:37:46.743183 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:46.742917 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:46.744448 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:46.744416 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" event={"ID":"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7","Type":"ContainerStarted","Data":"bcc4949fc4ae73da674d5a594fc25294c076340356fd5667a3ab410687c65ac5"} Jun 11 11:37:46.764929 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:46.764851 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" podStartSLOduration=1.186103383 podStartE2EDuration="4.764830525s" totalImagesPullingTime="3.578727142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:46.763587779 +0000 UTC m=+307.467595488" watchObservedRunningTime="2026-06-11 11:37:46.764830525 +0000 UTC m=+307.468838304" Jun 11 11:37:47.642462 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:47.642390 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:37:47.749804 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:47.749763 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" event={"ID":"f8db2e64-00fd-43b5-9c80-6fd0fbf110c7","Type":"ContainerStarted","Data":"c02b170aa26db67a16cc86edd66b3b1f6dfd9ea616dc2106f185d42916471f0f"} Jun 11 11:37:47.750302 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:47.750134 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:47.754608 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:47.754584 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" Jun 11 11:37:47.765810 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:47.765766 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wjrps" podStartSLOduration=2.453845141 podStartE2EDuration="3.76575143s" totalImagesPullingTime="1.311906289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:47.764409864 +0000 UTC m=+308.468417572" watchObservedRunningTime="2026-06-11 11:37:47.76575143 +0000 UTC m=+308.469759153" Jun 11 11:37:47.772689 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:47.772668 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:47.825970 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:47.825912 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:47.926223 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:47.926187 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:48.026679 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:48.026639 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:49.748330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.748287 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8cb6786d-hvlf2"] Jun 11 11:37:49.780647 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.780611 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8c878cdc8-shlnq"] Jun 11 11:37:49.784488 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.784456 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.793438 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.793364 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c878cdc8-shlnq"] Jun 11 11:37:49.829483 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.829446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-oauth-serving-cert\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.829685 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.829584 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-serving-cert\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.829685 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.829659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-oauth-config\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.829685 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.829681 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-trusted-ca-bundle\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.829838 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.829704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c74q6\" (UniqueName: \"kubernetes.io/projected/b31043e8-d4e1-4443-a6a5-97d59ecf1583-kube-api-access-c74q6\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.829838 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.829739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-service-ca\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.829838 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.829782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-config\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.930377 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.930340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-serving-cert\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.930545 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.930407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-oauth-config\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.930545 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.930435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-trusted-ca-bundle\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.930545 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.930455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c74q6\" (UniqueName: \"kubernetes.io/projected/b31043e8-d4e1-4443-a6a5-97d59ecf1583-kube-api-access-c74q6\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.930545 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.930487 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-service-ca\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.930545 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.930512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-config\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.930545 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.930543 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-oauth-serving-cert\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.931413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.931377 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-config\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.931552 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.931413 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-service-ca\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.931552 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.931413 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-oauth-serving-cert\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.931671 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.931550 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-trusted-ca-bundle\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.933035 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.933012 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-oauth-config\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.933183 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.933165 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-serving-cert\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:49.941650 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:49.941631 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c74q6\" (UniqueName: \"kubernetes.io/projected/b31043e8-d4e1-4443-a6a5-97d59ecf1583-kube-api-access-c74q6\") pod \"console-8c878cdc8-shlnq\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:50.096743 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:50.096639 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:37:50.244439 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:50.244406 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c878cdc8-shlnq"] Jun 11 11:37:50.248543 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:37:50.248515 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31043e8_d4e1_4443_a6a5_97d59ecf1583.slice/crio-6417aaaf3bd30453a5341b51d246412317fb2dd5b5d42a8bada290bb0d0d163a WatchSource:0}: Error finding container 6417aaaf3bd30453a5341b51d246412317fb2dd5b5d42a8bada290bb0d0d163a: Status 404 returned error can't find the container with id 6417aaaf3bd30453a5341b51d246412317fb2dd5b5d42a8bada290bb0d0d163a Jun 11 11:37:50.756381 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:50.756343 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:37:50.765669 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:50.765636 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c878cdc8-shlnq" event={"ID":"b31043e8-d4e1-4443-a6a5-97d59ecf1583","Type":"ContainerStarted","Data":"3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667"} Jun 11 11:37:50.765819 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:50.765688 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c878cdc8-shlnq" event={"ID":"b31043e8-d4e1-4443-a6a5-97d59ecf1583","Type":"ContainerStarted","Data":"6417aaaf3bd30453a5341b51d246412317fb2dd5b5d42a8bada290bb0d0d163a"} Jun 11 11:37:50.786795 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:50.786750 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8c878cdc8-shlnq" podStartSLOduration=1.78673626 podStartE2EDuration="1.78673626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:50.785974181 +0000 UTC m=+311.489981914" watchObservedRunningTime="2026-06-11 11:37:50.78673626 +0000 UTC m=+311.490743967" Jun 11 11:37:51.127599 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:51.127506 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:51.226143 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:51.226110 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:51.681392 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:51.681345 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:37:52.758163 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:52.758132 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d89764ddf-jw2sz" Jun 11 11:37:53.953599 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:53.953559 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:54.006998 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:54.006971 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:54.520134 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:54.520097 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c68fc7468-mj6d7"] Jun 11 11:37:54.599270 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:54.599233 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:54.699249 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:54.699215 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:54.800265 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:54.800171 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:54.857270 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:54.857232 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:59.835005 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:59.834969 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:37:59.936363 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:37:59.936328 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:00.097420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:00.097343 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:38:00.097420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:00.097406 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:38:00.102344 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:00.102320 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:38:00.808179 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:00.808153 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:38:02.735235 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:02.735200 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:03.929331 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:03.929298 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:03.984948 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:03.984908 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:05.144732 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:05.144701 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:09.210565 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:09.210530 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:09.263496 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:09.263460 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:14.772272 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:14.772199 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d8cb6786d-hvlf2" podUID="8d57a56b-c0d8-4143-a518-d8610674fe50" containerName="console" containerID="cri-o://184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25" gracePeriod=15 Jun 11 11:38:14.834127 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:14.834090 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:14.890609 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:14.890576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:15.068777 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.068745 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:38:15.151676 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.151644 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-oauth-serving-cert\") pod \"8d57a56b-c0d8-4143-a518-d8610674fe50\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " Jun 11 11:38:15.151676 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.151685 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-oauth-config\") pod \"8d57a56b-c0d8-4143-a518-d8610674fe50\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " Jun 11 11:38:15.151965 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.151731 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-console-config\") pod \"8d57a56b-c0d8-4143-a518-d8610674fe50\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " Jun 11 11:38:15.151965 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.151770 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gmf4\" (UniqueName: \"kubernetes.io/projected/8d57a56b-c0d8-4143-a518-d8610674fe50-kube-api-access-7gmf4\") pod \"8d57a56b-c0d8-4143-a518-d8610674fe50\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " Jun 11 11:38:15.151965 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.151797 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-trusted-ca-bundle\") pod \"8d57a56b-c0d8-4143-a518-d8610674fe50\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " Jun 11 11:38:15.151965 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.151947 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-service-ca\") pod \"8d57a56b-c0d8-4143-a518-d8610674fe50\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " Jun 11 11:38:15.152180 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.151989 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-serving-cert\") pod \"8d57a56b-c0d8-4143-a518-d8610674fe50\" (UID: \"8d57a56b-c0d8-4143-a518-d8610674fe50\") " Jun 11 11:38:15.152180 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.152143 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d57a56b-c0d8-4143-a518-d8610674fe50" (UID: "8d57a56b-c0d8-4143-a518-d8610674fe50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:38:15.152293 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.152215 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-console-config" (OuterVolumeSpecName: "console-config") pod "8d57a56b-c0d8-4143-a518-d8610674fe50" (UID: "8d57a56b-c0d8-4143-a518-d8610674fe50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:38:15.152293 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.152275 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-oauth-serving-cert\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:15.152480 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.152435 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d57a56b-c0d8-4143-a518-d8610674fe50" (UID: "8d57a56b-c0d8-4143-a518-d8610674fe50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:38:15.152480 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.152468 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d57a56b-c0d8-4143-a518-d8610674fe50" (UID: "8d57a56b-c0d8-4143-a518-d8610674fe50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:38:15.154210 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.154189 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d57a56b-c0d8-4143-a518-d8610674fe50" (UID: "8d57a56b-c0d8-4143-a518-d8610674fe50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:38:15.154292 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.154265 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d57a56b-c0d8-4143-a518-d8610674fe50-kube-api-access-7gmf4" (OuterVolumeSpecName: "kube-api-access-7gmf4") pod "8d57a56b-c0d8-4143-a518-d8610674fe50" (UID: "8d57a56b-c0d8-4143-a518-d8610674fe50"). InnerVolumeSpecName "kube-api-access-7gmf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:38:15.154350 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.154331 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d57a56b-c0d8-4143-a518-d8610674fe50" (UID: "8d57a56b-c0d8-4143-a518-d8610674fe50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:38:15.252737 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.252689 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gmf4\" (UniqueName: \"kubernetes.io/projected/8d57a56b-c0d8-4143-a518-d8610674fe50-kube-api-access-7gmf4\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:15.252737 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.252724 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-trusted-ca-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:15.252737 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.252734 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-service-ca\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:15.252737 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.252743 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-serving-cert\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:15.253031 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.252753 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d57a56b-c0d8-4143-a518-d8610674fe50-console-oauth-config\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:15.253031 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.252761 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d57a56b-c0d8-4143-a518-d8610674fe50-console-config\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:15.866095 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.866054 2560 generic.go:356] "Generic (PLEG): container finished" podID="8d57a56b-c0d8-4143-a518-d8610674fe50" containerID="184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25" exitCode=0 Jun 11 11:38:15.866485 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.866102 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8cb6786d-hvlf2" Jun 11 11:38:15.866485 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.866138 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8cb6786d-hvlf2" event={"ID":"8d57a56b-c0d8-4143-a518-d8610674fe50","Type":"ContainerDied","Data":"184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25"} Jun 11 11:38:15.866485 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.866190 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8cb6786d-hvlf2" event={"ID":"8d57a56b-c0d8-4143-a518-d8610674fe50","Type":"ContainerDied","Data":"97fd323f1e57a49a286de236c2138e5e18bf508b16467f3cd67c016b559aafee"} Jun 11 11:38:15.866485 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.866213 2560 scope.go:117] "RemoveContainer" containerID="184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25" Jun 11 11:38:15.874590 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.874569 2560 scope.go:117] "RemoveContainer" containerID="184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25" Jun 11 11:38:15.874851 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:38:15.874831 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25\": container with ID starting with 184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25 not found: ID does not exist" containerID="184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25" Jun 11 11:38:15.874914 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.874860 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25"} err="failed to get container status \"184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25\": rpc error: code = NotFound desc = could not find container \"184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25\": container with ID starting with 184d718ba8a2363ae2112eedfba164584682fc950c786b8e26970e451d3c5e25 not found: ID does not exist" Jun 11 11:38:15.882202 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.882178 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8cb6786d-hvlf2"] Jun 11 11:38:15.887224 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:15.887201 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8cb6786d-hvlf2"] Jun 11 11:38:17.760696 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:17.760664 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d57a56b-c0d8-4143-a518-d8610674fe50" path="/var/lib/kubelet/pods/8d57a56b-c0d8-4143-a518-d8610674fe50/volumes" Jun 11 11:38:17.778540 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:17.778504 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:17.874260 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:17.874225 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:18.531098 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:18.531071 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fqm4h_85986698-ac25-4de0-b5cc-fdee5ab9e607/serve-healthcheck-canary/0.log" Jun 11 11:38:19.540901 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.540818 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" podUID="be369cd3-bfe3-4e14-b8ae-2808a470bf33" containerName="registry" containerID="cri-o://f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269" gracePeriod=30 Jun 11 11:38:19.793666 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.793602 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:38:19.883753 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.883720 2560 generic.go:356] "Generic (PLEG): container finished" podID="be369cd3-bfe3-4e14-b8ae-2808a470bf33" containerID="f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269" exitCode=0 Jun 11 11:38:19.883999 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.883775 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" Jun 11 11:38:19.883999 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.883806 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" event={"ID":"be369cd3-bfe3-4e14-b8ae-2808a470bf33","Type":"ContainerDied","Data":"f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269"} Jun 11 11:38:19.883999 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.883858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c68fc7468-mj6d7" event={"ID":"be369cd3-bfe3-4e14-b8ae-2808a470bf33","Type":"ContainerDied","Data":"6a65b7eb2e8d235ba891addfb6472bb0c9aa3e12d1f4d93587c6405215c0c2a2"} Jun 11 11:38:19.883999 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.883906 2560 scope.go:117] "RemoveContainer" containerID="f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269" Jun 11 11:38:19.892008 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.891989 2560 scope.go:117] "RemoveContainer" containerID="f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269" Jun 11 11:38:19.892271 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:38:19.892252 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269\": container with ID starting with f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269 not found: ID does not exist" containerID="f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269" Jun 11 11:38:19.892330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.892283 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269"} err="failed to get container status \"f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269\": rpc error: code = NotFound desc = could not find container \"f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269\": container with ID starting with f433fc55f47f40c869577badaf57b40b7f18ce3dc8a128e83904a2ea0555e269 not found: ID does not exist" Jun 11 11:38:19.894581 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894560 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-certificates\") pod \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " Jun 11 11:38:19.894660 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894614 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-trusted-ca\") pod \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " Jun 11 11:38:19.894699 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894660 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-image-registry-private-configuration\") pod \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " Jun 11 11:38:19.894699 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894688 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") pod \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " Jun 11 11:38:19.894794 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894734 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zmsm\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-kube-api-access-6zmsm\") pod \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " Jun 11 11:38:19.894794 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894775 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be369cd3-bfe3-4e14-b8ae-2808a470bf33-ca-trust-extracted\") pod \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " Jun 11 11:38:19.894923 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894802 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-installation-pull-secrets\") pod \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " Jun 11 11:38:19.894923 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894842 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-bound-sa-token\") pod \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\" (UID: \"be369cd3-bfe3-4e14-b8ae-2808a470bf33\") " Jun 11 11:38:19.895023 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.894989 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "be369cd3-bfe3-4e14-b8ae-2808a470bf33" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:38:19.895023 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.895002 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "be369cd3-bfe3-4e14-b8ae-2808a470bf33" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:38:19.895300 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.895280 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-trusted-ca\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:19.895447 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.895431 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-certificates\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:19.897977 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.897928 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "be369cd3-bfe3-4e14-b8ae-2808a470bf33" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:38:19.898089 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.898036 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-kube-api-access-6zmsm" (OuterVolumeSpecName: "kube-api-access-6zmsm") pod "be369cd3-bfe3-4e14-b8ae-2808a470bf33" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33"). InnerVolumeSpecName "kube-api-access-6zmsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:38:19.898089 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.898045 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "be369cd3-bfe3-4e14-b8ae-2808a470bf33" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:38:19.898089 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.898055 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "be369cd3-bfe3-4e14-b8ae-2808a470bf33" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:38:19.898089 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.898068 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "be369cd3-bfe3-4e14-b8ae-2808a470bf33" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:38:19.905940 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.905913 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be369cd3-bfe3-4e14-b8ae-2808a470bf33-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "be369cd3-bfe3-4e14-b8ae-2808a470bf33" (UID: "be369cd3-bfe3-4e14-b8ae-2808a470bf33"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:38:19.995887 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.995830 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zmsm\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-kube-api-access-6zmsm\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:19.995887 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.995857 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be369cd3-bfe3-4e14-b8ae-2808a470bf33-ca-trust-extracted\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:19.995887 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.995882 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-installation-pull-secrets\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:19.995887 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.995892 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-bound-sa-token\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:19.996128 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.995902 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be369cd3-bfe3-4e14-b8ae-2808a470bf33-image-registry-private-configuration\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:19.996128 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:19.995912 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be369cd3-bfe3-4e14-b8ae-2808a470bf33-registry-tls\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:38:20.206075 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:20.206042 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c68fc7468-mj6d7"] Jun 11 11:38:20.209545 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:20.209514 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c68fc7468-mj6d7"] Jun 11 11:38:21.761308 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:21.761273 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be369cd3-bfe3-4e14-b8ae-2808a470bf33" path="/var/lib/kubelet/pods/be369cd3-bfe3-4e14-b8ae-2808a470bf33/volumes" Jun 11 11:38:26.779189 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:26.779151 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:26.835611 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:26.835578 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:26.912295 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:26.912259 2560 generic.go:356] "Generic (PLEG): container finished" podID="3d463a97-4a7d-4130-9ab7-dd3bde06cd39" containerID="5d3c246cb92e840ff53134583034d08b28ef20d16a6a2458d320cc01ffc48a3a" exitCode=0 Jun 11 11:38:26.912463 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:26.912333 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" event={"ID":"3d463a97-4a7d-4130-9ab7-dd3bde06cd39","Type":"ContainerDied","Data":"5d3c246cb92e840ff53134583034d08b28ef20d16a6a2458d320cc01ffc48a3a"} Jun 11 11:38:26.912685 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:26.912667 2560 scope.go:117] "RemoveContainer" containerID="5d3c246cb92e840ff53134583034d08b28ef20d16a6a2458d320cc01ffc48a3a" Jun 11 11:38:26.913832 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:26.913806 2560 generic.go:356] "Generic (PLEG): container finished" podID="d2b82d93-3852-47f0-a5e1-c2a7105f201b" containerID="e8e35dea7213613cc856de8770e544c831333f9dbda8f390e93fb14283337ca9" exitCode=0 Jun 11 11:38:26.913929 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:26.913889 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" event={"ID":"d2b82d93-3852-47f0-a5e1-c2a7105f201b","Type":"ContainerDied","Data":"e8e35dea7213613cc856de8770e544c831333f9dbda8f390e93fb14283337ca9"} Jun 11 11:38:26.914183 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:26.914168 2560 scope.go:117] "RemoveContainer" containerID="e8e35dea7213613cc856de8770e544c831333f9dbda8f390e93fb14283337ca9" Jun 11 11:38:27.919397 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:27.919360 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fwnw4" event={"ID":"d2b82d93-3852-47f0-a5e1-c2a7105f201b","Type":"ContainerStarted","Data":"8509389fdb504029208d2847ad0ec4f5ba93dd13f360522946cb2b2503508f29"} Jun 11 11:38:27.921036 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:27.921014 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kfjlq" event={"ID":"3d463a97-4a7d-4130-9ab7-dd3bde06cd39","Type":"ContainerStarted","Data":"1002a5446a73d030bf34224df2591bb953312f2b87d6e0238614fdf8742cddc1"} Jun 11 11:38:29.829915 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:29.829850 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:29.889063 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:29.889022 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:37.019810 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:37.019763 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:37.138439 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:37.138397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:37.238091 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:37.238061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:52.657209 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:52.657169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:38:52.659622 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:52.659601 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e1f5764-f329-441a-8b48-0809878ca25f-metrics-certs\") pod \"network-metrics-daemon-w59m5\" (UID: \"7e1f5764-f329-441a-8b48-0809878ca25f\") " pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:38:52.859766 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:52.859726 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxm4w\"" Jun 11 11:38:52.867946 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:52.867921 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w59m5" Jun 11 11:38:53.008303 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:53.004175 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w59m5"] Jun 11 11:38:53.011564 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:38:53.011535 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1f5764_f329_441a_8b48_0809878ca25f.slice/crio-b30c217283bd72482265165ebcb6831c67a674ab19b0a641ae0c8d45e085defe WatchSource:0}: Error finding container b30c217283bd72482265165ebcb6831c67a674ab19b0a641ae0c8d45e085defe: Status 404 returned error can't find the container with id b30c217283bd72482265165ebcb6831c67a674ab19b0a641ae0c8d45e085defe Jun 11 11:38:53.019511 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:53.019484 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w59m5" event={"ID":"7e1f5764-f329-441a-8b48-0809878ca25f","Type":"ContainerStarted","Data":"b30c217283bd72482265165ebcb6831c67a674ab19b0a641ae0c8d45e085defe"} Jun 11 11:38:55.030241 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:55.030203 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w59m5" event={"ID":"7e1f5764-f329-441a-8b48-0809878ca25f","Type":"ContainerStarted","Data":"18e5f0f9f5a04b1e8cc71008b0880e66068960cbcdfcf0e4e9dbfad83b69b5f8"} Jun 11 11:38:55.030724 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:55.030270 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w59m5" event={"ID":"7e1f5764-f329-441a-8b48-0809878ca25f","Type":"ContainerStarted","Data":"d818499ea96fc93447c9e666428fbea3fdb34468113cdc1ceceef48da0cbf493"} Jun 11 11:38:55.056320 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:55.056265 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w59m5" podStartSLOduration=374.976415235 podStartE2EDuration="6m16.056249082s" totalImagesPullingTime="1.079833847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:38:55.05590107 +0000 UTC m=+375.759908783" watchObservedRunningTime="2026-06-11 11:38:55.056249082 +0000 UTC m=+375.760256767" Jun 11 11:38:55.191146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:55.191111 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:55.293279 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:55.293193 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:56.193489 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:56.193457 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:38:56.295407 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:38:56.295375 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:00.209235 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.209191 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c5dc8b6d7-hzh8r"] Jun 11 11:39:00.209713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.209634 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d57a56b-c0d8-4143-a518-d8610674fe50" containerName="console" Jun 11 11:39:00.209713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.209653 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d57a56b-c0d8-4143-a518-d8610674fe50" containerName="console" Jun 11 11:39:00.209713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.209682 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be369cd3-bfe3-4e14-b8ae-2808a470bf33" containerName="registry" Jun 11 11:39:00.209713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.209691 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="be369cd3-bfe3-4e14-b8ae-2808a470bf33" containerName="registry" Jun 11 11:39:00.209957 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.209783 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d57a56b-c0d8-4143-a518-d8610674fe50" containerName="console" Jun 11 11:39:00.209957 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.209798 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="be369cd3-bfe3-4e14-b8ae-2808a470bf33" containerName="registry" Jun 11 11:39:00.212881 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.212844 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.228767 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.228740 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c5dc8b6d7-hzh8r"] Jun 11 11:39:00.272011 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.271979 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:00.315285 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.315251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-trusted-ca-bundle\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.315456 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.315301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-oauth-serving-cert\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.315456 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.315331 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-service-ca\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.315456 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.315385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-oauth-config\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.315564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.315483 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-config\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.315564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.315537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-serving-cert\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.315636 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.315569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgkjl\" (UniqueName: \"kubernetes.io/projected/98624931-b7fe-4a8b-bb47-03a559d66ecf-kube-api-access-lgkjl\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.339158 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.339119 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:00.398435 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.398401 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:00.416506 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.416464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-service-ca\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.416699 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.416509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-oauth-config\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.416699 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.416560 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-config\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.416699 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.416600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-serving-cert\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.416699 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.416625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgkjl\" (UniqueName: \"kubernetes.io/projected/98624931-b7fe-4a8b-bb47-03a559d66ecf-kube-api-access-lgkjl\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.416699 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.416656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-trusted-ca-bundle\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.416699 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.416695 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-oauth-serving-cert\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.417363 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.417334 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-service-ca\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.417548 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.417405 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-config\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.417618 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.417595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-oauth-serving-cert\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.417661 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.417629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-trusted-ca-bundle\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.419244 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.419219 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-serving-cert\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.419339 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.419252 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-oauth-config\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.425421 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.425389 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgkjl\" (UniqueName: \"kubernetes.io/projected/98624931-b7fe-4a8b-bb47-03a559d66ecf-kube-api-access-lgkjl\") pod \"console-6c5dc8b6d7-hzh8r\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.521615 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.521528 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:00.656702 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:00.656667 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c5dc8b6d7-hzh8r"] Jun 11 11:39:00.659640 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:39:00.659607 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98624931_b7fe_4a8b_bb47_03a559d66ecf.slice/crio-0e97cf8e49cae13c6a5ff4877df00255973fd4e9e5f4b606fe75d2c1616b24b9 WatchSource:0}: Error finding container 0e97cf8e49cae13c6a5ff4877df00255973fd4e9e5f4b606fe75d2c1616b24b9: Status 404 returned error can't find the container with id 0e97cf8e49cae13c6a5ff4877df00255973fd4e9e5f4b606fe75d2c1616b24b9 Jun 11 11:39:01.026679 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:01.026644 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:01.053220 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:01.053189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5dc8b6d7-hzh8r" event={"ID":"98624931-b7fe-4a8b-bb47-03a559d66ecf","Type":"ContainerStarted","Data":"81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236"} Jun 11 11:39:01.053365 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:01.053237 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5dc8b6d7-hzh8r" event={"ID":"98624931-b7fe-4a8b-bb47-03a559d66ecf","Type":"ContainerStarted","Data":"0e97cf8e49cae13c6a5ff4877df00255973fd4e9e5f4b606fe75d2c1616b24b9"} Jun 11 11:39:01.080783 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:01.080730 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c5dc8b6d7-hzh8r" podStartSLOduration=1.080716006 podStartE2EDuration="1.080716006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:39:01.079627332 +0000 UTC m=+381.783635040" watchObservedRunningTime="2026-06-11 11:39:01.080716006 +0000 UTC m=+381.784723714" Jun 11 11:39:01.121767 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:01.121736 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:10.522302 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:10.522251 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:10.522895 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:10.522333 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:10.527021 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:10.526994 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:10.760394 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:10.760363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:10.844025 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:10.843940 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:11.098450 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:11.098369 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:39:11.155645 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:11.155613 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c878cdc8-shlnq"] Jun 11 11:39:11.287025 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:11.286990 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:11.383420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:11.383344 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:11.484477 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:11.484439 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:14.858604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:14.858571 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:14.959093 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:14.959060 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:18.130073 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:18.130031 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:18.194257 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:18.194218 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:36.177384 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.177316 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8c878cdc8-shlnq" podUID="b31043e8-d4e1-4443-a6a5-97d59ecf1583" containerName="console" containerID="cri-o://3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667" gracePeriod=15 Jun 11 11:39:36.417043 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.417018 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:39:36.519434 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519343 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-service-ca\") pod \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " Jun 11 11:39:36.519434 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519392 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-oauth-config\") pod \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " Jun 11 11:39:36.519434 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519428 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-config\") pod \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " Jun 11 11:39:36.519710 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519449 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-oauth-serving-cert\") pod \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " Jun 11 11:39:36.519710 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519472 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-serving-cert\") pod \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " Jun 11 11:39:36.519710 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519494 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-trusted-ca-bundle\") pod \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " Jun 11 11:39:36.519710 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519561 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c74q6\" (UniqueName: \"kubernetes.io/projected/b31043e8-d4e1-4443-a6a5-97d59ecf1583-kube-api-access-c74q6\") pod \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\" (UID: \"b31043e8-d4e1-4443-a6a5-97d59ecf1583\") " Jun 11 11:39:36.519988 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519938 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-service-ca" (OuterVolumeSpecName: "service-ca") pod "b31043e8-d4e1-4443-a6a5-97d59ecf1583" (UID: "b31043e8-d4e1-4443-a6a5-97d59ecf1583"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:39:36.519988 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519950 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-config" (OuterVolumeSpecName: "console-config") pod "b31043e8-d4e1-4443-a6a5-97d59ecf1583" (UID: "b31043e8-d4e1-4443-a6a5-97d59ecf1583"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:39:36.519988 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519959 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b31043e8-d4e1-4443-a6a5-97d59ecf1583" (UID: "b31043e8-d4e1-4443-a6a5-97d59ecf1583"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:39:36.519988 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.519970 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b31043e8-d4e1-4443-a6a5-97d59ecf1583" (UID: "b31043e8-d4e1-4443-a6a5-97d59ecf1583"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:39:36.521922 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.521835 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b31043e8-d4e1-4443-a6a5-97d59ecf1583" (UID: "b31043e8-d4e1-4443-a6a5-97d59ecf1583"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:39:36.522013 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.521937 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31043e8-d4e1-4443-a6a5-97d59ecf1583-kube-api-access-c74q6" (OuterVolumeSpecName: "kube-api-access-c74q6") pod "b31043e8-d4e1-4443-a6a5-97d59ecf1583" (UID: "b31043e8-d4e1-4443-a6a5-97d59ecf1583"). InnerVolumeSpecName "kube-api-access-c74q6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:39:36.522056 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.522007 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b31043e8-d4e1-4443-a6a5-97d59ecf1583" (UID: "b31043e8-d4e1-4443-a6a5-97d59ecf1583"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:39:36.620658 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.620620 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c74q6\" (UniqueName: \"kubernetes.io/projected/b31043e8-d4e1-4443-a6a5-97d59ecf1583-kube-api-access-c74q6\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:39:36.620658 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.620653 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-service-ca\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:39:36.620658 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.620663 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-oauth-config\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:39:36.620919 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.620673 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-config\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:39:36.620919 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.620682 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-oauth-serving-cert\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:39:36.620919 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.620690 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31043e8-d4e1-4443-a6a5-97d59ecf1583-console-serving-cert\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:39:36.620919 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:36.620698 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31043e8-d4e1-4443-a6a5-97d59ecf1583-trusted-ca-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:39:37.203367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.203327 2560 generic.go:356] "Generic (PLEG): container finished" podID="b31043e8-d4e1-4443-a6a5-97d59ecf1583" containerID="3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667" exitCode=0 Jun 11 11:39:37.203367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.203370 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c878cdc8-shlnq" Jun 11 11:39:37.203892 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.203423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c878cdc8-shlnq" event={"ID":"b31043e8-d4e1-4443-a6a5-97d59ecf1583","Type":"ContainerDied","Data":"3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667"} Jun 11 11:39:37.203892 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.203472 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c878cdc8-shlnq" event={"ID":"b31043e8-d4e1-4443-a6a5-97d59ecf1583","Type":"ContainerDied","Data":"6417aaaf3bd30453a5341b51d246412317fb2dd5b5d42a8bada290bb0d0d163a"} Jun 11 11:39:37.203892 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.203494 2560 scope.go:117] "RemoveContainer" containerID="3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667" Jun 11 11:39:37.212340 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.212325 2560 scope.go:117] "RemoveContainer" containerID="3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667" Jun 11 11:39:37.212592 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:39:37.212568 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667\": container with ID starting with 3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667 not found: ID does not exist" containerID="3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667" Jun 11 11:39:37.212664 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.212601 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667"} err="failed to get container status \"3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667\": rpc error: code = NotFound desc = could not find container \"3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667\": container with ID starting with 3de06ccf8a25854f4ceecf53c1281e62fc9b458550919435c4debb1561919667 not found: ID does not exist" Jun 11 11:39:37.224123 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.224087 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c878cdc8-shlnq"] Jun 11 11:39:37.227918 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.227849 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8c878cdc8-shlnq"] Jun 11 11:39:37.761152 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:37.761122 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31043e8-d4e1-4443-a6a5-97d59ecf1583" path="/var/lib/kubelet/pods/b31043e8-d4e1-4443-a6a5-97d59ecf1583/volumes" Jun 11 11:39:48.625288 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:48.625252 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:49.128371 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:49.128329 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:50.377258 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:50.377221 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:50.467784 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:50.467747 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:39:51.114064 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.114030 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5"] Jun 11 11:39:51.114336 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.114324 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31043e8-d4e1-4443-a6a5-97d59ecf1583" containerName="console" Jun 11 11:39:51.114378 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.114339 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31043e8-d4e1-4443-a6a5-97d59ecf1583" containerName="console" Jun 11 11:39:51.114412 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.114401 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31043e8-d4e1-4443-a6a5-97d59ecf1583" containerName="console" Jun 11 11:39:51.118931 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.118910 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.121469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.121451 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5b642\"" Jun 11 11:39:51.121686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.121672 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 11:39:51.122544 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.122529 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 11:39:51.126027 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.126004 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.126123 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.126053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsngj\" (UniqueName: \"kubernetes.io/projected/e8b64f16-85b7-494d-b866-6543aac1ae1b-kube-api-access-tsngj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.126123 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.126084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.129326 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.129308 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5"] Jun 11 11:39:51.226990 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.226941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsngj\" (UniqueName: \"kubernetes.io/projected/e8b64f16-85b7-494d-b866-6543aac1ae1b-kube-api-access-tsngj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.226990 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.226991 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.227201 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.227078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.227417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.227398 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.227460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.227429 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.235659 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.235630 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsngj\" (UniqueName: \"kubernetes.io/projected/e8b64f16-85b7-494d-b866-6543aac1ae1b-kube-api-access-tsngj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.428051 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.428013 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:39:51.559397 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:51.559371 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5"] Jun 11 11:39:51.562142 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:39:51.562113 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b64f16_85b7_494d_b866_6543aac1ae1b.slice/crio-946ac400164cb07fefe829972cf94d73ca019f23534d9c0799b8d10258c316bf WatchSource:0}: Error finding container 946ac400164cb07fefe829972cf94d73ca019f23534d9c0799b8d10258c316bf: Status 404 returned error can't find the container with id 946ac400164cb07fefe829972cf94d73ca019f23534d9c0799b8d10258c316bf Jun 11 11:39:52.262246 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:39:52.262212 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" event={"ID":"e8b64f16-85b7-494d-b866-6543aac1ae1b","Type":"ContainerStarted","Data":"946ac400164cb07fefe829972cf94d73ca019f23534d9c0799b8d10258c316bf"} Jun 11 11:40:00.302950 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:00.302911 2560 generic.go:356] "Generic (PLEG): container finished" podID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerID="ae5e476613d6a371abd363c4ef929e4d155e49903a766f8b3c127d22f6de3a47" exitCode=0 Jun 11 11:40:00.303330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:00.302998 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" event={"ID":"e8b64f16-85b7-494d-b866-6543aac1ae1b","Type":"ContainerDied","Data":"ae5e476613d6a371abd363c4ef929e4d155e49903a766f8b3c127d22f6de3a47"} Jun 11 11:40:03.316845 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:03.316810 2560 generic.go:356] "Generic (PLEG): container finished" podID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerID="5188bb5df341c675a07a4e97682fe8943985b5d09c3f14197d1362b2108b7ac3" exitCode=0 Jun 11 11:40:03.317200 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:03.316892 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" event={"ID":"e8b64f16-85b7-494d-b866-6543aac1ae1b","Type":"ContainerDied","Data":"5188bb5df341c675a07a4e97682fe8943985b5d09c3f14197d1362b2108b7ac3"} Jun 11 11:40:11.356996 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:11.356901 2560 generic.go:356] "Generic (PLEG): container finished" podID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerID="cddbb72622d8c3ae9e2bd48715bd97f25cd6163fa5826cc25a0c014396748ac1" exitCode=0 Jun 11 11:40:11.356996 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:11.356941 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" event={"ID":"e8b64f16-85b7-494d-b866-6543aac1ae1b","Type":"ContainerDied","Data":"cddbb72622d8c3ae9e2bd48715bd97f25cd6163fa5826cc25a0c014396748ac1"} Jun 11 11:40:12.489911 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.489886 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:40:12.580490 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.580452 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsngj\" (UniqueName: \"kubernetes.io/projected/e8b64f16-85b7-494d-b866-6543aac1ae1b-kube-api-access-tsngj\") pod \"e8b64f16-85b7-494d-b866-6543aac1ae1b\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " Jun 11 11:40:12.580490 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.580493 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-util\") pod \"e8b64f16-85b7-494d-b866-6543aac1ae1b\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " Jun 11 11:40:12.580750 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.580510 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-bundle\") pod \"e8b64f16-85b7-494d-b866-6543aac1ae1b\" (UID: \"e8b64f16-85b7-494d-b866-6543aac1ae1b\") " Jun 11 11:40:12.581192 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.581167 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-bundle" (OuterVolumeSpecName: "bundle") pod "e8b64f16-85b7-494d-b866-6543aac1ae1b" (UID: "e8b64f16-85b7-494d-b866-6543aac1ae1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:40:12.582791 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.582767 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8b64f16-85b7-494d-b866-6543aac1ae1b-kube-api-access-tsngj" (OuterVolumeSpecName: "kube-api-access-tsngj") pod "e8b64f16-85b7-494d-b866-6543aac1ae1b" (UID: "e8b64f16-85b7-494d-b866-6543aac1ae1b"). InnerVolumeSpecName "kube-api-access-tsngj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:40:12.584481 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.584458 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-util" (OuterVolumeSpecName: "util") pod "e8b64f16-85b7-494d-b866-6543aac1ae1b" (UID: "e8b64f16-85b7-494d-b866-6543aac1ae1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:40:12.681223 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.681183 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsngj\" (UniqueName: \"kubernetes.io/projected/e8b64f16-85b7-494d-b866-6543aac1ae1b-kube-api-access-tsngj\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:12.681223 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.681216 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:12.681223 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:12.681226 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8b64f16-85b7-494d-b866-6543aac1ae1b-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:13.366460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:13.366427 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" event={"ID":"e8b64f16-85b7-494d-b866-6543aac1ae1b","Type":"ContainerDied","Data":"946ac400164cb07fefe829972cf94d73ca019f23534d9c0799b8d10258c316bf"} Jun 11 11:40:13.366628 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:13.366468 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhl5x5" Jun 11 11:40:13.366628 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:13.366476 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="946ac400164cb07fefe829972cf94d73ca019f23534d9c0799b8d10258c316bf" Jun 11 11:40:13.486109 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:13.486049 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:13.586802 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:13.586765 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:17.139518 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:17.139486 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:18.057432 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:18.057381 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:19.093684 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.093644 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm"] Jun 11 11:40:19.094184 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.094088 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerName="extract" Jun 11 11:40:19.094184 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.094106 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerName="extract" Jun 11 11:40:19.094184 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.094132 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerName="util" Jun 11 11:40:19.094184 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.094141 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerName="util" Jun 11 11:40:19.094184 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.094168 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerName="pull" Jun 11 11:40:19.094184 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.094175 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerName="pull" Jun 11 11:40:19.094473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.094249 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8b64f16-85b7-494d-b866-6543aac1ae1b" containerName="extract" Jun 11 11:40:19.097218 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.097195 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" Jun 11 11:40:19.103975 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.103943 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:40:19.104105 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.104034 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-f559c\"" Jun 11 11:40:19.104195 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.104173 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 11:40:19.110325 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.110299 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm"] Jun 11 11:40:19.130997 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.130966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0db7f54-bfc0-479c-a578-398f0c2c0d69-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fzbbm\" (UID: \"c0db7f54-bfc0-479c-a578-398f0c2c0d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" Jun 11 11:40:19.131195 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.131040 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjmbv\" (UniqueName: \"kubernetes.io/projected/c0db7f54-bfc0-479c-a578-398f0c2c0d69-kube-api-access-sjmbv\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fzbbm\" (UID: \"c0db7f54-bfc0-479c-a578-398f0c2c0d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" Jun 11 11:40:19.232333 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.232291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjmbv\" (UniqueName: \"kubernetes.io/projected/c0db7f54-bfc0-479c-a578-398f0c2c0d69-kube-api-access-sjmbv\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fzbbm\" (UID: \"c0db7f54-bfc0-479c-a578-398f0c2c0d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" Jun 11 11:40:19.232500 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.232367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0db7f54-bfc0-479c-a578-398f0c2c0d69-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fzbbm\" (UID: \"c0db7f54-bfc0-479c-a578-398f0c2c0d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" Jun 11 11:40:19.232705 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.232689 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0db7f54-bfc0-479c-a578-398f0c2c0d69-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fzbbm\" (UID: \"c0db7f54-bfc0-479c-a578-398f0c2c0d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" Jun 11 11:40:19.249831 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.249796 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjmbv\" (UniqueName: \"kubernetes.io/projected/c0db7f54-bfc0-479c-a578-398f0c2c0d69-kube-api-access-sjmbv\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fzbbm\" (UID: \"c0db7f54-bfc0-479c-a578-398f0c2c0d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" Jun 11 11:40:19.406838 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.406812 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" Jun 11 11:40:19.557232 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:19.557197 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm"] Jun 11 11:40:19.560916 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:40:19.560887 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0db7f54_bfc0_479c_a578_398f0c2c0d69.slice/crio-939c6306140cfb1301a6eb9a96de9904940bf1ffc052f4e204c9f419b3f54782 WatchSource:0}: Error finding container 939c6306140cfb1301a6eb9a96de9904940bf1ffc052f4e204c9f419b3f54782: Status 404 returned error can't find the container with id 939c6306140cfb1301a6eb9a96de9904940bf1ffc052f4e204c9f419b3f54782 Jun 11 11:40:20.395078 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:20.395042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" event={"ID":"c0db7f54-bfc0-479c-a578-398f0c2c0d69","Type":"ContainerStarted","Data":"939c6306140cfb1301a6eb9a96de9904940bf1ffc052f4e204c9f419b3f54782"} Jun 11 11:40:20.791793 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:20.791757 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:20.891722 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:20.891681 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:22.398822 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:22.398771 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:22.405374 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:22.405344 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" event={"ID":"c0db7f54-bfc0-479c-a578-398f0c2c0d69","Type":"ContainerStarted","Data":"104ab34c9008436cba244a8b6b0f213ea064bbc594d5cf345ce7e8327e68c999"} Jun 11 11:40:22.430551 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:22.430487 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fzbbm" podStartSLOduration=1.575406664 podStartE2EDuration="3.430470889s" totalImagesPullingTime="1.855064225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:40:22.428514994 +0000 UTC m=+463.132522728" watchObservedRunningTime="2026-06-11 11:40:22.430470889 +0000 UTC m=+463.134478597" Jun 11 11:40:22.502679 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:22.502640 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:22.824831 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:22.824752 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:22.991926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:22.991889 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:23.493953 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.493923 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc"] Jun 11 11:40:23.496927 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.496909 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.499566 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.499547 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 11:40:23.499701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.499621 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5b642\"" Jun 11 11:40:23.500762 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.500748 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 11:40:23.507010 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.506991 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc"] Jun 11 11:40:23.567039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.566997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.567039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.567042 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jb6c\" (UniqueName: \"kubernetes.io/projected/162d618a-0430-4ecb-a5e9-57fbd5a16eab-kube-api-access-8jb6c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.567278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.567138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.668043 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.668001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.668221 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.668072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.668221 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.668098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jb6c\" (UniqueName: \"kubernetes.io/projected/162d618a-0430-4ecb-a5e9-57fbd5a16eab-kube-api-access-8jb6c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.668454 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.668433 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.668495 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.668452 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.677072 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.677042 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jb6c\" (UniqueName: \"kubernetes.io/projected/162d618a-0430-4ecb-a5e9-57fbd5a16eab-kube-api-access-8jb6c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.805901 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.805795 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:23.945107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:23.945030 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc"] Jun 11 11:40:23.947490 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:40:23.947461 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162d618a_0430_4ecb_a5e9_57fbd5a16eab.slice/crio-44807dd4ca700c973b4e1a6ffdeaa29b90c233b17c5e747eaa662d64fd99b132 WatchSource:0}: Error finding container 44807dd4ca700c973b4e1a6ffdeaa29b90c233b17c5e747eaa662d64fd99b132: Status 404 returned error can't find the container with id 44807dd4ca700c973b4e1a6ffdeaa29b90c233b17c5e747eaa662d64fd99b132 Jun 11 11:40:24.415853 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:24.415818 2560 generic.go:356] "Generic (PLEG): container finished" podID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerID="8e6426609d3879c7266f3c40c1b1a94fa76f9d2f3d286c1e10e476b1f7184e49" exitCode=0 Jun 11 11:40:24.416039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:24.415906 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" event={"ID":"162d618a-0430-4ecb-a5e9-57fbd5a16eab","Type":"ContainerDied","Data":"8e6426609d3879c7266f3c40c1b1a94fa76f9d2f3d286c1e10e476b1f7184e49"} Jun 11 11:40:24.416039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:24.415971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" event={"ID":"162d618a-0430-4ecb-a5e9-57fbd5a16eab","Type":"ContainerStarted","Data":"44807dd4ca700c973b4e1a6ffdeaa29b90c233b17c5e747eaa662d64fd99b132"} Jun 11 11:40:25.069073 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.068992 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq"] Jun 11 11:40:25.072032 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.072011 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:25.074584 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.074564 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 11:40:25.075627 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.075609 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 11:40:25.075720 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.075616 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4p7mp\"" Jun 11 11:40:25.084539 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.084520 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq"] Jun 11 11:40:25.179282 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.179247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12a759b7-26fa-42d9-ac61-c5f6efd6fd48-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hs6kq\" (UID: \"12a759b7-26fa-42d9-ac61-c5f6efd6fd48\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:25.179469 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.179306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46hjh\" (UniqueName: \"kubernetes.io/projected/12a759b7-26fa-42d9-ac61-c5f6efd6fd48-kube-api-access-46hjh\") pod \"cert-manager-webhook-7dc76cbb94-hs6kq\" (UID: \"12a759b7-26fa-42d9-ac61-c5f6efd6fd48\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:25.280537 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.280497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12a759b7-26fa-42d9-ac61-c5f6efd6fd48-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hs6kq\" (UID: \"12a759b7-26fa-42d9-ac61-c5f6efd6fd48\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:25.280701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.280550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46hjh\" (UniqueName: \"kubernetes.io/projected/12a759b7-26fa-42d9-ac61-c5f6efd6fd48-kube-api-access-46hjh\") pod \"cert-manager-webhook-7dc76cbb94-hs6kq\" (UID: \"12a759b7-26fa-42d9-ac61-c5f6efd6fd48\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:25.290163 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.290128 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12a759b7-26fa-42d9-ac61-c5f6efd6fd48-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hs6kq\" (UID: \"12a759b7-26fa-42d9-ac61-c5f6efd6fd48\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:25.290270 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.290255 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46hjh\" (UniqueName: \"kubernetes.io/projected/12a759b7-26fa-42d9-ac61-c5f6efd6fd48-kube-api-access-46hjh\") pod \"cert-manager-webhook-7dc76cbb94-hs6kq\" (UID: \"12a759b7-26fa-42d9-ac61-c5f6efd6fd48\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:25.393713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.393623 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:25.523572 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.523522 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq"] Jun 11 11:40:25.525768 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:40:25.525741 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12a759b7_26fa_42d9_ac61_c5f6efd6fd48.slice/crio-8132bb99c4b4d22a2b00535502ec769f6d473d2bbbdc1fd83a2c73bbdafb6639 WatchSource:0}: Error finding container 8132bb99c4b4d22a2b00535502ec769f6d473d2bbbdc1fd83a2c73bbdafb6639: Status 404 returned error can't find the container with id 8132bb99c4b4d22a2b00535502ec769f6d473d2bbbdc1fd83a2c73bbdafb6639 Jun 11 11:40:25.714701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:25.714651 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:26.285952 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:26.285917 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:26.426564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:26.426514 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" event={"ID":"12a759b7-26fa-42d9-ac61-c5f6efd6fd48","Type":"ContainerStarted","Data":"8132bb99c4b4d22a2b00535502ec769f6d473d2bbbdc1fd83a2c73bbdafb6639"} Jun 11 11:40:27.534330 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:27.534292 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:27.605698 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:27.605663 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:27.910477 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:27.910442 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl"] Jun 11 11:40:27.914138 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:27.914115 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" Jun 11 11:40:27.916693 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:27.916667 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2lv8v\"" Jun 11 11:40:27.922852 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:27.922828 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl"] Jun 11 11:40:28.005973 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.005925 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a32d447-4667-4147-9e5f-cd74a7ad868a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-6vnnl\" (UID: \"9a32d447-4667-4147-9e5f-cd74a7ad868a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" Jun 11 11:40:28.006155 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.006062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfjxb\" (UniqueName: \"kubernetes.io/projected/9a32d447-4667-4147-9e5f-cd74a7ad868a-kube-api-access-cfjxb\") pod \"cert-manager-cainjector-5d99449ffd-6vnnl\" (UID: \"9a32d447-4667-4147-9e5f-cd74a7ad868a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" Jun 11 11:40:28.107490 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.107439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfjxb\" (UniqueName: \"kubernetes.io/projected/9a32d447-4667-4147-9e5f-cd74a7ad868a-kube-api-access-cfjxb\") pod \"cert-manager-cainjector-5d99449ffd-6vnnl\" (UID: \"9a32d447-4667-4147-9e5f-cd74a7ad868a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" Jun 11 11:40:28.107651 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.107542 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a32d447-4667-4147-9e5f-cd74a7ad868a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-6vnnl\" (UID: \"9a32d447-4667-4147-9e5f-cd74a7ad868a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" Jun 11 11:40:28.117045 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.117012 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a32d447-4667-4147-9e5f-cd74a7ad868a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-6vnnl\" (UID: \"9a32d447-4667-4147-9e5f-cd74a7ad868a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" Jun 11 11:40:28.117229 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.117202 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfjxb\" (UniqueName: \"kubernetes.io/projected/9a32d447-4667-4147-9e5f-cd74a7ad868a-kube-api-access-cfjxb\") pod \"cert-manager-cainjector-5d99449ffd-6vnnl\" (UID: \"9a32d447-4667-4147-9e5f-cd74a7ad868a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" Jun 11 11:40:28.225519 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.225418 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" Jun 11 11:40:28.439582 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.439542 2560 generic.go:356] "Generic (PLEG): container finished" podID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerID="e3eda3cd8a3a79ff1db8828c984f1309bd00d34c6a8a413d766c335b26eb2648" exitCode=0 Jun 11 11:40:28.439769 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.439596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" event={"ID":"162d618a-0430-4ecb-a5e9-57fbd5a16eab","Type":"ContainerDied","Data":"e3eda3cd8a3a79ff1db8828c984f1309bd00d34c6a8a413d766c335b26eb2648"} Jun 11 11:40:28.875419 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:28.875393 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl"] Jun 11 11:40:28.878317 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:40:28.878280 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a32d447_4667_4147_9e5f_cd74a7ad868a.slice/crio-58cc44d3dbffd28a30e946b7304ca4856b08753cefe67ef32850ec0e0d7168b2 WatchSource:0}: Error finding container 58cc44d3dbffd28a30e946b7304ca4856b08753cefe67ef32850ec0e0d7168b2: Status 404 returned error can't find the container with id 58cc44d3dbffd28a30e946b7304ca4856b08753cefe67ef32850ec0e0d7168b2 Jun 11 11:40:29.445974 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:29.445933 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" event={"ID":"9a32d447-4667-4147-9e5f-cd74a7ad868a","Type":"ContainerStarted","Data":"f03b678eff6aa3ba69eae0eeb5a2e16856c806ec90776ae9b5639f354340a2cc"} Jun 11 11:40:29.446153 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:29.445987 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" event={"ID":"9a32d447-4667-4147-9e5f-cd74a7ad868a","Type":"ContainerStarted","Data":"58cc44d3dbffd28a30e946b7304ca4856b08753cefe67ef32850ec0e0d7168b2"} Jun 11 11:40:29.447971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:29.447943 2560 generic.go:356] "Generic (PLEG): container finished" podID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerID="38d8ba127b4674138a9c07a242b63c9ad165eba02dbb7a182e50ffafae8b69fd" exitCode=0 Jun 11 11:40:29.448095 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:29.448010 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" event={"ID":"162d618a-0430-4ecb-a5e9-57fbd5a16eab","Type":"ContainerDied","Data":"38d8ba127b4674138a9c07a242b63c9ad165eba02dbb7a182e50ffafae8b69fd"} Jun 11 11:40:29.449422 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:29.449385 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" event={"ID":"12a759b7-26fa-42d9-ac61-c5f6efd6fd48","Type":"ContainerStarted","Data":"b1476a952c04aeddc50df245aff79a8017b6d59d71ea05632c6c6ce1bcd9ca5a"} Jun 11 11:40:29.449515 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:29.449443 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:29.462532 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:29.462486 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6vnnl" podStartSLOduration=2.462473213 podStartE2EDuration="2.462473213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:40:29.460751446 +0000 UTC m=+470.164759154" watchObservedRunningTime="2026-06-11 11:40:29.462473213 +0000 UTC m=+470.166480920" Jun 11 11:40:29.493387 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:29.493334 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" podStartSLOduration=1.212297191 podStartE2EDuration="4.493317097s" totalImagesPullingTime="3.281019906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:40:29.492392122 +0000 UTC m=+470.196399829" watchObservedRunningTime="2026-06-11 11:40:29.493317097 +0000 UTC m=+470.197324804" Jun 11 11:40:30.579604 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.579574 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:30.630682 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.630648 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-util\") pod \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " Jun 11 11:40:30.630842 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.630732 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-bundle\") pod \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " Jun 11 11:40:30.630842 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.630766 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jb6c\" (UniqueName: \"kubernetes.io/projected/162d618a-0430-4ecb-a5e9-57fbd5a16eab-kube-api-access-8jb6c\") pod \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\" (UID: \"162d618a-0430-4ecb-a5e9-57fbd5a16eab\") " Jun 11 11:40:30.631150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.631125 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-bundle" (OuterVolumeSpecName: "bundle") pod "162d618a-0430-4ecb-a5e9-57fbd5a16eab" (UID: "162d618a-0430-4ecb-a5e9-57fbd5a16eab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:40:30.632930 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.632906 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/162d618a-0430-4ecb-a5e9-57fbd5a16eab-kube-api-access-8jb6c" (OuterVolumeSpecName: "kube-api-access-8jb6c") pod "162d618a-0430-4ecb-a5e9-57fbd5a16eab" (UID: "162d618a-0430-4ecb-a5e9-57fbd5a16eab"). InnerVolumeSpecName "kube-api-access-8jb6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:40:30.635941 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.635341 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-util" (OuterVolumeSpecName: "util") pod "162d618a-0430-4ecb-a5e9-57fbd5a16eab" (UID: "162d618a-0430-4ecb-a5e9-57fbd5a16eab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:40:30.732146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.732057 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jb6c\" (UniqueName: \"kubernetes.io/projected/162d618a-0430-4ecb-a5e9-57fbd5a16eab-kube-api-access-8jb6c\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:30.732146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.732090 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:30.732146 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:30.732100 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/162d618a-0430-4ecb-a5e9-57fbd5a16eab-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:31.459580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:31.459539 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" event={"ID":"162d618a-0430-4ecb-a5e9-57fbd5a16eab","Type":"ContainerDied","Data":"44807dd4ca700c973b4e1a6ffdeaa29b90c233b17c5e747eaa662d64fd99b132"} Jun 11 11:40:31.459757 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:31.459598 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44807dd4ca700c973b4e1a6ffdeaa29b90c233b17c5e747eaa662d64fd99b132" Jun 11 11:40:31.459757 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:31.459561 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5jqc" Jun 11 11:40:34.126510 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:34.126468 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:35.210954 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:35.210849 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:35.311333 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:35.311298 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:35.455434 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:35.455401 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hs6kq" Jun 11 11:40:36.406329 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.406292 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55"] Jun 11 11:40:36.406785 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.406758 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerName="extract" Jun 11 11:40:36.406785 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.406776 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerName="extract" Jun 11 11:40:36.406948 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.406791 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerName="util" Jun 11 11:40:36.406948 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.406799 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerName="util" Jun 11 11:40:36.406948 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.406812 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerName="pull" Jun 11 11:40:36.406948 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.406821 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerName="pull" Jun 11 11:40:36.407135 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.406954 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="162d618a-0430-4ecb-a5e9-57fbd5a16eab" containerName="extract" Jun 11 11:40:36.411038 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.411017 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" Jun 11 11:40:36.413780 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.413759 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:40:36.413915 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.413815 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 11:40:36.414621 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.414601 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9rkj7\"" Jun 11 11:40:36.419860 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.419830 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55"] Jun 11 11:40:36.480201 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.480170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln94v\" (UniqueName: \"kubernetes.io/projected/c5f1e5f7-c912-43d6-809a-9687a982d079-kube-api-access-ln94v\") pod \"openshift-lws-operator-fd8ccff4c-rtl55\" (UID: \"c5f1e5f7-c912-43d6-809a-9687a982d079\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" Jun 11 11:40:36.480382 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.480219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5f1e5f7-c912-43d6-809a-9687a982d079-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rtl55\" (UID: \"c5f1e5f7-c912-43d6-809a-9687a982d079\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" Jun 11 11:40:36.581735 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.581696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5f1e5f7-c912-43d6-809a-9687a982d079-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rtl55\" (UID: \"c5f1e5f7-c912-43d6-809a-9687a982d079\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" Jun 11 11:40:36.581958 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.581778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln94v\" (UniqueName: \"kubernetes.io/projected/c5f1e5f7-c912-43d6-809a-9687a982d079-kube-api-access-ln94v\") pod \"openshift-lws-operator-fd8ccff4c-rtl55\" (UID: \"c5f1e5f7-c912-43d6-809a-9687a982d079\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" Jun 11 11:40:36.582206 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.582182 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5f1e5f7-c912-43d6-809a-9687a982d079-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rtl55\" (UID: \"c5f1e5f7-c912-43d6-809a-9687a982d079\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" Jun 11 11:40:36.589645 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.589623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln94v\" (UniqueName: \"kubernetes.io/projected/c5f1e5f7-c912-43d6-809a-9687a982d079-kube-api-access-ln94v\") pod \"openshift-lws-operator-fd8ccff4c-rtl55\" (UID: \"c5f1e5f7-c912-43d6-809a-9687a982d079\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" Jun 11 11:40:36.720988 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.720896 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" Jun 11 11:40:36.853683 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:36.853484 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55"] Jun 11 11:40:36.856675 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:40:36.856638 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5f1e5f7_c912_43d6_809a_9687a982d079.slice/crio-7b3d574b61912a39a36d6711b90a20fdbc9b9ed10b21d95b0fe8923ee0f64fad WatchSource:0}: Error finding container 7b3d574b61912a39a36d6711b90a20fdbc9b9ed10b21d95b0fe8923ee0f64fad: Status 404 returned error can't find the container with id 7b3d574b61912a39a36d6711b90a20fdbc9b9ed10b21d95b0fe8923ee0f64fad Jun 11 11:40:37.487845 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:37.487810 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" event={"ID":"c5f1e5f7-c912-43d6-809a-9687a982d079","Type":"ContainerStarted","Data":"7b3d574b61912a39a36d6711b90a20fdbc9b9ed10b21d95b0fe8923ee0f64fad"} Jun 11 11:40:40.503250 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:40.503206 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" event={"ID":"c5f1e5f7-c912-43d6-809a-9687a982d079","Type":"ContainerStarted","Data":"5a74aa1ec726f2fb8127c8f00dfa84d0c8948946cf372822ae95e79f1df7b370"} Jun 11 11:40:40.521399 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:40.521346 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rtl55" podStartSLOduration=1.599164668 podStartE2EDuration="4.521331286s" totalImagesPullingTime="2.922166618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:40:40.518802719 +0000 UTC m=+481.222810427" watchObservedRunningTime="2026-06-11 11:40:40.521331286 +0000 UTC m=+481.225338993" Jun 11 11:40:41.330124 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:41.330088 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:41.432037 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:41.431999 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:43.040766 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.040728 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb"] Jun 11 11:40:43.043189 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.043169 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.045615 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.045595 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5b642\"" Jun 11 11:40:43.045719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.045613 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 11:40:43.046625 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.046605 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 11:40:43.052382 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.052360 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb"] Jun 11 11:40:43.139884 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.139841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4llvj\" (UniqueName: \"kubernetes.io/projected/e6c1e512-530a-4f7c-93f9-5a39247f3a51-kube-api-access-4llvj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.140060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.139938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.140060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.139969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.240422 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.240387 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.240586 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.240456 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4llvj\" (UniqueName: \"kubernetes.io/projected/e6c1e512-530a-4f7c-93f9-5a39247f3a51-kube-api-access-4llvj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.240586 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.240493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.240782 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.240763 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.240833 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.240814 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.249650 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.249620 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4llvj\" (UniqueName: \"kubernetes.io/projected/e6c1e512-530a-4f7c-93f9-5a39247f3a51-kube-api-access-4llvj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.352925 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.352836 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:43.497349 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.497301 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb"] Jun 11 11:40:43.500410 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:40:43.500385 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c1e512_530a_4f7c_93f9_5a39247f3a51.slice/crio-d1bc7e3d2574c733dc7265cb2462f44b323cc48f987bf7b691cdaceaf49f708c WatchSource:0}: Error finding container d1bc7e3d2574c733dc7265cb2462f44b323cc48f987bf7b691cdaceaf49f708c: Status 404 returned error can't find the container with id d1bc7e3d2574c733dc7265cb2462f44b323cc48f987bf7b691cdaceaf49f708c Jun 11 11:40:43.500410 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.500394 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:43.517070 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:43.517030 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" event={"ID":"e6c1e512-530a-4f7c-93f9-5a39247f3a51","Type":"ContainerStarted","Data":"d1bc7e3d2574c733dc7265cb2462f44b323cc48f987bf7b691cdaceaf49f708c"} Jun 11 11:40:44.523509 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:44.523418 2560 generic.go:356] "Generic (PLEG): container finished" podID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerID="4a6c2c9dd644fa908312fa097cc537c17a9dade6b2aa4588a09839dd169fa58a" exitCode=0 Jun 11 11:40:44.523959 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:44.523511 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" event={"ID":"e6c1e512-530a-4f7c-93f9-5a39247f3a51","Type":"ContainerDied","Data":"4a6c2c9dd644fa908312fa097cc537c17a9dade6b2aa4588a09839dd169fa58a"} Jun 11 11:40:45.529347 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:45.529314 2560 generic.go:356] "Generic (PLEG): container finished" podID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerID="057cffa8970c469eb6e0c65607ef87afaa50951740139531e2bb08362f12233e" exitCode=0 Jun 11 11:40:45.529742 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:45.529402 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" event={"ID":"e6c1e512-530a-4f7c-93f9-5a39247f3a51","Type":"ContainerDied","Data":"057cffa8970c469eb6e0c65607ef87afaa50951740139531e2bb08362f12233e"} Jun 11 11:40:46.536521 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:46.536487 2560 generic.go:356] "Generic (PLEG): container finished" podID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerID="0714e7e7e22cc2425bffa46d5095ef2c10e72ed09e7e4696abfa3ca70d80e438" exitCode=0 Jun 11 11:40:46.536943 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:46.536565 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" event={"ID":"e6c1e512-530a-4f7c-93f9-5a39247f3a51","Type":"ContainerDied","Data":"0714e7e7e22cc2425bffa46d5095ef2c10e72ed09e7e4696abfa3ca70d80e438"} Jun 11 11:40:47.191581 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.191547 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:47.254072 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.254039 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:47.673297 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.673270 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:47.775757 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.775722 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4llvj\" (UniqueName: \"kubernetes.io/projected/e6c1e512-530a-4f7c-93f9-5a39247f3a51-kube-api-access-4llvj\") pod \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " Jun 11 11:40:47.775931 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.775785 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-bundle\") pod \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " Jun 11 11:40:47.775931 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.775822 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-util\") pod \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\" (UID: \"e6c1e512-530a-4f7c-93f9-5a39247f3a51\") " Jun 11 11:40:47.776549 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.776469 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-bundle" (OuterVolumeSpecName: "bundle") pod "e6c1e512-530a-4f7c-93f9-5a39247f3a51" (UID: "e6c1e512-530a-4f7c-93f9-5a39247f3a51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:40:47.778010 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.777983 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c1e512-530a-4f7c-93f9-5a39247f3a51-kube-api-access-4llvj" (OuterVolumeSpecName: "kube-api-access-4llvj") pod "e6c1e512-530a-4f7c-93f9-5a39247f3a51" (UID: "e6c1e512-530a-4f7c-93f9-5a39247f3a51"). InnerVolumeSpecName "kube-api-access-4llvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:40:47.781538 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.781502 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-util" (OuterVolumeSpecName: "util") pod "e6c1e512-530a-4f7c-93f9-5a39247f3a51" (UID: "e6c1e512-530a-4f7c-93f9-5a39247f3a51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:40:47.876621 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.876525 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4llvj\" (UniqueName: \"kubernetes.io/projected/e6c1e512-530a-4f7c-93f9-5a39247f3a51-kube-api-access-4llvj\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:47.876621 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.876561 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:47.876621 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:47.876574 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6c1e512-530a-4f7c-93f9-5a39247f3a51-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:40:48.547770 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:48.547726 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" event={"ID":"e6c1e512-530a-4f7c-93f9-5a39247f3a51","Type":"ContainerDied","Data":"d1bc7e3d2574c733dc7265cb2462f44b323cc48f987bf7b691cdaceaf49f708c"} Jun 11 11:40:48.547770 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:48.547762 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsl7fb" Jun 11 11:40:48.547999 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:48.547819 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1bc7e3d2574c733dc7265cb2462f44b323cc48f987bf7b691cdaceaf49f708c" Jun 11 11:40:51.727393 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:51.727360 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:51.812856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:51.812814 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:58.966533 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:58.966497 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:59.060630 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:59.060584 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:59.780504 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:59.780470 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:40:59.993360 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:40:59.993312 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:00.096377 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.096269 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:00.116124 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.116096 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh"] Jun 11 11:41:00.116426 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.116413 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerName="pull" Jun 11 11:41:00.116470 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.116428 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerName="pull" Jun 11 11:41:00.116470 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.116444 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerName="extract" Jun 11 11:41:00.116470 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.116450 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerName="extract" Jun 11 11:41:00.116470 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.116457 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerName="util" Jun 11 11:41:00.116470 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.116463 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerName="util" Jun 11 11:41:00.116621 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.116513 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6c1e512-530a-4f7c-93f9-5a39247f3a51" containerName="extract" Jun 11 11:41:00.119629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.119611 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.122450 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.122417 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 11:41:00.122684 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.122661 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 11:41:00.122762 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.122746 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 11:41:00.122806 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.122778 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 11:41:00.122806 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.122788 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gs8j6\"" Jun 11 11:41:00.138971 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.138940 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh"] Jun 11 11:41:00.292170 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.292135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-manifests\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.292170 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.292170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.292394 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.292213 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vmwh\" (UniqueName: \"kubernetes.io/projected/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-kube-api-access-2vmwh\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.292394 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.292252 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.292394 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.292281 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-tmp\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.338508 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.338470 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:00.393729 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.393634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-tmp\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.393729 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.393688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-manifests\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.393729 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.393716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.394054 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.393771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vmwh\" (UniqueName: \"kubernetes.io/projected/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-kube-api-access-2vmwh\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.394054 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.393802 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.394246 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.394220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-manifests\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.396220 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.396198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-tmp\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.396422 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.396405 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.396481 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.396412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.411379 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.411348 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vmwh\" (UniqueName: \"kubernetes.io/projected/e93fa1e0-ce7f-4fee-8cb9-e14be3944056-kube-api-access-2vmwh\") pod \"opendatahub-operator-controller-manager-69b86f57c5-bj8mh\" (UID: \"e93fa1e0-ce7f-4fee-8cb9-e14be3944056\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.429903 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.429845 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:00.438268 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.438241 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:00.539629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.539596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:00.573049 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.573016 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh"] Jun 11 11:41:00.575455 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:00.575421 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93fa1e0_ce7f_4fee_8cb9_e14be3944056.slice/crio-02cb91689779b93ebc217dafb2dde2d1d08e5d7db49319b8eb64a7f808a7bf75 WatchSource:0}: Error finding container 02cb91689779b93ebc217dafb2dde2d1d08e5d7db49319b8eb64a7f808a7bf75: Status 404 returned error can't find the container with id 02cb91689779b93ebc217dafb2dde2d1d08e5d7db49319b8eb64a7f808a7bf75 Jun 11 11:41:00.605715 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.605679 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" event={"ID":"e93fa1e0-ce7f-4fee-8cb9-e14be3944056","Type":"ContainerStarted","Data":"02cb91689779b93ebc217dafb2dde2d1d08e5d7db49319b8eb64a7f808a7bf75"} Jun 11 11:41:00.609352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.609322 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:00.688756 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.688718 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:00.788900 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:00.788847 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:03.628625 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:03.628584 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" event={"ID":"e93fa1e0-ce7f-4fee-8cb9-e14be3944056","Type":"ContainerStarted","Data":"0145a4a39e62e030c7ed3e94b61d3e9416aeb485abe947e6be56970f254767dc"} Jun 11 11:41:04.634922 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:04.634887 2560 generic.go:356] "Generic (PLEG): container finished" podID="e93fa1e0-ce7f-4fee-8cb9-e14be3944056" containerID="0145a4a39e62e030c7ed3e94b61d3e9416aeb485abe947e6be56970f254767dc" exitCode=0 Jun 11 11:41:04.635306 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:04.634937 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" event={"ID":"e93fa1e0-ce7f-4fee-8cb9-e14be3944056","Type":"ContainerDied","Data":"0145a4a39e62e030c7ed3e94b61d3e9416aeb485abe947e6be56970f254767dc"} Jun 11 11:41:05.642356 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:05.642314 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" event={"ID":"e93fa1e0-ce7f-4fee-8cb9-e14be3944056","Type":"ContainerStarted","Data":"16c4e1d0cff403be0baaf17a956ed3bf031c2d7e0ca24aae000c5b2ef49fc974"} Jun 11 11:41:05.642814 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:05.642529 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:05.666436 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:05.666385 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" podStartSLOduration=1.467502884 podStartE2EDuration="5.666369472s" totalImagesPullingTime="3.226215298s" totalInitContainerRuntime="972.65129ms" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:05.663840419 +0000 UTC m=+506.367848127" watchObservedRunningTime="2026-06-11 11:41:05.666369472 +0000 UTC m=+506.370377179" Jun 11 11:41:14.216629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:14.216596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:16.649628 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:16.649598 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-bj8mh" Jun 11 11:41:18.200681 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.200648 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:18.321801 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.321763 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:18.508891 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.508777 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:18.683428 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.683380 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:18.784982 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.784884 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6"] Jun 11 11:41:18.789949 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.789925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.792933 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.792894 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 11:41:18.793858 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.793836 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-74rtl\"" Jun 11 11:41:18.793997 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.793882 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 11:41:18.793997 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.793894 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 11:41:18.793997 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.793890 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 11:41:18.805368 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.805340 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6"] Jun 11 11:41:18.835268 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.835238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tvr8\" (UniqueName: \"kubernetes.io/projected/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-kube-api-access-8tvr8\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.835419 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.835285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tls-certs\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.835419 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.835360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tmp\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.936500 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.936458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tmp\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.936500 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.936503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tvr8\" (UniqueName: \"kubernetes.io/projected/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-kube-api-access-8tvr8\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.936706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.936537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tls-certs\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.936706 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:41:18.936643 2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 11:41:18.936790 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:41:18.936716 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tls-certs podName:c9255614-3d88-4dfc-a8ec-ef3ecf1be41a nodeName:}" failed. No retries permitted until 2026-06-11 11:41:19.436697073 +0000 UTC m=+520.140704761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tls-certs") pod "kube-auth-proxy-74bc6b598d-w2jf6" (UID: "c9255614-3d88-4dfc-a8ec-ef3ecf1be41a") : secret "kube-auth-proxy-tls" not found Jun 11 11:41:18.938992 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.938963 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tmp\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.958666 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.958630 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tvr8\" (UniqueName: \"kubernetes.io/projected/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-kube-api-access-8tvr8\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:18.961724 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.961700 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-96l44"] Jun 11 11:41:18.964222 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.964198 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:18.966969 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.966948 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 11:41:18.967068 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.967049 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jnd95\"" Jun 11 11:41:18.986736 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:18.986706 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-96l44"] Jun 11 11:41:19.014154 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.014122 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:19.037070 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.036986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpdfm\" (UniqueName: \"kubernetes.io/projected/7e05d947-873c-4e13-a6d0-e1556d2655e1-kube-api-access-fpdfm\") pod \"odh-model-controller-6dc94f689f-96l44\" (UID: \"7e05d947-873c-4e13-a6d0-e1556d2655e1\") " pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:19.037070 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.037035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert\") pod \"odh-model-controller-6dc94f689f-96l44\" (UID: \"7e05d947-873c-4e13-a6d0-e1556d2655e1\") " pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:19.112205 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.112163 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:19.138458 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.138418 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpdfm\" (UniqueName: \"kubernetes.io/projected/7e05d947-873c-4e13-a6d0-e1556d2655e1-kube-api-access-fpdfm\") pod \"odh-model-controller-6dc94f689f-96l44\" (UID: \"7e05d947-873c-4e13-a6d0-e1556d2655e1\") " pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:19.138560 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.138482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert\") pod \"odh-model-controller-6dc94f689f-96l44\" (UID: \"7e05d947-873c-4e13-a6d0-e1556d2655e1\") " pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:19.138619 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:41:19.138604 2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 11:41:19.138675 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:41:19.138665 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert podName:7e05d947-873c-4e13-a6d0-e1556d2655e1 nodeName:}" failed. No retries permitted until 2026-06-11 11:41:19.638647146 +0000 UTC m=+520.342654835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert") pod "odh-model-controller-6dc94f689f-96l44" (UID: "7e05d947-873c-4e13-a6d0-e1556d2655e1") : secret "odh-model-controller-webhook-cert" not found Jun 11 11:41:19.149684 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.149649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpdfm\" (UniqueName: \"kubernetes.io/projected/7e05d947-873c-4e13-a6d0-e1556d2655e1-kube-api-access-fpdfm\") pod \"odh-model-controller-6dc94f689f-96l44\" (UID: \"7e05d947-873c-4e13-a6d0-e1556d2655e1\") " pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:19.213367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.213331 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:19.325085 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.324995 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:19.441140 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.441108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tls-certs\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:19.443713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.443679 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9255614-3d88-4dfc-a8ec-ef3ecf1be41a-tls-certs\") pod \"kube-auth-proxy-74bc6b598d-w2jf6\" (UID: \"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:19.580017 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.579930 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wszmz"] Jun 11 11:41:19.582788 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.582769 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:19.585922 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.585894 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 11:41:19.610136 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.610098 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wszmz"] Jun 11 11:41:19.643309 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.643274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cab49a19-438c-4013-9ad4-203fbba67393-tls-certs\") pod \"model-serving-api-5dd488fc48-wszmz\" (UID: \"cab49a19-438c-4013-9ad4-203fbba67393\") " pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:19.643309 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.643311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p7w9\" (UniqueName: \"kubernetes.io/projected/cab49a19-438c-4013-9ad4-203fbba67393-kube-api-access-9p7w9\") pod \"model-serving-api-5dd488fc48-wszmz\" (UID: \"cab49a19-438c-4013-9ad4-203fbba67393\") " pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:19.643535 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.643399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert\") pod \"odh-model-controller-6dc94f689f-96l44\" (UID: \"7e05d947-873c-4e13-a6d0-e1556d2655e1\") " pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:19.643535 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:41:19.643515 2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 11:41:19.643615 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:41:19.643565 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert podName:7e05d947-873c-4e13-a6d0-e1556d2655e1 nodeName:}" failed. No retries permitted until 2026-06-11 11:41:20.643551153 +0000 UTC m=+521.347558838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert") pod "odh-model-controller-6dc94f689f-96l44" (UID: "7e05d947-873c-4e13-a6d0-e1556d2655e1") : secret "odh-model-controller-webhook-cert" not found Jun 11 11:41:19.669083 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.669046 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:19.699732 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.699693 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" Jun 11 11:41:19.744454 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.744414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cab49a19-438c-4013-9ad4-203fbba67393-tls-certs\") pod \"model-serving-api-5dd488fc48-wszmz\" (UID: \"cab49a19-438c-4013-9ad4-203fbba67393\") " pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:19.744454 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.744456 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p7w9\" (UniqueName: \"kubernetes.io/projected/cab49a19-438c-4013-9ad4-203fbba67393-kube-api-access-9p7w9\") pod \"model-serving-api-5dd488fc48-wszmz\" (UID: \"cab49a19-438c-4013-9ad4-203fbba67393\") " pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:19.747145 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.747121 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cab49a19-438c-4013-9ad4-203fbba67393-tls-certs\") pod \"model-serving-api-5dd488fc48-wszmz\" (UID: \"cab49a19-438c-4013-9ad4-203fbba67393\") " pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:19.754383 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.754357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p7w9\" (UniqueName: \"kubernetes.io/projected/cab49a19-438c-4013-9ad4-203fbba67393-kube-api-access-9p7w9\") pod \"model-serving-api-5dd488fc48-wszmz\" (UID: \"cab49a19-438c-4013-9ad4-203fbba67393\") " pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:19.761127 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.761026 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:19.839309 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.839282 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6"] Jun 11 11:41:19.841157 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:19.841133 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9255614_3d88_4dfc_a8ec_ef3ecf1be41a.slice/crio-3f4bed134d4c0caaefc2d0e919eeea1ac02c04893f31a7a40ce99e9df05e5407 WatchSource:0}: Error finding container 3f4bed134d4c0caaefc2d0e919eeea1ac02c04893f31a7a40ce99e9df05e5407: Status 404 returned error can't find the container with id 3f4bed134d4c0caaefc2d0e919eeea1ac02c04893f31a7a40ce99e9df05e5407 Jun 11 11:41:19.849224 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.849201 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:19.894525 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:19.894490 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:20.033679 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:20.033645 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wszmz"] Jun 11 11:41:20.037390 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:20.037348 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab49a19_438c_4013_9ad4_203fbba67393.slice/crio-d162241fcbd1a9d82ea3fea0e901e8f6c01023e5efbe1f54ac2e515549829dc6 WatchSource:0}: Error finding container d162241fcbd1a9d82ea3fea0e901e8f6c01023e5efbe1f54ac2e515549829dc6: Status 404 returned error can't find the container with id d162241fcbd1a9d82ea3fea0e901e8f6c01023e5efbe1f54ac2e515549829dc6 Jun 11 11:41:20.651135 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:20.651094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert\") pod \"odh-model-controller-6dc94f689f-96l44\" (UID: \"7e05d947-873c-4e13-a6d0-e1556d2655e1\") " pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:20.656850 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:20.656813 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e05d947-873c-4e13-a6d0-e1556d2655e1-cert\") pod \"odh-model-controller-6dc94f689f-96l44\" (UID: \"7e05d947-873c-4e13-a6d0-e1556d2655e1\") " pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:20.719955 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:20.719831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-wszmz" event={"ID":"cab49a19-438c-4013-9ad4-203fbba67393","Type":"ContainerStarted","Data":"d162241fcbd1a9d82ea3fea0e901e8f6c01023e5efbe1f54ac2e515549829dc6"} Jun 11 11:41:20.722375 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:20.722339 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" event={"ID":"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a","Type":"ContainerStarted","Data":"3f4bed134d4c0caaefc2d0e919eeea1ac02c04893f31a7a40ce99e9df05e5407"} Jun 11 11:41:20.775721 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:20.775681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:20.973084 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:20.972786 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-96l44"] Jun 11 11:41:20.975450 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:20.975418 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e05d947_873c_4e13_a6d0_e1556d2655e1.slice/crio-37b1f2b2b4b496d69188062e5573d8f166eb12f33ad5b65cdcde583d5b495567 WatchSource:0}: Error finding container 37b1f2b2b4b496d69188062e5573d8f166eb12f33ad5b65cdcde583d5b495567: Status 404 returned error can't find the container with id 37b1f2b2b4b496d69188062e5573d8f166eb12f33ad5b65cdcde583d5b495567 Jun 11 11:41:21.731198 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:21.731156 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-96l44" event={"ID":"7e05d947-873c-4e13-a6d0-e1556d2655e1","Type":"ContainerStarted","Data":"37b1f2b2b4b496d69188062e5573d8f166eb12f33ad5b65cdcde583d5b495567"} Jun 11 11:41:22.155375 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.155337 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh"] Jun 11 11:41:22.161030 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.160974 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.164588 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.164007 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5b642\"" Jun 11 11:41:22.164588 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.164326 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 11:41:22.165186 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.165164 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 11:41:22.170790 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.170745 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh"] Jun 11 11:41:22.271405 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.271348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.271593 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.271518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwxx\" (UniqueName: \"kubernetes.io/projected/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-kube-api-access-qxwxx\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.271593 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.271564 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.372713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.372673 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwxx\" (UniqueName: \"kubernetes.io/projected/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-kube-api-access-qxwxx\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.372918 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.372730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.372918 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.372790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.373314 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.373286 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.373436 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.373358 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.381556 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.381530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwxx\" (UniqueName: \"kubernetes.io/projected/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-kube-api-access-qxwxx\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:22.478646 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:22.478572 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:24.814201 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:24.814057 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh"] Jun 11 11:41:24.816774 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:24.816744 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aeb3b61_4e7d_4655_bbf7_b83293e9d4ef.slice/crio-8065425d142421a1c32a2df3d1cb5b481ae34c29614330caf4a77a68b17edd1f WatchSource:0}: Error finding container 8065425d142421a1c32a2df3d1cb5b481ae34c29614330caf4a77a68b17edd1f: Status 404 returned error can't find the container with id 8065425d142421a1c32a2df3d1cb5b481ae34c29614330caf4a77a68b17edd1f Jun 11 11:41:25.755387 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.755343 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-wszmz" event={"ID":"cab49a19-438c-4013-9ad4-203fbba67393","Type":"ContainerStarted","Data":"28458fafb6c56e72f105cd49559540ff58bf25e188e4827c0679622c274b3715"} Jun 11 11:41:25.756973 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.756945 2560 generic.go:356] "Generic (PLEG): container finished" podID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerID="e02042a0529d54d7a44eaeb3091bc9c8832819a58eeed3589912f7c6c8b46137" exitCode=0 Jun 11 11:41:25.761936 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.761903 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:25.762057 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.761962 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:25.762057 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.762004 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" event={"ID":"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef","Type":"ContainerDied","Data":"e02042a0529d54d7a44eaeb3091bc9c8832819a58eeed3589912f7c6c8b46137"} Jun 11 11:41:25.762057 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.762032 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" event={"ID":"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef","Type":"ContainerStarted","Data":"8065425d142421a1c32a2df3d1cb5b481ae34c29614330caf4a77a68b17edd1f"} Jun 11 11:41:25.762057 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.762053 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" event={"ID":"c9255614-3d88-4dfc-a8ec-ef3ecf1be41a","Type":"ContainerStarted","Data":"e47633a5c8713aaac808cf9af08080152b552c625e673796c1f0e92254f96f94"} Jun 11 11:41:25.762209 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.762077 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-96l44" event={"ID":"7e05d947-873c-4e13-a6d0-e1556d2655e1","Type":"ContainerStarted","Data":"9ab2e5b465aab75f8ecd66869a2eb04803384f7fae2f68128e9a23b57e17da13"} Jun 11 11:41:25.797073 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.797007 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-wszmz" podStartSLOduration=2.169154153 podStartE2EDuration="6.796986022s" totalImagesPullingTime="4.627831869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:25.794786592 +0000 UTC m=+526.498794299" watchObservedRunningTime="2026-06-11 11:41:25.796986022 +0000 UTC m=+526.500993731" Jun 11 11:41:25.842208 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.842156 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-w2jf6" podStartSLOduration=3.021953074 podStartE2EDuration="7.842139517s" totalImagesPullingTime="4.820186443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:25.840745608 +0000 UTC m=+526.544753317" watchObservedRunningTime="2026-06-11 11:41:25.842139517 +0000 UTC m=+526.546147225" Jun 11 11:41:25.871037 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:25.870971 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-96l44" podStartSLOduration=4.134041169 podStartE2EDuration="7.870949176s" totalImagesPullingTime="3.736908007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:25.8695399 +0000 UTC m=+526.573547622" watchObservedRunningTime="2026-06-11 11:41:25.870949176 +0000 UTC m=+526.574956884" Jun 11 11:41:27.773116 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:27.773080 2560 generic.go:356] "Generic (PLEG): container finished" podID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerID="41936a07f25fff255f060c281d376d65c611b0d7f1071a4d9e54d0a94d212624" exitCode=0 Jun 11 11:41:27.773492 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:27.773163 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" event={"ID":"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef","Type":"ContainerDied","Data":"41936a07f25fff255f060c281d376d65c611b0d7f1071a4d9e54d0a94d212624"} Jun 11 11:41:28.237910 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.237459 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:28.302283 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.302249 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-v5dl2"] Jun 11 11:41:28.306024 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.305946 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:28.308601 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.308404 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 11:41:28.308601 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.308534 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qbqgz\"" Jun 11 11:41:28.321244 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.321153 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-v5dl2"] Jun 11 11:41:28.323555 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.323529 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf"] Jun 11 11:41:28.327188 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.327158 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:28.330460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.330430 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hfw29\"" Jun 11 11:41:28.330584 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.330485 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 11:41:28.338425 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.338391 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf"] Jun 11 11:41:28.341230 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.341106 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:28.434472 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.434426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfjk4\" (UniqueName: \"kubernetes.io/projected/170bf76b-301b-4d44-a027-82191a9704cf-kube-api-access-mfjk4\") pod \"kserve-controller-manager-69fc866d76-v5dl2\" (UID: \"170bf76b-301b-4d44-a027-82191a9704cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:28.434656 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.434540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe0682c-b600-4f83-8fe7-c949ecad03c8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hlkcf\" (UID: \"dbe0682c-b600-4f83-8fe7-c949ecad03c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:28.434656 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.434572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/170bf76b-301b-4d44-a027-82191a9704cf-cert\") pod \"kserve-controller-manager-69fc866d76-v5dl2\" (UID: \"170bf76b-301b-4d44-a027-82191a9704cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:28.434656 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.434616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts9q6\" (UniqueName: \"kubernetes.io/projected/dbe0682c-b600-4f83-8fe7-c949ecad03c8-kube-api-access-ts9q6\") pod \"llmisvc-controller-manager-864bfd7bc9-hlkcf\" (UID: \"dbe0682c-b600-4f83-8fe7-c949ecad03c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:28.483665 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.483633 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:28.535821 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.535784 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts9q6\" (UniqueName: \"kubernetes.io/projected/dbe0682c-b600-4f83-8fe7-c949ecad03c8-kube-api-access-ts9q6\") pod \"llmisvc-controller-manager-864bfd7bc9-hlkcf\" (UID: \"dbe0682c-b600-4f83-8fe7-c949ecad03c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:28.536038 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.535833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfjk4\" (UniqueName: \"kubernetes.io/projected/170bf76b-301b-4d44-a027-82191a9704cf-kube-api-access-mfjk4\") pod \"kserve-controller-manager-69fc866d76-v5dl2\" (UID: \"170bf76b-301b-4d44-a027-82191a9704cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:28.536038 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.535941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe0682c-b600-4f83-8fe7-c949ecad03c8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hlkcf\" (UID: \"dbe0682c-b600-4f83-8fe7-c949ecad03c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:28.536038 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.535973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/170bf76b-301b-4d44-a027-82191a9704cf-cert\") pod \"kserve-controller-manager-69fc866d76-v5dl2\" (UID: \"170bf76b-301b-4d44-a027-82191a9704cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:28.538651 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.538625 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe0682c-b600-4f83-8fe7-c949ecad03c8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hlkcf\" (UID: \"dbe0682c-b600-4f83-8fe7-c949ecad03c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:28.538791 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.538661 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/170bf76b-301b-4d44-a027-82191a9704cf-cert\") pod \"kserve-controller-manager-69fc866d76-v5dl2\" (UID: \"170bf76b-301b-4d44-a027-82191a9704cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:28.548039 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.548009 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts9q6\" (UniqueName: \"kubernetes.io/projected/dbe0682c-b600-4f83-8fe7-c949ecad03c8-kube-api-access-ts9q6\") pod \"llmisvc-controller-manager-864bfd7bc9-hlkcf\" (UID: \"dbe0682c-b600-4f83-8fe7-c949ecad03c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:28.548172 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.548097 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfjk4\" (UniqueName: \"kubernetes.io/projected/170bf76b-301b-4d44-a027-82191a9704cf-kube-api-access-mfjk4\") pod \"kserve-controller-manager-69fc866d76-v5dl2\" (UID: \"170bf76b-301b-4d44-a027-82191a9704cf\") " pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:28.577315 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.577214 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:28.620595 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.620562 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:28.653001 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.652965 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:28.783289 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.782576 2560 generic.go:356] "Generic (PLEG): container finished" podID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerID="4d47a927b7acb8a0cc4cc25579074001d1c4364759d64c6e1a5653f54b21657a" exitCode=0 Jun 11 11:41:28.783289 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.782748 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" event={"ID":"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef","Type":"ContainerDied","Data":"4d47a927b7acb8a0cc4cc25579074001d1c4364759d64c6e1a5653f54b21657a"} Jun 11 11:41:28.814105 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.814077 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-v5dl2"] Jun 11 11:41:28.816591 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:28.816561 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170bf76b_301b_4d44_a027_82191a9704cf.slice/crio-36e742d048200b9418daa2dd8ee02dd6d28fe45d7c92c6d3c304dd779d2728cc WatchSource:0}: Error finding container 36e742d048200b9418daa2dd8ee02dd6d28fe45d7c92c6d3c304dd779d2728cc: Status 404 returned error can't find the container with id 36e742d048200b9418daa2dd8ee02dd6d28fe45d7c92c6d3c304dd779d2728cc Jun 11 11:41:28.836754 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:28.836714 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf"] Jun 11 11:41:28.837043 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:28.837010 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddbe0682c_b600_4f83_8fe7_c949ecad03c8.slice/crio-6b9916a00d755f338672c0ae232ea26163e8b478c43c7dafa025b2a3b755c359 WatchSource:0}: Error finding container 6b9916a00d755f338672c0ae232ea26163e8b478c43c7dafa025b2a3b755c359: Status 404 returned error can't find the container with id 6b9916a00d755f338672c0ae232ea26163e8b478c43c7dafa025b2a3b755c359 Jun 11 11:41:29.563760 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:29.563726 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:29.660734 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:29.660667 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:29.766102 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:29.766059 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:29.791752 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:29.791679 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" event={"ID":"dbe0682c-b600-4f83-8fe7-c949ecad03c8","Type":"ContainerStarted","Data":"6b9916a00d755f338672c0ae232ea26163e8b478c43c7dafa025b2a3b755c359"} Jun 11 11:41:29.793585 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:29.793500 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" event={"ID":"170bf76b-301b-4d44-a027-82191a9704cf","Type":"ContainerStarted","Data":"36e742d048200b9418daa2dd8ee02dd6d28fe45d7c92c6d3c304dd779d2728cc"} Jun 11 11:41:30.087513 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.087476 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:30.150290 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.150258 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxwxx\" (UniqueName: \"kubernetes.io/projected/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-kube-api-access-qxwxx\") pod \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " Jun 11 11:41:30.150468 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.150364 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-util\") pod \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " Jun 11 11:41:30.150544 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.150484 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-bundle\") pod \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\" (UID: \"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef\") " Jun 11 11:41:30.151616 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.151566 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-bundle" (OuterVolumeSpecName: "bundle") pod "2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" (UID: "2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:41:30.154714 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.154679 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-kube-api-access-qxwxx" (OuterVolumeSpecName: "kube-api-access-qxwxx") pod "2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" (UID: "2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef"). InnerVolumeSpecName "kube-api-access-qxwxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:41:30.157851 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.157784 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-util" (OuterVolumeSpecName: "util") pod "2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" (UID: "2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:41:30.251404 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.251363 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:41:30.251404 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.251402 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:41:30.251404 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.251413 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxwxx\" (UniqueName: \"kubernetes.io/projected/2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef-kube-api-access-qxwxx\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:41:30.801031 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.800999 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" Jun 11 11:41:30.801473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.801034 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qqlxh" event={"ID":"2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef","Type":"ContainerDied","Data":"8065425d142421a1c32a2df3d1cb5b481ae34c29614330caf4a77a68b17edd1f"} Jun 11 11:41:30.801473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:30.801095 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8065425d142421a1c32a2df3d1cb5b481ae34c29614330caf4a77a68b17edd1f" Jun 11 11:41:31.809236 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:31.809190 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" event={"ID":"170bf76b-301b-4d44-a027-82191a9704cf","Type":"ContainerStarted","Data":"83e6850a2ac04e3d54ac00d7285e380c87a60ca280d59d0537c218b25cae9702"} Jun 11 11:41:31.809669 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:31.809331 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:41:31.843611 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:31.843557 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" podStartSLOduration=1.452085278 podStartE2EDuration="3.843540575s" totalImagesPullingTime="2.391455297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:31.841514555 +0000 UTC m=+532.545522264" watchObservedRunningTime="2026-06-11 11:41:31.843540575 +0000 UTC m=+532.547548283" Jun 11 11:41:32.817326 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:32.817289 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" event={"ID":"dbe0682c-b600-4f83-8fe7-c949ecad03c8","Type":"ContainerStarted","Data":"5f8bf6711d86c652bc7ecb5bc870d8877c630a20bf2dd011f07f0bc038621297"} Jun 11 11:41:32.817730 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:32.817523 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:41:32.834838 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:32.834793 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" podStartSLOduration=1.486059645 podStartE2EDuration="4.834780488s" totalImagesPullingTime="3.348720843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:32.833795188 +0000 UTC m=+533.537802910" watchObservedRunningTime="2026-06-11 11:41:32.834780488 +0000 UTC m=+533.538788196" Jun 11 11:41:35.572096 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:35.572056 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:35.701033 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:35.700992 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:36.877989 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.877953 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:36.907545 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.907509 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr"] Jun 11 11:41:36.907929 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.907912 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerName="extract" Jun 11 11:41:36.907972 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.907931 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerName="extract" Jun 11 11:41:36.907972 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.907952 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerName="pull" Jun 11 11:41:36.907972 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.907958 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerName="pull" Jun 11 11:41:36.907972 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.907966 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerName="util" Jun 11 11:41:36.907972 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.907971 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerName="util" Jun 11 11:41:36.908116 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.908038 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aeb3b61-4e7d-4655-bbf7-b83293e9d4ef" containerName="extract" Jun 11 11:41:36.915000 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.914976 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:36.920224 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.920200 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 11:41:36.924535 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.924514 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 11:41:36.926394 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.926379 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5b642\"" Jun 11 11:41:36.949499 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:36.949467 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr"] Jun 11 11:41:37.016658 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.016618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.016799 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.016689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.016799 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.016719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj9b4\" (UniqueName: \"kubernetes.io/projected/e5fa512f-137d-4267-9d42-b3554dd15eae-kube-api-access-vj9b4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.038426 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.038366 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:37.117231 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.117189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.117385 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.117289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.117385 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.117322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj9b4\" (UniqueName: \"kubernetes.io/projected/e5fa512f-137d-4267-9d42-b3554dd15eae-kube-api-access-vj9b4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.117587 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.117566 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.117668 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.117650 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.129145 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.129084 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj9b4\" (UniqueName: \"kubernetes.io/projected/e5fa512f-137d-4267-9d42-b3554dd15eae-kube-api-access-vj9b4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.225149 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.225102 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:37.376341 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.376312 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr"] Jun 11 11:41:37.378227 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:37.378202 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fa512f_137d_4267_9d42_b3554dd15eae.slice/crio-a3eec8d79cd0755b8cf7b99f87554a08a6007986d917846eb33b31a59622f53d WatchSource:0}: Error finding container a3eec8d79cd0755b8cf7b99f87554a08a6007986d917846eb33b31a59622f53d: Status 404 returned error can't find the container with id a3eec8d79cd0755b8cf7b99f87554a08a6007986d917846eb33b31a59622f53d Jun 11 11:41:37.538037 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.538006 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:37.775120 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.775092 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-96l44" Jun 11 11:41:37.777113 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.777091 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-wszmz" Jun 11 11:41:37.845725 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.845687 2560 generic.go:356] "Generic (PLEG): container finished" podID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerID="8a75e0bb32ae572098e2a9a7a74a0ddf76744d1f9e5e71cfc724450b372e7995" exitCode=0 Jun 11 11:41:37.845933 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.845777 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" event={"ID":"e5fa512f-137d-4267-9d42-b3554dd15eae","Type":"ContainerDied","Data":"8a75e0bb32ae572098e2a9a7a74a0ddf76744d1f9e5e71cfc724450b372e7995"} Jun 11 11:41:37.845933 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.845840 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" event={"ID":"e5fa512f-137d-4267-9d42-b3554dd15eae","Type":"ContainerStarted","Data":"a3eec8d79cd0755b8cf7b99f87554a08a6007986d917846eb33b31a59622f53d"} Jun 11 11:41:37.911107 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:37.911054 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:38.115627 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.115503 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:38.430201 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.430162 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bdln5"] Jun 11 11:41:38.432769 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.432742 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:38.437705 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.437683 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 11:41:38.438921 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.438897 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 11:41:38.447802 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.447783 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-zwqdv\"" Jun 11 11:41:38.488190 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.488156 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bdln5"] Jun 11 11:41:38.528694 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.528658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/300fb9fe-d511-4913-9552-dc2b97ffa638-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bdln5\" (UID: \"300fb9fe-d511-4913-9552-dc2b97ffa638\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:38.528841 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.528702 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df5w5\" (UniqueName: \"kubernetes.io/projected/300fb9fe-d511-4913-9552-dc2b97ffa638-kube-api-access-df5w5\") pod \"servicemesh-operator3-57f65f65fb-bdln5\" (UID: \"300fb9fe-d511-4913-9552-dc2b97ffa638\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:38.629202 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.629173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df5w5\" (UniqueName: \"kubernetes.io/projected/300fb9fe-d511-4913-9552-dc2b97ffa638-kube-api-access-df5w5\") pod \"servicemesh-operator3-57f65f65fb-bdln5\" (UID: \"300fb9fe-d511-4913-9552-dc2b97ffa638\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:38.629320 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.629306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/300fb9fe-d511-4913-9552-dc2b97ffa638-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bdln5\" (UID: \"300fb9fe-d511-4913-9552-dc2b97ffa638\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:38.631734 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.631702 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/300fb9fe-d511-4913-9552-dc2b97ffa638-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bdln5\" (UID: \"300fb9fe-d511-4913-9552-dc2b97ffa638\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:38.641561 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.641532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df5w5\" (UniqueName: \"kubernetes.io/projected/300fb9fe-d511-4913-9552-dc2b97ffa638-kube-api-access-df5w5\") pod \"servicemesh-operator3-57f65f65fb-bdln5\" (UID: \"300fb9fe-d511-4913-9552-dc2b97ffa638\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:38.742540 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.742514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:38.854441 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.854398 2560 generic.go:356] "Generic (PLEG): container finished" podID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerID="ee552383668491d4872e2d8894b055bd708472ad6242b970a62b091a8dbc4bda" exitCode=0 Jun 11 11:41:38.854596 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.854532 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" event={"ID":"e5fa512f-137d-4267-9d42-b3554dd15eae","Type":"ContainerDied","Data":"ee552383668491d4872e2d8894b055bd708472ad6242b970a62b091a8dbc4bda"} Jun 11 11:41:38.885753 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:38.885727 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bdln5"] Jun 11 11:41:38.887899 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:38.887851 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300fb9fe_d511_4913_9552_dc2b97ffa638.slice/crio-ecd3e550b1b778f3fdb2847fb29aa92f624c95bd571fd270bb4c44cc35ae8f6c WatchSource:0}: Error finding container ecd3e550b1b778f3fdb2847fb29aa92f624c95bd571fd270bb4c44cc35ae8f6c: Status 404 returned error can't find the container with id ecd3e550b1b778f3fdb2847fb29aa92f624c95bd571fd270bb4c44cc35ae8f6c Jun 11 11:41:39.865091 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:39.864609 2560 generic.go:356] "Generic (PLEG): container finished" podID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerID="c97aec2654e3d625d7026bc3fbcd8713a5701e3dde3a316805f18674a0c2248c" exitCode=0 Jun 11 11:41:39.865091 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:39.864702 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" event={"ID":"e5fa512f-137d-4267-9d42-b3554dd15eae","Type":"ContainerDied","Data":"c97aec2654e3d625d7026bc3fbcd8713a5701e3dde3a316805f18674a0c2248c"} Jun 11 11:41:39.867514 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:39.867477 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" event={"ID":"300fb9fe-d511-4913-9552-dc2b97ffa638","Type":"ContainerStarted","Data":"ecd3e550b1b778f3fdb2847fb29aa92f624c95bd571fd270bb4c44cc35ae8f6c"} Jun 11 11:41:41.448841 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.448815 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:41.554982 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.554956 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-bundle\") pod \"e5fa512f-137d-4267-9d42-b3554dd15eae\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " Jun 11 11:41:41.555097 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.555007 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-util\") pod \"e5fa512f-137d-4267-9d42-b3554dd15eae\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " Jun 11 11:41:41.555097 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.555033 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj9b4\" (UniqueName: \"kubernetes.io/projected/e5fa512f-137d-4267-9d42-b3554dd15eae-kube-api-access-vj9b4\") pod \"e5fa512f-137d-4267-9d42-b3554dd15eae\" (UID: \"e5fa512f-137d-4267-9d42-b3554dd15eae\") " Jun 11 11:41:41.556125 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.556097 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-bundle" (OuterVolumeSpecName: "bundle") pod "e5fa512f-137d-4267-9d42-b3554dd15eae" (UID: "e5fa512f-137d-4267-9d42-b3554dd15eae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:41:41.557319 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.557289 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5fa512f-137d-4267-9d42-b3554dd15eae-kube-api-access-vj9b4" (OuterVolumeSpecName: "kube-api-access-vj9b4") pod "e5fa512f-137d-4267-9d42-b3554dd15eae" (UID: "e5fa512f-137d-4267-9d42-b3554dd15eae"). InnerVolumeSpecName "kube-api-access-vj9b4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:41:41.560544 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.560506 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-util" (OuterVolumeSpecName: "util") pod "e5fa512f-137d-4267-9d42-b3554dd15eae" (UID: "e5fa512f-137d-4267-9d42-b3554dd15eae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:41:41.656244 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.656201 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:41:41.656244 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.656243 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5fa512f-137d-4267-9d42-b3554dd15eae-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:41:41.656504 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.656271 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj9b4\" (UniqueName: \"kubernetes.io/projected/e5fa512f-137d-4267-9d42-b3554dd15eae-kube-api-access-vj9b4\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:41:41.881266 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.881225 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" event={"ID":"e5fa512f-137d-4267-9d42-b3554dd15eae","Type":"ContainerDied","Data":"a3eec8d79cd0755b8cf7b99f87554a08a6007986d917846eb33b31a59622f53d"} Jun 11 11:41:41.881266 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.881258 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajscnr" Jun 11 11:41:41.881478 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.881284 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3eec8d79cd0755b8cf7b99f87554a08a6007986d917846eb33b31a59622f53d" Jun 11 11:41:41.883596 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.883565 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" event={"ID":"300fb9fe-d511-4913-9552-dc2b97ffa638","Type":"ContainerStarted","Data":"5af2f18747fb73bbc6b7942e9d9552d4a9c0b5aca572ea381fbefe421a05b4db"} Jun 11 11:41:41.883744 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.883679 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:41.904433 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:41.904377 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" podStartSLOduration=1.303062684 podStartE2EDuration="3.904359577s" totalImagesPullingTime="2.601296893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:41.903106168 +0000 UTC m=+542.607113875" watchObservedRunningTime="2026-06-11 11:41:41.904359577 +0000 UTC m=+542.608367286" Jun 11 11:41:48.430764 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:48.430724 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:48.531316 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:48.531276 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:49.058929 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.058896 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-87d68b7dc-5c9sg"] Jun 11 11:41:49.059285 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.059271 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerName="util" Jun 11 11:41:49.059327 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.059286 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerName="util" Jun 11 11:41:49.059327 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.059296 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerName="pull" Jun 11 11:41:49.059327 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.059301 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerName="pull" Jun 11 11:41:49.059327 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.059318 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerName="extract" Jun 11 11:41:49.059327 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.059323 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerName="extract" Jun 11 11:41:49.059476 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.059383 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5fa512f-137d-4267-9d42-b3554dd15eae" containerName="extract" Jun 11 11:41:49.062564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.062539 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" Jun 11 11:41:49.065283 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.065262 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9tsgj\"" Jun 11 11:41:49.065613 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.065594 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 11:41:49.074950 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.074926 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-87d68b7dc-5c9sg"] Jun 11 11:41:49.100045 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.100009 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:41:49.220987 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.220951 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e0a146bc-aff9-4915-bfdc-54ea4996a0ad-redirect-config\") pod \"dashboard-redirect-87d68b7dc-5c9sg\" (UID: \"e0a146bc-aff9-4915-bfdc-54ea4996a0ad\") " pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" Jun 11 11:41:49.221182 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.221079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgrn8\" (UniqueName: \"kubernetes.io/projected/e0a146bc-aff9-4915-bfdc-54ea4996a0ad-kube-api-access-dgrn8\") pod \"dashboard-redirect-87d68b7dc-5c9sg\" (UID: \"e0a146bc-aff9-4915-bfdc-54ea4996a0ad\") " pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" Jun 11 11:41:49.322367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.322274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgrn8\" (UniqueName: \"kubernetes.io/projected/e0a146bc-aff9-4915-bfdc-54ea4996a0ad-kube-api-access-dgrn8\") pod \"dashboard-redirect-87d68b7dc-5c9sg\" (UID: \"e0a146bc-aff9-4915-bfdc-54ea4996a0ad\") " pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" Jun 11 11:41:49.322367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.322348 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e0a146bc-aff9-4915-bfdc-54ea4996a0ad-redirect-config\") pod \"dashboard-redirect-87d68b7dc-5c9sg\" (UID: \"e0a146bc-aff9-4915-bfdc-54ea4996a0ad\") " pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" Jun 11 11:41:49.323151 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.323132 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e0a146bc-aff9-4915-bfdc-54ea4996a0ad-redirect-config\") pod \"dashboard-redirect-87d68b7dc-5c9sg\" (UID: \"e0a146bc-aff9-4915-bfdc-54ea4996a0ad\") " pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" Jun 11 11:41:49.330537 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.330515 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgrn8\" (UniqueName: \"kubernetes.io/projected/e0a146bc-aff9-4915-bfdc-54ea4996a0ad-kube-api-access-dgrn8\") pod \"dashboard-redirect-87d68b7dc-5c9sg\" (UID: \"e0a146bc-aff9-4915-bfdc-54ea4996a0ad\") " pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" Jun 11 11:41:49.373444 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.373411 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" Jun 11 11:41:49.510963 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.510935 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-87d68b7dc-5c9sg"] Jun 11 11:41:49.513648 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:41:49.513622 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a146bc_aff9_4915_bfdc_54ea4996a0ad.slice/crio-7017b91d5a2973db519e0dce66af4b4aa7525a018fc8ae3284c6cffd977a9b91 WatchSource:0}: Error finding container 7017b91d5a2973db519e0dce66af4b4aa7525a018fc8ae3284c6cffd977a9b91: Status 404 returned error can't find the container with id 7017b91d5a2973db519e0dce66af4b4aa7525a018fc8ae3284c6cffd977a9b91 Jun 11 11:41:49.928806 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:49.928773 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" event={"ID":"e0a146bc-aff9-4915-bfdc-54ea4996a0ad","Type":"ContainerStarted","Data":"7017b91d5a2973db519e0dce66af4b4aa7525a018fc8ae3284c6cffd977a9b91"} Jun 11 11:41:52.892706 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:52.892671 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bdln5" Jun 11 11:41:54.963186 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:54.963147 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" event={"ID":"e0a146bc-aff9-4915-bfdc-54ea4996a0ad","Type":"ContainerStarted","Data":"aaab0e68ed55db977c5b23a83f21964ecc4370aff4602730e51db89360959e1d"} Jun 11 11:41:54.983595 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:41:54.983541 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-87d68b7dc-5c9sg" podStartSLOduration=1.138243657 podStartE2EDuration="5.983526211s" totalImagesPullingTime="4.845282554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:54.981900056 +0000 UTC m=+555.685907754" watchObservedRunningTime="2026-06-11 11:41:54.983526211 +0000 UTC m=+555.687533918" Jun 11 11:42:02.822791 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:02.822752 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-v5dl2" Jun 11 11:42:03.825555 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:03.825519 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hlkcf" Jun 11 11:42:08.556460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.556413 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:08.557460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.557432 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9"] Jun 11 11:42:08.562468 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.562442 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.565059 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.565037 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 11:42:08.565168 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.565038 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 11:42:08.565416 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.565398 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 11:42:08.565500 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.565484 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h4bgj\"" Jun 11 11:42:08.566059 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.566046 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 11:42:08.572278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.572254 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9"] Jun 11 11:42:08.580736 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.580711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a353873-9d62-4f15-91c2-e94a8330d969-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.580856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.580756 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.580856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.580780 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn5nt\" (UniqueName: \"kubernetes.io/projected/9a353873-9d62-4f15-91c2-e94a8330d969-kube-api-access-bn5nt\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.580856 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.580832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a353873-9d62-4f15-91c2-e94a8330d969-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.581060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.580929 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a353873-9d62-4f15-91c2-e94a8330d969-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.581060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.580970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.581060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.580998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.615178 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.615133 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:08.682351 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.682317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a353873-9d62-4f15-91c2-e94a8330d969-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.682351 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.682353 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a353873-9d62-4f15-91c2-e94a8330d969-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.682611 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.682379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.682611 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.682403 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.682611 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.682430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a353873-9d62-4f15-91c2-e94a8330d969-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.682611 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.682464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.682611 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.682593 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn5nt\" (UniqueName: \"kubernetes.io/projected/9a353873-9d62-4f15-91c2-e94a8330d969-kube-api-access-bn5nt\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.683197 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.683138 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a353873-9d62-4f15-91c2-e94a8330d969-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.684997 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.684973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a353873-9d62-4f15-91c2-e94a8330d969-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.685106 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.685047 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.685304 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.685282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.685362 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.685325 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a353873-9d62-4f15-91c2-e94a8330d969-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.691035 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.691007 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn5nt\" (UniqueName: \"kubernetes.io/projected/9a353873-9d62-4f15-91c2-e94a8330d969-kube-api-access-bn5nt\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.691118 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.691077 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a353873-9d62-4f15-91c2-e94a8330d969-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-s5rh9\" (UID: \"9a353873-9d62-4f15-91c2-e94a8330d969\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:08.873329 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:08.873227 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:09.019497 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:09.019467 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9"] Jun 11 11:42:09.021283 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:42:09.021243 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a353873_9d62_4f15_91c2_e94a8330d969.slice/crio-cf1714aee579474981b2dc3d785d085a481c968cf7dd8bef94ee8c3cec0e5ff3 WatchSource:0}: Error finding container cf1714aee579474981b2dc3d785d085a481c968cf7dd8bef94ee8c3cec0e5ff3: Status 404 returned error can't find the container with id cf1714aee579474981b2dc3d785d085a481c968cf7dd8bef94ee8c3cec0e5ff3 Jun 11 11:42:09.043232 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:09.043194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" event={"ID":"9a353873-9d62-4f15-91c2-e94a8330d969","Type":"ContainerStarted","Data":"cf1714aee579474981b2dc3d785d085a481c968cf7dd8bef94ee8c3cec0e5ff3"} Jun 11 11:42:09.087223 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:09.087190 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:11.867081 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:11.867041 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 11:42:11.867353 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:11.867112 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 11:42:12.062029 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.061984 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" event={"ID":"9a353873-9d62-4f15-91c2-e94a8330d969","Type":"ContainerStarted","Data":"d0e4bd71d7268be9caf1c261dd16620fa02312ec310fbeb65111645ba4a918d3"} Jun 11 11:42:12.062230 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.062200 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:12.063713 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.063686 2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-s5rh9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 11:42:12.064008 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.063741 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" podUID="9a353873-9d62-4f15-91c2-e94a8330d969" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 11:42:12.085370 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.085305 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" podStartSLOduration=1.24193852 podStartE2EDuration="4.085290278s" totalImagesPullingTime="2.843351758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:42:12.083124497 +0000 UTC m=+572.787132209" watchObservedRunningTime="2026-06-11 11:42:12.085290278 +0000 UTC m=+572.789297986" Jun 11 11:42:12.502925 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.502854 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:12.603579 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.603543 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:12.795260 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.795173 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:12.926125 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:12.926088 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:13.027246 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:13.027188 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:13.070639 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:13.070523 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-s5rh9" Jun 11 11:42:13.251476 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:13.251418 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:19.914358 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:19.914320 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:20.005030 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:20.004991 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:20.103786 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:20.103750 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:30.550783 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:30.550728 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:35.825284 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.825238 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v"] Jun 11 11:42:35.843632 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.843602 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v"] Jun 11 11:42:35.843816 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.843704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:35.846608 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.846581 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 11:42:35.846737 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.846640 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7r27k\"" Jun 11 11:42:35.846737 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.846675 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 11:42:35.925642 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.925604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:35.925844 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.925725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksbk5\" (UniqueName: \"kubernetes.io/projected/bba0c180-92eb-484e-9433-6909e4dcd8da-kube-api-access-ksbk5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:35.925844 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:35.925811 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:36.026722 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.026686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:36.026722 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.026728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:36.026959 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.026774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksbk5\" (UniqueName: \"kubernetes.io/projected/bba0c180-92eb-484e-9433-6909e4dcd8da-kube-api-access-ksbk5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:36.027142 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.027123 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:36.027181 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.027138 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:36.034964 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.034937 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksbk5\" (UniqueName: \"kubernetes.io/projected/bba0c180-92eb-484e-9433-6909e4dcd8da-kube-api-access-ksbk5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:36.155719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.155689 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:36.295212 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.295186 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v"] Jun 11 11:42:36.297354 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:42:36.297326 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba0c180_92eb_484e_9433_6909e4dcd8da.slice/crio-c5565f8405cc88515023b9b7d5f8a3f13c29d69bd7287e32dfa27145bf4eea7d WatchSource:0}: Error finding container c5565f8405cc88515023b9b7d5f8a3f13c29d69bd7287e32dfa27145bf4eea7d: Status 404 returned error can't find the container with id c5565f8405cc88515023b9b7d5f8a3f13c29d69bd7287e32dfa27145bf4eea7d Jun 11 11:42:36.416656 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.416593 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf"] Jun 11 11:42:36.420069 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.420048 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.428717 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.428685 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf"] Jun 11 11:42:36.531342 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.531308 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.531527 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.531418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7x8m\" (UniqueName: \"kubernetes.io/projected/61dd8884-4159-47f0-a38c-2c7856194d13-kube-api-access-q7x8m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.531527 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.531451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.632788 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.632747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7x8m\" (UniqueName: \"kubernetes.io/projected/61dd8884-4159-47f0-a38c-2c7856194d13-kube-api-access-q7x8m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.632788 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.632793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.633021 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.632840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.633300 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.633277 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.633340 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.633285 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.640768 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.640740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7x8m\" (UniqueName: \"kubernetes.io/projected/61dd8884-4159-47f0-a38c-2c7856194d13-kube-api-access-q7x8m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.776906 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.776805 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:36.814554 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.814520 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t"] Jun 11 11:42:36.818508 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.818482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:36.832040 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.831985 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t"] Jun 11 11:42:36.918565 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.918536 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf"] Jun 11 11:42:36.919937 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:42:36.919914 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61dd8884_4159_47f0_a38c_2c7856194d13.slice/crio-2422cdf1a9f114124a9986b78e7bd3109214ac0a9eddea0a0e18c271cb319683 WatchSource:0}: Error finding container 2422cdf1a9f114124a9986b78e7bd3109214ac0a9eddea0a0e18c271cb319683: Status 404 returned error can't find the container with id 2422cdf1a9f114124a9986b78e7bd3109214ac0a9eddea0a0e18c271cb319683 Jun 11 11:42:36.935278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.935221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:36.935278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.935247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:36.935412 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:36.935319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm744\" (UniqueName: \"kubernetes.io/projected/aec41a50-3542-4da1-8967-b42e2b846d0c-kube-api-access-nm744\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:37.035947 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.035918 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm744\" (UniqueName: \"kubernetes.io/projected/aec41a50-3542-4da1-8967-b42e2b846d0c-kube-api-access-nm744\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:37.036105 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.036034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:37.036105 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.036065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:37.036384 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.036362 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:37.036460 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.036397 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:37.044668 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.044644 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm744\" (UniqueName: \"kubernetes.io/projected/aec41a50-3542-4da1-8967-b42e2b846d0c-kube-api-access-nm744\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:37.130092 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.130060 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:37.204953 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.204914 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerID="5d0fa13143d3cf604d5ca09d2fdfe8cebe0085c99bb0f65146b91f99a80f6d9f" exitCode=0 Jun 11 11:42:37.205166 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.204994 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" event={"ID":"bba0c180-92eb-484e-9433-6909e4dcd8da","Type":"ContainerDied","Data":"5d0fa13143d3cf604d5ca09d2fdfe8cebe0085c99bb0f65146b91f99a80f6d9f"} Jun 11 11:42:37.205166 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.205045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" event={"ID":"bba0c180-92eb-484e-9433-6909e4dcd8da","Type":"ContainerStarted","Data":"c5565f8405cc88515023b9b7d5f8a3f13c29d69bd7287e32dfa27145bf4eea7d"} Jun 11 11:42:37.207030 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.207005 2560 generic.go:356] "Generic (PLEG): container finished" podID="61dd8884-4159-47f0-a38c-2c7856194d13" containerID="3a17a86a41960dcd9096007121dbb21dc1bd613d93ac3924e5ab1dc1674675e5" exitCode=0 Jun 11 11:42:37.207141 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.207085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" event={"ID":"61dd8884-4159-47f0-a38c-2c7856194d13","Type":"ContainerDied","Data":"3a17a86a41960dcd9096007121dbb21dc1bd613d93ac3924e5ab1dc1674675e5"} Jun 11 11:42:37.207141 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.207124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" event={"ID":"61dd8884-4159-47f0-a38c-2c7856194d13","Type":"ContainerStarted","Data":"2422cdf1a9f114124a9986b78e7bd3109214ac0a9eddea0a0e18c271cb319683"} Jun 11 11:42:37.224468 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.224439 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z"] Jun 11 11:42:37.231358 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.231336 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.236154 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.236116 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z"] Jun 11 11:42:37.279779 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.279756 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t"] Jun 11 11:42:37.281806 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:42:37.281778 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec41a50_3542_4da1_8967_b42e2b846d0c.slice/crio-99d937db5636250a3c79dc0578c2d17237a26ddab54ec42ada105219c204f773 WatchSource:0}: Error finding container 99d937db5636250a3c79dc0578c2d17237a26ddab54ec42ada105219c204f773: Status 404 returned error can't find the container with id 99d937db5636250a3c79dc0578c2d17237a26ddab54ec42ada105219c204f773 Jun 11 11:42:37.338246 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.338216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.338376 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.338267 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tkmv\" (UniqueName: \"kubernetes.io/projected/2bbaf424-139b-4a4d-969a-eb377d0382f7-kube-api-access-5tkmv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.338443 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.338375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.348227 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.348204 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:37.439577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.439538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.439577 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.439579 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tkmv\" (UniqueName: \"kubernetes.io/projected/2bbaf424-139b-4a4d-969a-eb377d0382f7-kube-api-access-5tkmv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.439765 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.439630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.440006 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.439986 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.440053 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.439990 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.448843 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.448814 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tkmv\" (UniqueName: \"kubernetes.io/projected/2bbaf424-139b-4a4d-969a-eb377d0382f7-kube-api-access-5tkmv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.546036 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.545943 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:37.683204 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:37.683181 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z"] Jun 11 11:42:37.684912 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:42:37.684881 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbaf424_139b_4a4d_969a_eb377d0382f7.slice/crio-98be52dc8dca189f0937f0bc4de43137df5fd61cf42d4625ec58e14fde4f9291 WatchSource:0}: Error finding container 98be52dc8dca189f0937f0bc4de43137df5fd61cf42d4625ec58e14fde4f9291: Status 404 returned error can't find the container with id 98be52dc8dca189f0937f0bc4de43137df5fd61cf42d4625ec58e14fde4f9291 Jun 11 11:42:38.217602 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.217566 2560 generic.go:356] "Generic (PLEG): container finished" podID="61dd8884-4159-47f0-a38c-2c7856194d13" containerID="693951b40a4b91410bc50a2cfd2682f3a098d6ecc5c6a29b2f81bd349a43b6b2" exitCode=0 Jun 11 11:42:38.218040 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.217656 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" event={"ID":"61dd8884-4159-47f0-a38c-2c7856194d13","Type":"ContainerDied","Data":"693951b40a4b91410bc50a2cfd2682f3a098d6ecc5c6a29b2f81bd349a43b6b2"} Jun 11 11:42:38.219994 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.219971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" event={"ID":"bba0c180-92eb-484e-9433-6909e4dcd8da","Type":"ContainerStarted","Data":"860ab9667d1733585f40ceae7afb29649713265f586c1f94a2f74b3212990776"} Jun 11 11:42:38.221789 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.221762 2560 generic.go:356] "Generic (PLEG): container finished" podID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerID="5c8717425c623cc827c37d573cb5963a7b79b24cba2d94e8817362f791a3c71e" exitCode=0 Jun 11 11:42:38.221930 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.221834 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" event={"ID":"2bbaf424-139b-4a4d-969a-eb377d0382f7","Type":"ContainerDied","Data":"5c8717425c623cc827c37d573cb5963a7b79b24cba2d94e8817362f791a3c71e"} Jun 11 11:42:38.221930 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.221894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" event={"ID":"2bbaf424-139b-4a4d-969a-eb377d0382f7","Type":"ContainerStarted","Data":"98be52dc8dca189f0937f0bc4de43137df5fd61cf42d4625ec58e14fde4f9291"} Jun 11 11:42:38.223635 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.223615 2560 generic.go:356] "Generic (PLEG): container finished" podID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerID="b5f1e0254170f7ced5ce14a2dc33ca19ea9925d09e478d4be26283c193736d82" exitCode=0 Jun 11 11:42:38.223731 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.223642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" event={"ID":"aec41a50-3542-4da1-8967-b42e2b846d0c","Type":"ContainerDied","Data":"b5f1e0254170f7ced5ce14a2dc33ca19ea9925d09e478d4be26283c193736d82"} Jun 11 11:42:38.223731 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:38.223667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" event={"ID":"aec41a50-3542-4da1-8967-b42e2b846d0c","Type":"ContainerStarted","Data":"99d937db5636250a3c79dc0578c2d17237a26ddab54ec42ada105219c204f773"} Jun 11 11:42:39.230882 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:39.230842 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerID="860ab9667d1733585f40ceae7afb29649713265f586c1f94a2f74b3212990776" exitCode=0 Jun 11 11:42:39.231307 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:39.230925 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" event={"ID":"bba0c180-92eb-484e-9433-6909e4dcd8da","Type":"ContainerDied","Data":"860ab9667d1733585f40ceae7afb29649713265f586c1f94a2f74b3212990776"} Jun 11 11:42:39.232900 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:39.232850 2560 generic.go:356] "Generic (PLEG): container finished" podID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerID="67b579b58a7949f8c08851e43a8db68530979d29f751da24b4c083c12d24a4cc" exitCode=0 Jun 11 11:42:39.232979 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:39.232961 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" event={"ID":"2bbaf424-139b-4a4d-969a-eb377d0382f7","Type":"ContainerDied","Data":"67b579b58a7949f8c08851e43a8db68530979d29f751da24b4c083c12d24a4cc"} Jun 11 11:42:39.235023 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:39.235001 2560 generic.go:356] "Generic (PLEG): container finished" podID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerID="795592e347df7652f96214689a951d4a380218e6bb4bf3c7dc888841f2dbe11e" exitCode=0 Jun 11 11:42:39.235149 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:39.235127 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" event={"ID":"aec41a50-3542-4da1-8967-b42e2b846d0c","Type":"ContainerDied","Data":"795592e347df7652f96214689a951d4a380218e6bb4bf3c7dc888841f2dbe11e"} Jun 11 11:42:39.237322 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:39.237301 2560 generic.go:356] "Generic (PLEG): container finished" podID="61dd8884-4159-47f0-a38c-2c7856194d13" containerID="906710fbff779327284c8441692a8cf708a32f59903f9d1c1759b66c3747e4bd" exitCode=0 Jun 11 11:42:39.237411 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:39.237375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" event={"ID":"61dd8884-4159-47f0-a38c-2c7856194d13","Type":"ContainerDied","Data":"906710fbff779327284c8441692a8cf708a32f59903f9d1c1759b66c3747e4bd"} Jun 11 11:42:40.245599 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.245563 2560 generic.go:356] "Generic (PLEG): container finished" podID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerID="6a6bb55e8cefe5e412da48655e14a529f88be64fd5856caf2dd498937992cae3" exitCode=0 Jun 11 11:42:40.246074 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.245636 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" event={"ID":"bba0c180-92eb-484e-9433-6909e4dcd8da","Type":"ContainerDied","Data":"6a6bb55e8cefe5e412da48655e14a529f88be64fd5856caf2dd498937992cae3"} Jun 11 11:42:40.247686 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.247648 2560 generic.go:356] "Generic (PLEG): container finished" podID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerID="7ba5e05f40754a8204ebb9037a92c37a4f60bfa1b8c945bdedc32bd0aea390b0" exitCode=0 Jun 11 11:42:40.247780 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.247728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" event={"ID":"2bbaf424-139b-4a4d-969a-eb377d0382f7","Type":"ContainerDied","Data":"7ba5e05f40754a8204ebb9037a92c37a4f60bfa1b8c945bdedc32bd0aea390b0"} Jun 11 11:42:40.249644 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.249617 2560 generic.go:356] "Generic (PLEG): container finished" podID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerID="0e5a7d232e5ca2c7c6f332a39a6e576e1c49d26f407e8c21e2db1bdf82b6c29b" exitCode=0 Jun 11 11:42:40.249753 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.249649 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" event={"ID":"aec41a50-3542-4da1-8967-b42e2b846d0c","Type":"ContainerDied","Data":"0e5a7d232e5ca2c7c6f332a39a6e576e1c49d26f407e8c21e2db1bdf82b6c29b"} Jun 11 11:42:40.387564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.387540 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:40.566728 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.566692 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-bundle\") pod \"61dd8884-4159-47f0-a38c-2c7856194d13\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " Jun 11 11:42:40.566952 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.566820 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7x8m\" (UniqueName: \"kubernetes.io/projected/61dd8884-4159-47f0-a38c-2c7856194d13-kube-api-access-q7x8m\") pod \"61dd8884-4159-47f0-a38c-2c7856194d13\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " Jun 11 11:42:40.566952 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.566839 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-util\") pod \"61dd8884-4159-47f0-a38c-2c7856194d13\" (UID: \"61dd8884-4159-47f0-a38c-2c7856194d13\") " Jun 11 11:42:40.567320 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.567295 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-bundle" (OuterVolumeSpecName: "bundle") pod "61dd8884-4159-47f0-a38c-2c7856194d13" (UID: "61dd8884-4159-47f0-a38c-2c7856194d13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:42:40.569295 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.569271 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61dd8884-4159-47f0-a38c-2c7856194d13-kube-api-access-q7x8m" (OuterVolumeSpecName: "kube-api-access-q7x8m") pod "61dd8884-4159-47f0-a38c-2c7856194d13" (UID: "61dd8884-4159-47f0-a38c-2c7856194d13"). InnerVolumeSpecName "kube-api-access-q7x8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:42:40.572298 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.572278 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-util" (OuterVolumeSpecName: "util") pod "61dd8884-4159-47f0-a38c-2c7856194d13" (UID: "61dd8884-4159-47f0-a38c-2c7856194d13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:42:40.668153 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.668112 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7x8m\" (UniqueName: \"kubernetes.io/projected/61dd8884-4159-47f0-a38c-2c7856194d13-kube-api-access-q7x8m\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:40.668153 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.668151 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:40.668333 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:40.668163 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61dd8884-4159-47f0-a38c-2c7856194d13-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.257488 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.257457 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" Jun 11 11:42:41.257967 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.257508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf" event={"ID":"61dd8884-4159-47f0-a38c-2c7856194d13","Type":"ContainerDied","Data":"2422cdf1a9f114124a9986b78e7bd3109214ac0a9eddea0a0e18c271cb319683"} Jun 11 11:42:41.257967 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.257559 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2422cdf1a9f114124a9986b78e7bd3109214ac0a9eddea0a0e18c271cb319683" Jun 11 11:42:41.411735 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.411704 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:41.464585 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.464560 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:41.467830 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.467811 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:41.577420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577311 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-util\") pod \"aec41a50-3542-4da1-8967-b42e2b846d0c\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " Jun 11 11:42:41.577420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577368 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-util\") pod \"bba0c180-92eb-484e-9433-6909e4dcd8da\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " Jun 11 11:42:41.577420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577388 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm744\" (UniqueName: \"kubernetes.io/projected/aec41a50-3542-4da1-8967-b42e2b846d0c-kube-api-access-nm744\") pod \"aec41a50-3542-4da1-8967-b42e2b846d0c\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " Jun 11 11:42:41.577420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577403 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-util\") pod \"2bbaf424-139b-4a4d-969a-eb377d0382f7\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " Jun 11 11:42:41.577420 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577426 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-bundle\") pod \"aec41a50-3542-4da1-8967-b42e2b846d0c\" (UID: \"aec41a50-3542-4da1-8967-b42e2b846d0c\") " Jun 11 11:42:41.577818 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577494 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-bundle\") pod \"bba0c180-92eb-484e-9433-6909e4dcd8da\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " Jun 11 11:42:41.577818 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577553 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tkmv\" (UniqueName: \"kubernetes.io/projected/2bbaf424-139b-4a4d-969a-eb377d0382f7-kube-api-access-5tkmv\") pod \"2bbaf424-139b-4a4d-969a-eb377d0382f7\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " Jun 11 11:42:41.577818 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577622 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksbk5\" (UniqueName: \"kubernetes.io/projected/bba0c180-92eb-484e-9433-6909e4dcd8da-kube-api-access-ksbk5\") pod \"bba0c180-92eb-484e-9433-6909e4dcd8da\" (UID: \"bba0c180-92eb-484e-9433-6909e4dcd8da\") " Jun 11 11:42:41.577818 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.577655 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-bundle\") pod \"2bbaf424-139b-4a4d-969a-eb377d0382f7\" (UID: \"2bbaf424-139b-4a4d-969a-eb377d0382f7\") " Jun 11 11:42:41.578367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.578310 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-bundle" (OuterVolumeSpecName: "bundle") pod "2bbaf424-139b-4a4d-969a-eb377d0382f7" (UID: "2bbaf424-139b-4a4d-969a-eb377d0382f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:42:41.578367 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.578315 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-bundle" (OuterVolumeSpecName: "bundle") pod "aec41a50-3542-4da1-8967-b42e2b846d0c" (UID: "aec41a50-3542-4da1-8967-b42e2b846d0c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:42:41.578612 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.578586 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-bundle" (OuterVolumeSpecName: "bundle") pod "bba0c180-92eb-484e-9433-6909e4dcd8da" (UID: "bba0c180-92eb-484e-9433-6909e4dcd8da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:42:41.580395 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.580363 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aec41a50-3542-4da1-8967-b42e2b846d0c-kube-api-access-nm744" (OuterVolumeSpecName: "kube-api-access-nm744") pod "aec41a50-3542-4da1-8967-b42e2b846d0c" (UID: "aec41a50-3542-4da1-8967-b42e2b846d0c"). InnerVolumeSpecName "kube-api-access-nm744". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:42:41.580834 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.580805 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba0c180-92eb-484e-9433-6909e4dcd8da-kube-api-access-ksbk5" (OuterVolumeSpecName: "kube-api-access-ksbk5") pod "bba0c180-92eb-484e-9433-6909e4dcd8da" (UID: "bba0c180-92eb-484e-9433-6909e4dcd8da"). InnerVolumeSpecName "kube-api-access-ksbk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:42:41.581062 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.580840 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bbaf424-139b-4a4d-969a-eb377d0382f7-kube-api-access-5tkmv" (OuterVolumeSpecName: "kube-api-access-5tkmv") pod "2bbaf424-139b-4a4d-969a-eb377d0382f7" (UID: "2bbaf424-139b-4a4d-969a-eb377d0382f7"). InnerVolumeSpecName "kube-api-access-5tkmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:42:41.583631 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.583606 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-util" (OuterVolumeSpecName: "util") pod "bba0c180-92eb-484e-9433-6909e4dcd8da" (UID: "bba0c180-92eb-484e-9433-6909e4dcd8da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:42:41.584409 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.584387 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-util" (OuterVolumeSpecName: "util") pod "2bbaf424-139b-4a4d-969a-eb377d0382f7" (UID: "2bbaf424-139b-4a4d-969a-eb377d0382f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:42:41.584745 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.584717 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-util" (OuterVolumeSpecName: "util") pod "aec41a50-3542-4da1-8967-b42e2b846d0c" (UID: "aec41a50-3542-4da1-8967-b42e2b846d0c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:42:41.679352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679312 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksbk5\" (UniqueName: \"kubernetes.io/projected/bba0c180-92eb-484e-9433-6909e4dcd8da-kube-api-access-ksbk5\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.679352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679348 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.679352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679357 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.679352 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679365 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.679629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679373 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm744\" (UniqueName: \"kubernetes.io/projected/aec41a50-3542-4da1-8967-b42e2b846d0c-kube-api-access-nm744\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.679629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679381 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bbaf424-139b-4a4d-969a-eb377d0382f7-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.679629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679388 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aec41a50-3542-4da1-8967-b42e2b846d0c-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.679629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679395 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba0c180-92eb-484e-9433-6909e4dcd8da-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:41.679629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:41.679403 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tkmv\" (UniqueName: \"kubernetes.io/projected/2bbaf424-139b-4a4d-969a-eb377d0382f7-kube-api-access-5tkmv\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:42:42.265714 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.265671 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" event={"ID":"bba0c180-92eb-484e-9433-6909e4dcd8da","Type":"ContainerDied","Data":"c5565f8405cc88515023b9b7d5f8a3f13c29d69bd7287e32dfa27145bf4eea7d"} Jun 11 11:42:42.266214 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.265728 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5565f8405cc88515023b9b7d5f8a3f13c29d69bd7287e32dfa27145bf4eea7d" Jun 11 11:42:42.266214 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.265688 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v" Jun 11 11:42:42.267844 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.267815 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" event={"ID":"2bbaf424-139b-4a4d-969a-eb377d0382f7","Type":"ContainerDied","Data":"98be52dc8dca189f0937f0bc4de43137df5fd61cf42d4625ec58e14fde4f9291"} Jun 11 11:42:42.268057 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.267893 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98be52dc8dca189f0937f0bc4de43137df5fd61cf42d4625ec58e14fde4f9291" Jun 11 11:42:42.268057 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.267825 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z" Jun 11 11:42:42.270244 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.270222 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" Jun 11 11:42:42.270385 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.270252 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t" event={"ID":"aec41a50-3542-4da1-8967-b42e2b846d0c","Type":"ContainerDied","Data":"99d937db5636250a3c79dc0578c2d17237a26ddab54ec42ada105219c204f773"} Jun 11 11:42:42.270385 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:42.270290 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99d937db5636250a3c79dc0578c2d17237a26ddab54ec42ada105219c204f773" Jun 11 11:42:48.783600 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:48.783562 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:52.646956 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:52.646917 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:53.213274 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:53.213240 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:53.273772 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:53.273732 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:54.410254 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:54.410179 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:55.702920 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.702877 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c"] Jun 11 11:42:55.703278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703248 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerName="util" Jun 11 11:42:55.703278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703261 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerName="util" Jun 11 11:42:55.703278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703271 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61dd8884-4159-47f0-a38c-2c7856194d13" containerName="util" Jun 11 11:42:55.703278 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703277 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61dd8884-4159-47f0-a38c-2c7856194d13" containerName="util" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703283 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61dd8884-4159-47f0-a38c-2c7856194d13" containerName="pull" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703290 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61dd8884-4159-47f0-a38c-2c7856194d13" containerName="pull" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703299 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerName="pull" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703304 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerName="pull" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703314 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerName="util" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703318 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerName="util" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703329 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerName="extract" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703334 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerName="extract" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703341 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerName="pull" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703346 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerName="pull" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703351 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerName="pull" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703356 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerName="pull" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703363 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61dd8884-4159-47f0-a38c-2c7856194d13" containerName="extract" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703367 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61dd8884-4159-47f0-a38c-2c7856194d13" containerName="extract" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703372 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerName="extract" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703377 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerName="extract" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703382 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerName="util" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703387 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerName="util" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703398 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerName="extract" Jun 11 11:42:55.703413 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703402 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerName="extract" Jun 11 11:42:55.703993 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703456 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="61dd8884-4159-47f0-a38c-2c7856194d13" containerName="extract" Jun 11 11:42:55.703993 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703467 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba0c180-92eb-484e-9433-6909e4dcd8da" containerName="extract" Jun 11 11:42:55.703993 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703473 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aec41a50-3542-4da1-8967-b42e2b846d0c" containerName="extract" Jun 11 11:42:55.703993 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.703480 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbaf424-139b-4a4d-969a-eb377d0382f7" containerName="extract" Jun 11 11:42:55.711917 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.711890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:42:55.715124 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.715097 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mlwkg\"" Jun 11 11:42:55.715318 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.715131 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 11:42:55.715979 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.715960 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 11:42:55.721703 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.721680 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c"] Jun 11 11:42:55.809163 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.809122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwdf4\" (UniqueName: \"kubernetes.io/projected/eed1fe3f-be05-48fa-9032-9d677a3ff57e-kube-api-access-fwdf4\") pod \"limitador-operator-controller-manager-859d7b78bd-2fs7c\" (UID: \"eed1fe3f-be05-48fa-9032-9d677a3ff57e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:42:55.910574 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.910532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwdf4\" (UniqueName: \"kubernetes.io/projected/eed1fe3f-be05-48fa-9032-9d677a3ff57e-kube-api-access-fwdf4\") pod \"limitador-operator-controller-manager-859d7b78bd-2fs7c\" (UID: \"eed1fe3f-be05-48fa-9032-9d677a3ff57e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:42:55.924105 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:55.924078 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwdf4\" (UniqueName: \"kubernetes.io/projected/eed1fe3f-be05-48fa-9032-9d677a3ff57e-kube-api-access-fwdf4\") pod \"limitador-operator-controller-manager-859d7b78bd-2fs7c\" (UID: \"eed1fe3f-be05-48fa-9032-9d677a3ff57e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:42:56.025277 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:56.025184 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:42:56.038543 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:56.038513 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:56.165632 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:56.165599 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c"] Jun 11 11:42:56.167344 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:42:56.167320 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed1fe3f_be05_48fa_9032_9d677a3ff57e.slice/crio-c70ec5cb429f83c4f2ade86cbc0e38d4e276abaf6aea8de434de32b701c83586 WatchSource:0}: Error finding container c70ec5cb429f83c4f2ade86cbc0e38d4e276abaf6aea8de434de32b701c83586: Status 404 returned error can't find the container with id c70ec5cb429f83c4f2ade86cbc0e38d4e276abaf6aea8de434de32b701c83586 Jun 11 11:42:56.169338 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:56.169322 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 11:42:56.355897 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:56.355798 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" event={"ID":"eed1fe3f-be05-48fa-9032-9d677a3ff57e","Type":"ContainerStarted","Data":"c70ec5cb429f83c4f2ade86cbc0e38d4e276abaf6aea8de434de32b701c83586"} Jun 11 11:42:56.388215 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:56.388161 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:57.849052 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:57.848971 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:42:58.374885 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:58.374770 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" event={"ID":"eed1fe3f-be05-48fa-9032-9d677a3ff57e","Type":"ContainerStarted","Data":"a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b"} Jun 11 11:42:58.375049 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:58.374936 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:42:58.394018 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:58.393962 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" podStartSLOduration=1.496403836 podStartE2EDuration="3.393945601s" totalImagesPullingTime="1.897541765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:42:58.392454593 +0000 UTC m=+619.096462299" watchObservedRunningTime="2026-06-11 11:42:58.393945601 +0000 UTC m=+619.097953373" Jun 11 11:42:59.442653 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:42:59.442620 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:00.271838 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:00.271801 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:00.372736 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:00.372706 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:01.778285 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:01.778241 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6"] Jun 11 11:43:01.783004 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:01.782976 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" Jun 11 11:43:01.789163 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:01.789139 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-229rd\"" Jun 11 11:43:01.790140 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:01.790118 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 11:43:01.795274 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:01.795250 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6"] Jun 11 11:43:01.866062 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:01.866028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9khdw\" (UniqueName: \"kubernetes.io/projected/7146266b-53c4-432a-8d17-c52c866a7225-kube-api-access-9khdw\") pod \"dns-operator-controller-manager-864dd78c4c-cfdf6\" (UID: \"7146266b-53c4-432a-8d17-c52c866a7225\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" Jun 11 11:43:01.967381 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:01.967342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9khdw\" (UniqueName: \"kubernetes.io/projected/7146266b-53c4-432a-8d17-c52c866a7225-kube-api-access-9khdw\") pod \"dns-operator-controller-manager-864dd78c4c-cfdf6\" (UID: \"7146266b-53c4-432a-8d17-c52c866a7225\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" Jun 11 11:43:01.980144 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:01.980105 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9khdw\" (UniqueName: \"kubernetes.io/projected/7146266b-53c4-432a-8d17-c52c866a7225-kube-api-access-9khdw\") pod \"dns-operator-controller-manager-864dd78c4c-cfdf6\" (UID: \"7146266b-53c4-432a-8d17-c52c866a7225\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" Jun 11 11:43:02.094765 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:02.094669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" Jun 11 11:43:02.255173 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:02.255145 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6"] Jun 11 11:43:02.257436 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:43:02.257406 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7146266b_53c4_432a_8d17_c52c866a7225.slice/crio-ce02180c148b02083d04c10873b614416e055b20ec2c7e5ff95827a89e1ffa17 WatchSource:0}: Error finding container ce02180c148b02083d04c10873b614416e055b20ec2c7e5ff95827a89e1ffa17: Status 404 returned error can't find the container with id ce02180c148b02083d04c10873b614416e055b20ec2c7e5ff95827a89e1ffa17 Jun 11 11:43:02.272820 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:02.272789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:02.398487 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:02.398411 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" event={"ID":"7146266b-53c4-432a-8d17-c52c866a7225","Type":"ContainerStarted","Data":"ce02180c148b02083d04c10873b614416e055b20ec2c7e5ff95827a89e1ffa17"} Jun 11 11:43:04.109017 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:04.105159 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c5dc8b6d7-hzh8r"] Jun 11 11:43:04.199213 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:04.199159 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:04.298429 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:04.298393 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:04.409794 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:04.409763 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:04.411939 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:04.411913 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" event={"ID":"7146266b-53c4-432a-8d17-c52c866a7225","Type":"ContainerStarted","Data":"79e59758704509c011eb2ee4278102d08c09d2b1e6405e75cfda257a732f0ad2"} Jun 11 11:43:04.412093 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:04.412020 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" Jun 11 11:43:04.435226 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:04.435170 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" podStartSLOduration=1.5010483369999998 podStartE2EDuration="3.43515312s" totalImagesPullingTime="1.934104783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:43:04.433018841 +0000 UTC m=+625.137026589" watchObservedRunningTime="2026-06-11 11:43:04.43515312 +0000 UTC m=+625.139160827" Jun 11 11:43:04.510314 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:04.510279 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:05.186968 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:05.186934 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:05.289007 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:05.288971 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:09.382915 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:09.382851 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:43:11.612562 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:11.612529 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:11.716582 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:11.716550 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:15.420998 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:15.420964 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cfdf6" Jun 11 11:43:15.953127 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:15.953086 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c"] Jun 11 11:43:15.953406 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:15.953348 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" containerName="manager" containerID="cri-o://a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b" gracePeriod=2 Jun 11 11:43:15.972416 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:15.972387 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c"] Jun 11 11:43:16.016660 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.016626 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb"] Jun 11 11:43:16.017034 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.017019 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" containerName="manager" Jun 11 11:43:16.017034 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.017034 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" containerName="manager" Jun 11 11:43:16.017183 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.017114 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" containerName="manager" Jun 11 11:43:16.020277 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.020252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" Jun 11 11:43:16.046029 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.046001 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb"] Jun 11 11:43:16.076170 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:43:16.076135 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2fs7c\" is forbidden: User \"system:node:ip-10-0-129-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-217.ec2.internal' and this object" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:43:16.093531 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.093497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lstlx\" (UniqueName: \"kubernetes.io/projected/2d3a09d7-daf5-4d9a-89b6-e34166c78240-kube-api-access-lstlx\") pod \"limitador-operator-controller-manager-859d7b78bd-n9wkb\" (UID: \"2d3a09d7-daf5-4d9a-89b6-e34166c78240\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" Jun 11 11:43:16.194095 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.194057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lstlx\" (UniqueName: \"kubernetes.io/projected/2d3a09d7-daf5-4d9a-89b6-e34166c78240-kube-api-access-lstlx\") pod \"limitador-operator-controller-manager-859d7b78bd-n9wkb\" (UID: \"2d3a09d7-daf5-4d9a-89b6-e34166c78240\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" Jun 11 11:43:16.199408 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.199383 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:43:16.204706 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:43:16.204647 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2fs7c\" is forbidden: User \"system:node:ip-10-0-129-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-217.ec2.internal' and this object" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:43:16.214939 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.214909 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lstlx\" (UniqueName: \"kubernetes.io/projected/2d3a09d7-daf5-4d9a-89b6-e34166c78240-kube-api-access-lstlx\") pod \"limitador-operator-controller-manager-859d7b78bd-n9wkb\" (UID: \"2d3a09d7-daf5-4d9a-89b6-e34166c78240\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" Jun 11 11:43:16.294973 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.294928 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwdf4\" (UniqueName: \"kubernetes.io/projected/eed1fe3f-be05-48fa-9032-9d677a3ff57e-kube-api-access-fwdf4\") pod \"eed1fe3f-be05-48fa-9032-9d677a3ff57e\" (UID: \"eed1fe3f-be05-48fa-9032-9d677a3ff57e\") " Jun 11 11:43:16.297250 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.297222 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed1fe3f-be05-48fa-9032-9d677a3ff57e-kube-api-access-fwdf4" (OuterVolumeSpecName: "kube-api-access-fwdf4") pod "eed1fe3f-be05-48fa-9032-9d677a3ff57e" (UID: "eed1fe3f-be05-48fa-9032-9d677a3ff57e"). InnerVolumeSpecName "kube-api-access-fwdf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:43:16.335624 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.335570 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" Jun 11 11:43:16.396431 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.396390 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwdf4\" (UniqueName: \"kubernetes.io/projected/eed1fe3f-be05-48fa-9032-9d677a3ff57e-kube-api-access-fwdf4\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:43:16.480980 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.480857 2560 generic.go:356] "Generic (PLEG): container finished" podID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" containerID="a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b" exitCode=0 Jun 11 11:43:16.480980 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.480920 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:43:16.481507 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.481012 2560 scope.go:117] "RemoveContainer" containerID="a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b" Jun 11 11:43:16.483823 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:43:16.483764 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2fs7c\" is forbidden: User \"system:node:ip-10-0-129-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-217.ec2.internal' and this object" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:43:16.488983 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.488954 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb"] Jun 11 11:43:16.493913 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:43:16.493884 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3a09d7_daf5_4d9a_89b6_e34166c78240.slice/crio-0856e4f89bf9ac42008384edcf43891dce405cdcfa4931104d62d75023eae3b7 WatchSource:0}: Error finding container 0856e4f89bf9ac42008384edcf43891dce405cdcfa4931104d62d75023eae3b7: Status 404 returned error can't find the container with id 0856e4f89bf9ac42008384edcf43891dce405cdcfa4931104d62d75023eae3b7 Jun 11 11:43:16.495251 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.495207 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:16.497359 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:43:16.497331 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2fs7c\" is forbidden: User \"system:node:ip-10-0-129-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-217.ec2.internal' and this object" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:43:16.499603 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.499524 2560 scope.go:117] "RemoveContainer" containerID="a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b" Jun 11 11:43:16.499801 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:43:16.499776 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b\": container with ID starting with a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b not found: ID does not exist" containerID="a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b" Jun 11 11:43:16.499894 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.499809 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b"} err="failed to get container status \"a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b\": rpc error: code = NotFound desc = could not find container \"a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b\": container with ID starting with a0d1a90965a7979dc066a956cb505499d83eb79d42b018713cf217bbffdc645b not found: ID does not exist" Jun 11 11:43:16.604283 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.604249 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:16.718710 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:16.718672 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:17.488901 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:17.488845 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" event={"ID":"2d3a09d7-daf5-4d9a-89b6-e34166c78240","Type":"ContainerStarted","Data":"4ce61d977fd642ac7e17ad878dae408edfce895f549b153c29e2836dbbbd926d"} Jun 11 11:43:17.489273 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:17.488915 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" event={"ID":"2d3a09d7-daf5-4d9a-89b6-e34166c78240","Type":"ContainerStarted","Data":"0856e4f89bf9ac42008384edcf43891dce405cdcfa4931104d62d75023eae3b7"} Jun 11 11:43:17.489273 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:17.488991 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" Jun 11 11:43:17.491396 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:43:17.491370 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2fs7c\" is forbidden: User \"system:node:ip-10-0-129-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-217.ec2.internal' and this object" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2fs7c" Jun 11 11:43:17.531051 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:17.531002 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" podStartSLOduration=2.5309863889999997 podStartE2EDuration="2.530986389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:43:17.529134775 +0000 UTC m=+638.233142482" watchObservedRunningTime="2026-06-11 11:43:17.530986389 +0000 UTC m=+638.234994097" Jun 11 11:43:17.762059 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:17.761977 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed1fe3f-be05-48fa-9032-9d677a3ff57e" path="/var/lib/kubelet/pods/eed1fe3f-be05-48fa-9032-9d677a3ff57e/volumes" Jun 11 11:43:18.893486 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:18.893450 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:18.989760 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:18.989725 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:22.383356 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:22.383311 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:22.479409 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:22.479346 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:24.187044 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:24.187009 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:24.288974 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:24.288938 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:24.405623 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:24.405592 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:24.470310 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:24.470229 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:28.497635 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:28.497603 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n9wkb" Jun 11 11:43:29.132937 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.132898 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c5dc8b6d7-hzh8r" podUID="98624931-b7fe-4a8b-bb47-03a559d66ecf" containerName="console" containerID="cri-o://81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236" gracePeriod=15 Jun 11 11:43:29.390979 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.390918 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:43:29.512628 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.512591 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-trusted-ca-bundle\") pod \"98624931-b7fe-4a8b-bb47-03a559d66ecf\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " Jun 11 11:43:29.513150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.512663 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-config\") pod \"98624931-b7fe-4a8b-bb47-03a559d66ecf\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " Jun 11 11:43:29.513150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.512729 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-serving-cert\") pod \"98624931-b7fe-4a8b-bb47-03a559d66ecf\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " Jun 11 11:43:29.513150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.512758 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-oauth-serving-cert\") pod \"98624931-b7fe-4a8b-bb47-03a559d66ecf\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " Jun 11 11:43:29.513150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.512810 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-service-ca\") pod \"98624931-b7fe-4a8b-bb47-03a559d66ecf\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " Jun 11 11:43:29.513150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.512838 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-oauth-config\") pod \"98624931-b7fe-4a8b-bb47-03a559d66ecf\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " Jun 11 11:43:29.513150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.512896 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgkjl\" (UniqueName: \"kubernetes.io/projected/98624931-b7fe-4a8b-bb47-03a559d66ecf-kube-api-access-lgkjl\") pod \"98624931-b7fe-4a8b-bb47-03a559d66ecf\" (UID: \"98624931-b7fe-4a8b-bb47-03a559d66ecf\") " Jun 11 11:43:29.513475 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.513100 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "98624931-b7fe-4a8b-bb47-03a559d66ecf" (UID: "98624931-b7fe-4a8b-bb47-03a559d66ecf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:43:29.513475 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.513285 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-config" (OuterVolumeSpecName: "console-config") pod "98624931-b7fe-4a8b-bb47-03a559d66ecf" (UID: "98624931-b7fe-4a8b-bb47-03a559d66ecf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:43:29.513475 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.513291 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "98624931-b7fe-4a8b-bb47-03a559d66ecf" (UID: "98624931-b7fe-4a8b-bb47-03a559d66ecf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:43:29.513475 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.513395 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-service-ca" (OuterVolumeSpecName: "service-ca") pod "98624931-b7fe-4a8b-bb47-03a559d66ecf" (UID: "98624931-b7fe-4a8b-bb47-03a559d66ecf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:43:29.515037 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.515013 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "98624931-b7fe-4a8b-bb47-03a559d66ecf" (UID: "98624931-b7fe-4a8b-bb47-03a559d66ecf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:43:29.515138 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.515114 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "98624931-b7fe-4a8b-bb47-03a559d66ecf" (UID: "98624931-b7fe-4a8b-bb47-03a559d66ecf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:43:29.515273 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.515254 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98624931-b7fe-4a8b-bb47-03a559d66ecf-kube-api-access-lgkjl" (OuterVolumeSpecName: "kube-api-access-lgkjl") pod "98624931-b7fe-4a8b-bb47-03a559d66ecf" (UID: "98624931-b7fe-4a8b-bb47-03a559d66ecf"). InnerVolumeSpecName "kube-api-access-lgkjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:43:29.569517 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.569481 2560 generic.go:356] "Generic (PLEG): container finished" podID="98624931-b7fe-4a8b-bb47-03a559d66ecf" containerID="81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236" exitCode=0 Jun 11 11:43:29.569715 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.569527 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5dc8b6d7-hzh8r" Jun 11 11:43:29.569715 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.569544 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5dc8b6d7-hzh8r" event={"ID":"98624931-b7fe-4a8b-bb47-03a559d66ecf","Type":"ContainerDied","Data":"81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236"} Jun 11 11:43:29.569715 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.569590 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5dc8b6d7-hzh8r" event={"ID":"98624931-b7fe-4a8b-bb47-03a559d66ecf","Type":"ContainerDied","Data":"0e97cf8e49cae13c6a5ff4877df00255973fd4e9e5f4b606fe75d2c1616b24b9"} Jun 11 11:43:29.569715 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.569612 2560 scope.go:117] "RemoveContainer" containerID="81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236" Jun 11 11:43:29.579468 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.579446 2560 scope.go:117] "RemoveContainer" containerID="81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236" Jun 11 11:43:29.579713 ip-10-0-129-217 kubenswrapper[2560]: E0611 11:43:29.579697 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236\": container with ID starting with 81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236 not found: ID does not exist" containerID="81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236" Jun 11 11:43:29.579762 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.579721 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236"} err="failed to get container status \"81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236\": rpc error: code = NotFound desc = could not find container \"81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236\": container with ID starting with 81448c7f6ba018fab0846ca95d8bc68f2f40b05347533f89a42b495b12e26236 not found: ID does not exist" Jun 11 11:43:29.601998 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.601969 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c5dc8b6d7-hzh8r"] Jun 11 11:43:29.609920 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.609892 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c5dc8b6d7-hzh8r"] Jun 11 11:43:29.614349 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.614327 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgkjl\" (UniqueName: \"kubernetes.io/projected/98624931-b7fe-4a8b-bb47-03a559d66ecf-kube-api-access-lgkjl\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:43:29.614418 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.614353 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-trusted-ca-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:43:29.614418 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.614365 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-config\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:43:29.614418 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.614373 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-serving-cert\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:43:29.614418 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.614381 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-oauth-serving-cert\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:43:29.614418 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.614389 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98624931-b7fe-4a8b-bb47-03a559d66ecf-service-ca\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:43:29.614418 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.614397 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98624931-b7fe-4a8b-bb47-03a559d66ecf-console-oauth-config\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:43:29.762535 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:29.762503 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98624931-b7fe-4a8b-bb47-03a559d66ecf" path="/var/lib/kubelet/pods/98624931-b7fe-4a8b-bb47-03a559d66ecf/volumes" Jun 11 11:43:31.360993 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:31.360946 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:31.462847 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:31.462809 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:36.160493 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:36.160454 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:36.261881 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:36.261846 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:36.336001 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:36.335965 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:38.624227 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:38.624183 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:38.723165 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:38.723135 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:40.672534 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:40.672499 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:44.572328 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:44.572292 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:44.672800 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:44.672760 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:45.649831 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:45.649795 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:46.003509 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:46.003425 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:47.403626 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.403598 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:47.404719 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.404700 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-887jg"] Jun 11 11:43:47.405102 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.405090 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98624931-b7fe-4a8b-bb47-03a559d66ecf" containerName="console" Jun 11 11:43:47.405150 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.405105 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="98624931-b7fe-4a8b-bb47-03a559d66ecf" containerName="console" Jun 11 11:43:47.405193 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.405184 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="98624931-b7fe-4a8b-bb47-03a559d66ecf" containerName="console" Jun 11 11:43:47.412075 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.412057 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:47.418924 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.418900 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 11:43:47.419010 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.418942 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7r27k\"" Jun 11 11:43:47.428815 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.428787 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-887jg"] Jun 11 11:43:47.446102 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.446066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5tds\" (UniqueName: \"kubernetes.io/projected/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-kube-api-access-j5tds\") pod \"limitador-limitador-64c94fd64f-887jg\" (UID: \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:47.446285 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.446189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-config-file\") pod \"limitador-limitador-64c94fd64f-887jg\" (UID: \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:47.480732 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.480689 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-887jg"] Jun 11 11:43:47.494391 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.494364 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:47.546842 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.546799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-config-file\") pod \"limitador-limitador-64c94fd64f-887jg\" (UID: \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:47.547054 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.546855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5tds\" (UniqueName: \"kubernetes.io/projected/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-kube-api-access-j5tds\") pod \"limitador-limitador-64c94fd64f-887jg\" (UID: \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:47.547473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.547452 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-config-file\") pod \"limitador-limitador-64c94fd64f-887jg\" (UID: \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:47.556539 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.556508 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5tds\" (UniqueName: \"kubernetes.io/projected/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-kube-api-access-j5tds\") pod \"limitador-limitador-64c94fd64f-887jg\" (UID: \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:47.595921 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.595862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:47.722273 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.722182 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:47.868687 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:47.868656 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-887jg"] Jun 11 11:43:47.869535 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:43:47.869499 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fadfcb1_981d_4ffc_8f31_41c8acd2a8bc.slice/crio-9a7a0480f784cc91ddd1888cfa17e556047eab56a48f8417916c9285c667f2d6 WatchSource:0}: Error finding container 9a7a0480f784cc91ddd1888cfa17e556047eab56a48f8417916c9285c667f2d6: Status 404 returned error can't find the container with id 9a7a0480f784cc91ddd1888cfa17e556047eab56a48f8417916c9285c667f2d6 Jun 11 11:43:48.231780 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:48.231747 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:48.303617 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:48.303586 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:48.689167 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:48.689126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" event={"ID":"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc","Type":"ContainerStarted","Data":"9a7a0480f784cc91ddd1888cfa17e556047eab56a48f8417916c9285c667f2d6"} Jun 11 11:43:50.702416 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:50.702386 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" event={"ID":"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc","Type":"ContainerStarted","Data":"c5a8f23c7176211cc7ced4a6b4603a867edf5a35269e71aa5f34049821724994"} Jun 11 11:43:50.702837 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:50.702512 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:43:50.722506 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:50.722426 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" podStartSLOduration=0.972085317 podStartE2EDuration="3.72240446s" totalImagesPullingTime="2.750319143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:43:50.721083889 +0000 UTC m=+671.425091597" watchObservedRunningTime="2026-06-11 11:43:50.72240446 +0000 UTC m=+671.426412168" Jun 11 11:43:51.783230 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:51.783191 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:51.882408 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:51.882373 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:52.559651 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:52.559618 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:52.614291 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:52.614261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:56.581181 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:56.581140 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:56.680658 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:56.680623 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:59.030209 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:59.030163 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:43:59.085908 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:43:59.085848 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:44:01.710609 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:01.710576 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:44:02.326629 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.326590 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-887jg"] Jun 11 11:44:02.326850 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.326797 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" podUID="7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc" containerName="limitador" containerID="cri-o://c5a8f23c7176211cc7ced4a6b4603a867edf5a35269e71aa5f34049821724994" gracePeriod=30 Jun 11 11:44:02.772466 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.772434 2560 generic.go:356] "Generic (PLEG): container finished" podID="7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc" containerID="c5a8f23c7176211cc7ced4a6b4603a867edf5a35269e71aa5f34049821724994" exitCode=0 Jun 11 11:44:02.772820 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.772488 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" event={"ID":"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc","Type":"ContainerDied","Data":"c5a8f23c7176211cc7ced4a6b4603a867edf5a35269e71aa5f34049821724994"} Jun 11 11:44:02.884742 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.884679 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:44:02.983555 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.983523 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5tds\" (UniqueName: \"kubernetes.io/projected/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-kube-api-access-j5tds\") pod \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\" (UID: \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\") " Jun 11 11:44:02.983757 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.983564 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-config-file\") pod \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\" (UID: \"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc\") " Jun 11 11:44:02.984023 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.983993 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-config-file" (OuterVolumeSpecName: "config-file") pod "7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc" (UID: "7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 11:44:02.985752 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:02.985728 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-kube-api-access-j5tds" (OuterVolumeSpecName: "kube-api-access-j5tds") pod "7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc" (UID: "7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc"). InnerVolumeSpecName "kube-api-access-j5tds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:44:03.084319 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.084280 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5tds\" (UniqueName: \"kubernetes.io/projected/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-kube-api-access-j5tds\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:44:03.084319 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.084313 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc-config-file\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:44:03.485015 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.484979 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-vrjm7"] Jun 11 11:44:03.485369 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.485357 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc" containerName="limitador" Jun 11 11:44:03.485423 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.485371 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc" containerName="limitador" Jun 11 11:44:03.485471 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.485462 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc" containerName="limitador" Jun 11 11:44:03.488187 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.488172 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:03.491957 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.491934 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 11:44:03.510715 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.510685 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vrjm7"] Jun 11 11:44:03.553723 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.553686 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:44:03.588596 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.588568 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrtpc\" (UniqueName: \"kubernetes.io/projected/73a82137-3fac-497d-9fcf-b8a779f28f62-kube-api-access-wrtpc\") pod \"postgres-69fb4594cf-vrjm7\" (UID: \"73a82137-3fac-497d-9fcf-b8a779f28f62\") " pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:03.588734 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.588632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73a82137-3fac-497d-9fcf-b8a779f28f62-data\") pod \"postgres-69fb4594cf-vrjm7\" (UID: \"73a82137-3fac-497d-9fcf-b8a779f28f62\") " pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:03.689504 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.689456 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73a82137-3fac-497d-9fcf-b8a779f28f62-data\") pod \"postgres-69fb4594cf-vrjm7\" (UID: \"73a82137-3fac-497d-9fcf-b8a779f28f62\") " pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:03.689679 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.689534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrtpc\" (UniqueName: \"kubernetes.io/projected/73a82137-3fac-497d-9fcf-b8a779f28f62-kube-api-access-wrtpc\") pod \"postgres-69fb4594cf-vrjm7\" (UID: \"73a82137-3fac-497d-9fcf-b8a779f28f62\") " pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:03.689823 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.689805 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73a82137-3fac-497d-9fcf-b8a779f28f62-data\") pod \"postgres-69fb4594cf-vrjm7\" (UID: \"73a82137-3fac-497d-9fcf-b8a779f28f62\") " pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:03.698184 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.698153 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrtpc\" (UniqueName: \"kubernetes.io/projected/73a82137-3fac-497d-9fcf-b8a779f28f62-kube-api-access-wrtpc\") pod \"postgres-69fb4594cf-vrjm7\" (UID: \"73a82137-3fac-497d-9fcf-b8a779f28f62\") " pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:03.779248 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.779223 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" Jun 11 11:44:03.779657 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.779263 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-887jg" event={"ID":"7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc","Type":"ContainerDied","Data":"9a7a0480f784cc91ddd1888cfa17e556047eab56a48f8417916c9285c667f2d6"} Jun 11 11:44:03.779657 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.779326 2560 scope.go:117] "RemoveContainer" containerID="c5a8f23c7176211cc7ced4a6b4603a867edf5a35269e71aa5f34049821724994" Jun 11 11:44:03.798989 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.798601 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-887jg"] Jun 11 11:44:03.798989 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.798769 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:03.808083 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.808052 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-887jg"] Jun 11 11:44:03.939268 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:03.939235 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vrjm7"] Jun 11 11:44:03.941380 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:44:03.941351 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a82137_3fac_497d_9fcf_b8a779f28f62.slice/crio-447c61c3e8e14ca458ce3842d10fa3b5f62e825000562edf364c14ad4f2aa30d WatchSource:0}: Error finding container 447c61c3e8e14ca458ce3842d10fa3b5f62e825000562edf364c14ad4f2aa30d: Status 404 returned error can't find the container with id 447c61c3e8e14ca458ce3842d10fa3b5f62e825000562edf364c14ad4f2aa30d Jun 11 11:44:04.787858 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:04.787822 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vrjm7" event={"ID":"73a82137-3fac-497d-9fcf-b8a779f28f62","Type":"ContainerStarted","Data":"447c61c3e8e14ca458ce3842d10fa3b5f62e825000562edf364c14ad4f2aa30d"} Jun 11 11:44:05.764459 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:05.764423 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc" path="/var/lib/kubelet/pods/7fadfcb1-981d-4ffc-8f31-41c8acd2a8bc/volumes" Jun 11 11:44:06.803158 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:06.803066 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vrjm7" event={"ID":"73a82137-3fac-497d-9fcf-b8a779f28f62","Type":"ContainerStarted","Data":"a919aaec583a267966f8c04c32c0fab57e60272ac566ff2a2331b126538a1ae1"} Jun 11 11:44:06.803491 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:06.803162 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:06.821322 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:06.821264 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-vrjm7" podStartSLOduration=1.269480423 podStartE2EDuration="3.821245755s" totalImagesPullingTime="2.551765332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:44:06.819014334 +0000 UTC m=+687.523022043" watchObservedRunningTime="2026-06-11 11:44:06.821245755 +0000 UTC m=+687.525253463" Jun 11 11:44:12.649340 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:12.649299 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:44:12.840069 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:12.840043 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-vrjm7" Jun 11 11:44:13.152838 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:13.152797 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:44:13.250122 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:13.250072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:44:13.386736 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:13.386711 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:44:14.455940 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.455904 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x"] Jun 11 11:44:14.459876 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.459850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.462987 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.462967 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 11:44:14.463177 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.463146 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 11:44:14.463304 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.463215 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5b642\"" Jun 11 11:44:14.473179 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.473146 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x"] Jun 11 11:44:14.585206 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.585166 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.585382 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.585242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf449\" (UniqueName: \"kubernetes.io/projected/994725c0-3b60-40c4-a358-134ce1ac38a4-kube-api-access-jf449\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.585382 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.585278 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.686248 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.686209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf449\" (UniqueName: \"kubernetes.io/projected/994725c0-3b60-40c4-a358-134ce1ac38a4-kube-api-access-jf449\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.686248 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.686258 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.686503 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.686300 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.686680 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.686660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.686729 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.686671 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.696075 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.696047 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf449\" (UniqueName: \"kubernetes.io/projected/994725c0-3b60-40c4-a358-134ce1ac38a4-kube-api-access-jf449\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.769212 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.769106 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:14.915835 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:14.915811 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x"] Jun 11 11:44:14.918053 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:44:14.918020 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994725c0_3b60_40c4_a358_134ce1ac38a4.slice/crio-52abe19f2b1aa87e975314e58ef044c672f03963b3bf4a61a3335d2dc7369a94 WatchSource:0}: Error finding container 52abe19f2b1aa87e975314e58ef044c672f03963b3bf4a61a3335d2dc7369a94: Status 404 returned error can't find the container with id 52abe19f2b1aa87e975314e58ef044c672f03963b3bf4a61a3335d2dc7369a94 Jun 11 11:44:15.859373 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:15.859335 2560 generic.go:356] "Generic (PLEG): container finished" podID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerID="a13495ff6d2f795470c896419330931d91a6254f8c7bbefc35026d85afb9e19c" exitCode=0 Jun 11 11:44:15.859733 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:15.859383 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" event={"ID":"994725c0-3b60-40c4-a358-134ce1ac38a4","Type":"ContainerDied","Data":"a13495ff6d2f795470c896419330931d91a6254f8c7bbefc35026d85afb9e19c"} Jun 11 11:44:15.859733 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:15.859424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" event={"ID":"994725c0-3b60-40c4-a358-134ce1ac38a4","Type":"ContainerStarted","Data":"52abe19f2b1aa87e975314e58ef044c672f03963b3bf4a61a3335d2dc7369a94"} Jun 11 11:44:16.867734 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:16.867637 2560 generic.go:356] "Generic (PLEG): container finished" podID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerID="da221ffa85e71755e4ba7a1a3c8511336a42a240f3418c6c15220548c4a2f942" exitCode=0 Jun 11 11:44:16.867734 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:16.867691 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" event={"ID":"994725c0-3b60-40c4-a358-134ce1ac38a4","Type":"ContainerDied","Data":"da221ffa85e71755e4ba7a1a3c8511336a42a240f3418c6c15220548c4a2f942"} Jun 11 11:44:17.879379 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:17.879336 2560 generic.go:356] "Generic (PLEG): container finished" podID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerID="598b0624860d55bb07080397d2c1a600ede5c404dc86da9a324c00df1a6cbd3e" exitCode=0 Jun 11 11:44:17.879847 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:17.879392 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" event={"ID":"994725c0-3b60-40c4-a358-134ce1ac38a4","Type":"ContainerDied","Data":"598b0624860d55bb07080397d2c1a600ede5c404dc86da9a324c00df1a6cbd3e"} Jun 11 11:44:19.053842 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.053806 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:19.122849 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.122811 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf449\" (UniqueName: \"kubernetes.io/projected/994725c0-3b60-40c4-a358-134ce1ac38a4-kube-api-access-jf449\") pod \"994725c0-3b60-40c4-a358-134ce1ac38a4\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " Jun 11 11:44:19.123033 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.122902 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-bundle\") pod \"994725c0-3b60-40c4-a358-134ce1ac38a4\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " Jun 11 11:44:19.123033 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.122965 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-util\") pod \"994725c0-3b60-40c4-a358-134ce1ac38a4\" (UID: \"994725c0-3b60-40c4-a358-134ce1ac38a4\") " Jun 11 11:44:19.123350 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.123314 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-bundle" (OuterVolumeSpecName: "bundle") pod "994725c0-3b60-40c4-a358-134ce1ac38a4" (UID: "994725c0-3b60-40c4-a358-134ce1ac38a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:44:19.125158 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.125125 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994725c0-3b60-40c4-a358-134ce1ac38a4-kube-api-access-jf449" (OuterVolumeSpecName: "kube-api-access-jf449") pod "994725c0-3b60-40c4-a358-134ce1ac38a4" (UID: "994725c0-3b60-40c4-a358-134ce1ac38a4"). InnerVolumeSpecName "kube-api-access-jf449". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:44:19.128637 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.128612 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-util" (OuterVolumeSpecName: "util") pod "994725c0-3b60-40c4-a358-134ce1ac38a4" (UID: "994725c0-3b60-40c4-a358-134ce1ac38a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 11:44:19.224212 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.224175 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-bundle\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:44:19.224212 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.224206 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/994725c0-3b60-40c4-a358-134ce1ac38a4-util\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:44:19.224212 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.224215 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf449\" (UniqueName: \"kubernetes.io/projected/994725c0-3b60-40c4-a358-134ce1ac38a4-kube-api-access-jf449\") on node \"ip-10-0-129-217.ec2.internal\" DevicePath \"\"" Jun 11 11:44:19.892836 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.892797 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" Jun 11 11:44:19.892836 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.892816 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748mlp9x" event={"ID":"994725c0-3b60-40c4-a358-134ce1ac38a4","Type":"ContainerDied","Data":"52abe19f2b1aa87e975314e58ef044c672f03963b3bf4a61a3335d2dc7369a94"} Jun 11 11:44:19.893070 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:19.892889 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52abe19f2b1aa87e975314e58ef044c672f03963b3bf4a61a3335d2dc7369a94" Jun 11 11:44:22.499739 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.499704 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9nb28"] Jun 11 11:44:22.500156 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.500124 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerName="extract" Jun 11 11:44:22.500156 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.500136 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerName="extract" Jun 11 11:44:22.500239 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.500158 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerName="util" Jun 11 11:44:22.500239 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.500164 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerName="util" Jun 11 11:44:22.500239 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.500179 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerName="pull" Jun 11 11:44:22.500239 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.500186 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerName="pull" Jun 11 11:44:22.500363 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.500254 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="994725c0-3b60-40c4-a358-134ce1ac38a4" containerName="extract" Jun 11 11:44:22.503433 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.503411 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-9nb28" Jun 11 11:44:22.506197 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.506175 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 11:44:22.507119 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.507101 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 11:44:22.507256 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.507136 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-j9d95\"" Jun 11 11:44:22.518939 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.518909 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9nb28"] Jun 11 11:44:22.654783 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.654742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9xvv\" (UniqueName: \"kubernetes.io/projected/29c9308a-1f32-4dc3-b513-ec035ebd3ded-kube-api-access-q9xvv\") pod \"keycloak-operator-d67dbbb48-9nb28\" (UID: \"29c9308a-1f32-4dc3-b513-ec035ebd3ded\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9nb28" Jun 11 11:44:22.756004 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.755913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9xvv\" (UniqueName: \"kubernetes.io/projected/29c9308a-1f32-4dc3-b513-ec035ebd3ded-kube-api-access-q9xvv\") pod \"keycloak-operator-d67dbbb48-9nb28\" (UID: \"29c9308a-1f32-4dc3-b513-ec035ebd3ded\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9nb28" Jun 11 11:44:22.767815 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.767791 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9xvv\" (UniqueName: \"kubernetes.io/projected/29c9308a-1f32-4dc3-b513-ec035ebd3ded-kube-api-access-q9xvv\") pod \"keycloak-operator-d67dbbb48-9nb28\" (UID: \"29c9308a-1f32-4dc3-b513-ec035ebd3ded\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9nb28" Jun 11 11:44:22.814246 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.814213 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-9nb28" Jun 11 11:44:22.957175 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:22.957140 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9nb28"] Jun 11 11:44:22.958994 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:44:22.958967 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c9308a_1f32_4dc3_b513_ec035ebd3ded.slice/crio-c21cf7a18cacff102d9aa06d032801eaa20137372ee0ec4180ff2d908a777877 WatchSource:0}: Error finding container c21cf7a18cacff102d9aa06d032801eaa20137372ee0ec4180ff2d908a777877: Status 404 returned error can't find the container with id c21cf7a18cacff102d9aa06d032801eaa20137372ee0ec4180ff2d908a777877 Jun 11 11:44:23.929290 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:23.929244 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-9nb28" event={"ID":"29c9308a-1f32-4dc3-b513-ec035ebd3ded","Type":"ContainerStarted","Data":"c21cf7a18cacff102d9aa06d032801eaa20137372ee0ec4180ff2d908a777877"} Jun 11 11:44:24.756384 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:24.756344 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:44:29.971549 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:29.971496 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-9nb28" event={"ID":"29c9308a-1f32-4dc3-b513-ec035ebd3ded","Type":"ContainerStarted","Data":"f715c16888d68e35708d5148eb98e68c3ebeb5c6cef98f99447f8f81c3dc9d9d"} Jun 11 11:44:29.990774 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:29.990720 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-9nb28" podStartSLOduration=1.6236601080000002 podStartE2EDuration="7.990705781s" totalImagesPullingTime="6.367045673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:44:29.989030716 +0000 UTC m=+710.693038589" watchObservedRunningTime="2026-06-11 11:44:29.990705781 +0000 UTC m=+710.694713579" Jun 11 11:44:38.516672 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:38.516632 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:44:38.617208 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:44:38.617177 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:08.006232 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:08.006201 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:08.105821 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:08.105791 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:13.338793 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:13.338760 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:13.437775 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:13.437740 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:13.506429 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:13.506397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:14.052274 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:14.052238 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:17.351612 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:17.351562 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:17.455291 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:17.455253 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:48.408147 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:48.408107 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:48.532548 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:48.532509 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:48.936090 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:48.936057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:45:49.038426 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:45:49.038382 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:46:28.399292 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:46:28.399250 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:46:28.499031 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:46:28.498994 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:48:38.065750 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:48:38.065710 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:48:51.318305 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:48:51.318262 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:48:51.416562 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:48:51.416522 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:49:02.169820 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:02.169711 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:49:05.777508 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.777476 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l"] Jun 11 11:49:05.781109 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.781091 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.784429 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.784403 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2v4q9\"" Jun 11 11:49:05.785576 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.785558 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 11:49:05.785674 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.785617 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 11:49:05.785674 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.785619 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 11:49:05.797473 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.797439 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l"] Jun 11 11:49:05.828285 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.828235 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:49:05.838085 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.838053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.838233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.838145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.838233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.838175 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.838233 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.838220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf18781-6a04-4e8e-92eb-b28fae75e264-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.838377 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.838310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdprc\" (UniqueName: \"kubernetes.io/projected/eaf18781-6a04-4e8e-92eb-b28fae75e264-kube-api-access-cdprc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.838417 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.838384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.938882 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.938820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.939086 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.938901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.939086 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.938946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf18781-6a04-4e8e-92eb-b28fae75e264-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.939086 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.938984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdprc\" (UniqueName: \"kubernetes.io/projected/eaf18781-6a04-4e8e-92eb-b28fae75e264-kube-api-access-cdprc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.939086 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.939014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.939086 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.939055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.939393 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.939368 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.939464 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.939390 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.939464 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.939452 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.941229 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.941207 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf18781-6a04-4e8e-92eb-b28fae75e264-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.941574 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.941556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf18781-6a04-4e8e-92eb-b28fae75e264-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:05.947141 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:05.947122 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdprc\" (UniqueName: \"kubernetes.io/projected/eaf18781-6a04-4e8e-92eb-b28fae75e264-kube-api-access-cdprc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-htg8l\" (UID: \"eaf18781-6a04-4e8e-92eb-b28fae75e264\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:06.092050 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:06.091948 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" Jun 11 11:49:06.238424 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:06.238394 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l"] Jun 11 11:49:06.239997 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:49:06.239954 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf18781_6a04_4e8e_92eb_b28fae75e264.slice/crio-7d1e201e5cefdb59113329198634bd79b52bdc5c4e089541730fbf8e116ef5f2 WatchSource:0}: Error finding container 7d1e201e5cefdb59113329198634bd79b52bdc5c4e089541730fbf8e116ef5f2: Status 404 returned error can't find the container with id 7d1e201e5cefdb59113329198634bd79b52bdc5c4e089541730fbf8e116ef5f2 Jun 11 11:49:06.241960 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:06.241939 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 11:49:06.601129 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:06.601042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" event={"ID":"eaf18781-6a04-4e8e-92eb-b28fae75e264","Type":"ContainerStarted","Data":"7d1e201e5cefdb59113329198634bd79b52bdc5c4e089541730fbf8e116ef5f2"} Jun 11 11:49:09.622155 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:09.622114 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-htg8l" event={"ID":"eaf18781-6a04-4e8e-92eb-b28fae75e264","Type":"ContainerStarted","Data":"876091297db2365642729acb56648f87526ec3619dcf802d41af2630aa54bd7a"} Jun 11 11:49:10.592255 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:10.592219 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:49:15.546961 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:15.546917 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:49:24.977457 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:24.977421 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:49:25.077508 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:25.077476 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:49:48.764701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:49:48.764665 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:50:04.816398 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.816333 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx"] Jun 11 11:50:04.820481 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.820456 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.823236 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.823213 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 11:50:04.834098 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.834072 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx"] Jun 11 11:50:04.842028 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.842002 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.842140 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.842048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6243668-53a8-463c-90b1-c2de1332f8b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.842140 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.842079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttptd\" (UniqueName: \"kubernetes.io/projected/d6243668-53a8-463c-90b1-c2de1332f8b9-kube-api-access-ttptd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.842140 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.842102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.842273 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.842205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.842273 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.842246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.863816 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.863786 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:50:04.943645 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.943610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.943645 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.943645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.943937 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.943781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.943937 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.943830 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6243668-53a8-463c-90b1-c2de1332f8b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.943937 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.943898 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttptd\" (UniqueName: \"kubernetes.io/projected/d6243668-53a8-463c-90b1-c2de1332f8b9-kube-api-access-ttptd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.944099 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.944076 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.944099 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.944092 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.944209 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.944137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.944209 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.944172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.946321 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.946302 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6243668-53a8-463c-90b1-c2de1332f8b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.946483 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.946466 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6243668-53a8-463c-90b1-c2de1332f8b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:04.952667 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:04.952646 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttptd\" (UniqueName: \"kubernetes.io/projected/d6243668-53a8-463c-90b1-c2de1332f8b9-kube-api-access-ttptd\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx\" (UID: \"d6243668-53a8-463c-90b1-c2de1332f8b9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:05.131703 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:05.131615 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" Jun 11 11:50:05.280056 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:05.280027 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx"] Jun 11 11:50:05.282614 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:50:05.282584 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6243668_53a8_463c_90b1_c2de1332f8b9.slice/crio-b0845f5b6e62269b4b137927bf16b8b2a71a1560671c535fd2107276dd54d126 WatchSource:0}: Error finding container b0845f5b6e62269b4b137927bf16b8b2a71a1560671c535fd2107276dd54d126: Status 404 returned error can't find the container with id b0845f5b6e62269b4b137927bf16b8b2a71a1560671c535fd2107276dd54d126 Jun 11 11:50:05.959889 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:05.959828 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" event={"ID":"d6243668-53a8-463c-90b1-c2de1332f8b9","Type":"ContainerStarted","Data":"0895d5ee09a57fc318322497450f6efd92acc5cec2d2a04699ac795fd09ae721"} Jun 11 11:50:05.960314 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:05.959900 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx" event={"ID":"d6243668-53a8-463c-90b1-c2de1332f8b9","Type":"ContainerStarted","Data":"b0845f5b6e62269b4b137927bf16b8b2a71a1560671c535fd2107276dd54d126"} Jun 11 11:50:09.745455 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:09.745413 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:50:39.650954 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:50:39.650912 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:51:29.238447 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:51:29.238413 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:53:55.190830 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:53:55.190799 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-d8jpx_d6243668-53a8-463c-90b1-c2de1332f8b9/storage-initializer/0.log" Jun 11 11:54:00.953516 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:00.953482 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-87d68b7dc-5c9sg_e0a146bc-aff9-4915-bfdc-54ea4996a0ad/nginx/0.log" Jun 11 11:54:01.206134 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:01.206056 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-v5dl2_170bf76b-301b-4d44-a027-82191a9704cf/manager/0.log" Jun 11 11:54:01.325682 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:01.325650 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-hlkcf_dbe0682c-b600-4f83-8fe7-c949ecad03c8/manager/0.log" Jun 11 11:54:01.716488 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:01.716462 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-wszmz_cab49a19-438c-4013-9ad4-203fbba67393/server/0.log" Jun 11 11:54:01.838108 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:01.838073 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-96l44_7e05d947-873c-4e13-a6d0-e1556d2655e1/manager/0.log" Jun 11 11:54:01.960388 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:01.960359 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b86f57c5-bj8mh_e93fa1e0-ce7f-4fee-8cb9-e14be3944056/copy-manifests/0.log" Jun 11 11:54:01.968046 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:01.967974 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b86f57c5-bj8mh_e93fa1e0-ce7f-4fee-8cb9-e14be3944056/manager/0.log" Jun 11 11:54:02.337818 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:02.337733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vrjm7_73a82137-3fac-497d-9fcf-b8a779f28f62/postgres/0.log" Jun 11 11:54:03.109117 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.109089 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z_2bbaf424-139b-4a4d-969a-eb377d0382f7/util/0.log" Jun 11 11:54:03.116405 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.116362 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z_2bbaf424-139b-4a4d-969a-eb377d0382f7/pull/0.log" Jun 11 11:54:03.123226 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.123203 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z_2bbaf424-139b-4a4d-969a-eb377d0382f7/extract/0.log" Jun 11 11:54:03.240042 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.240008 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf_61dd8884-4159-47f0-a38c-2c7856194d13/util/0.log" Jun 11 11:54:03.246678 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.246642 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf_61dd8884-4159-47f0-a38c-2c7856194d13/pull/0.log" Jun 11 11:54:03.253292 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.253268 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf_61dd8884-4159-47f0-a38c-2c7856194d13/extract/0.log" Jun 11 11:54:03.371058 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.370976 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t_aec41a50-3542-4da1-8967-b42e2b846d0c/util/0.log" Jun 11 11:54:03.378829 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.378803 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t_aec41a50-3542-4da1-8967-b42e2b846d0c/pull/0.log" Jun 11 11:54:03.386564 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.386547 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t_aec41a50-3542-4da1-8967-b42e2b846d0c/extract/0.log" Jun 11 11:54:03.509688 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.509659 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v_bba0c180-92eb-484e-9433-6909e4dcd8da/util/0.log" Jun 11 11:54:03.516249 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.516231 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v_bba0c180-92eb-484e-9433-6909e4dcd8da/pull/0.log" Jun 11 11:54:03.522769 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.522750 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v_bba0c180-92eb-484e-9433-6909e4dcd8da/extract/0.log" Jun 11 11:54:03.872317 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:03.872288 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cfdf6_7146266b-53c4-432a-8d17-c52c866a7225/manager/0.log" Jun 11 11:54:04.489885 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:04.489846 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n9wkb_2d3a09d7-daf5-4d9a-89b6-e34166c78240/manager/0.log" Jun 11 11:54:05.007082 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:05.007046 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-s5rh9_9a353873-9d62-4f15-91c2-e94a8330d969/discovery/0.log" Jun 11 11:54:05.226262 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:05.226226 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bc6b598d-w2jf6_c9255614-3d88-4dfc-a8ec-ef3ecf1be41a/kube-auth-proxy/0.log" Jun 11 11:54:06.182559 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:06.182519 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-htg8l_eaf18781-6a04-4e8e-92eb-b28fae75e264/storage-initializer/0.log" Jun 11 11:54:10.702788 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:10.702748 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:54:11.857214 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:11.857181 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" limit=1024 Jun 11 11:54:13.552378 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:13.552347 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fxm9p_a97b11c1-5f78-445c-abb6-f256b3df4283/global-pull-secret-syncer/0.log" Jun 11 11:54:13.684573 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:13.684541 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-898tl_1c99f213-6cd1-4c2f-966d-f15153a79e7d/konnectivity-agent/0.log" Jun 11 11:54:13.766601 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:13.766573 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-217.ec2.internal_45fd46cdb00075c41be9450fd694dc7c/haproxy/0.log" Jun 11 11:54:17.947704 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:17.947672 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-bdln5_300fb9fe-d511-4913-9552-dc2b97ffa638/sail-operator/0.log" Jun 11 11:54:18.324087 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.324007 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z_2bbaf424-139b-4a4d-969a-eb377d0382f7/extract/0.log" Jun 11 11:54:18.353803 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.353771 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z_2bbaf424-139b-4a4d-969a-eb377d0382f7/util/0.log" Jun 11 11:54:18.381175 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.381145 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75957v7z_2bbaf424-139b-4a4d-969a-eb377d0382f7/pull/0.log" Jun 11 11:54:18.419516 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.419490 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf_61dd8884-4159-47f0-a38c-2c7856194d13/extract/0.log" Jun 11 11:54:18.446095 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.446062 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf_61dd8884-4159-47f0-a38c-2c7856194d13/util/0.log" Jun 11 11:54:18.473244 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.473215 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x8wlf_61dd8884-4159-47f0-a38c-2c7856194d13/pull/0.log" Jun 11 11:54:18.523290 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.523262 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t_aec41a50-3542-4da1-8967-b42e2b846d0c/extract/0.log" Jun 11 11:54:18.551780 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.551753 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t_aec41a50-3542-4da1-8967-b42e2b846d0c/util/0.log" Jun 11 11:54:18.590416 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.590339 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736kc7t_aec41a50-3542-4da1-8967-b42e2b846d0c/pull/0.log" Jun 11 11:54:18.625310 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.625264 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v_bba0c180-92eb-484e-9433-6909e4dcd8da/extract/0.log" Jun 11 11:54:18.652032 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.652004 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v_bba0c180-92eb-484e-9433-6909e4dcd8da/util/0.log" Jun 11 11:54:18.680128 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.680097 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g4j7v_bba0c180-92eb-484e-9433-6909e4dcd8da/pull/0.log" Jun 11 11:54:18.785563 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.785533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cfdf6_7146266b-53c4-432a-8d17-c52c866a7225/manager/0.log" Jun 11 11:54:18.971668 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:18.971635 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n9wkb_2d3a09d7-daf5-4d9a-89b6-e34166c78240/manager/0.log" Jun 11 11:54:20.930217 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:20.930186 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-5w467_8e5443ca-7265-4da1-9a68-1dfde8ac8d64/cluster-monitoring-operator/0.log" Jun 11 11:54:21.116226 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:21.116198 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-wjrps_f8db2e64-00fd-43b5-9c80-6fd0fbf110c7/monitoring-plugin/0.log" Jun 11 11:54:21.162365 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:21.162337 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kzfv_5b399f3d-5fa4-4814-8b97-9867ba27a5e7/node-exporter/0.log" Jun 11 11:54:21.208669 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:21.208568 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kzfv_5b399f3d-5fa4-4814-8b97-9867ba27a5e7/kube-rbac-proxy/0.log" Jun 11 11:54:21.250166 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:21.250140 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kzfv_5b399f3d-5fa4-4814-8b97-9867ba27a5e7/init-textfile/0.log" Jun 11 11:54:21.958920 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:21.958890 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-cpckr_cf585238-6055-4edf-9d7d-a91a88694962/prometheus-operator/0.log" Jun 11 11:54:21.992707 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:21.992683 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-cpckr_cf585238-6055-4edf-9d7d-a91a88694962/kube-rbac-proxy/0.log" Jun 11 11:54:22.028728 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:22.028699 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-qlcph_1d13de5a-0e53-44af-a953-e9c4a138d261/prometheus-operator-admission-webhook/0.log" Jun 11 11:54:22.164537 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:22.164512 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d89764ddf-jw2sz_fd5f149b-480b-4126-983f-50b9a5660bcc/thanos-query/0.log" Jun 11 11:54:22.199060 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:22.199036 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d89764ddf-jw2sz_fd5f149b-480b-4126-983f-50b9a5660bcc/kube-rbac-proxy-web/0.log" Jun 11 11:54:22.227726 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:22.227646 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d89764ddf-jw2sz_fd5f149b-480b-4126-983f-50b9a5660bcc/kube-rbac-proxy/0.log" Jun 11 11:54:22.265379 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:22.265353 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d89764ddf-jw2sz_fd5f149b-480b-4126-983f-50b9a5660bcc/prom-label-proxy/0.log" Jun 11 11:54:22.308027 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:22.308000 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d89764ddf-jw2sz_fd5f149b-480b-4126-983f-50b9a5660bcc/kube-rbac-proxy-rules/0.log" Jun 11 11:54:22.357632 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:22.357598 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d89764ddf-jw2sz_fd5f149b-480b-4126-983f-50b9a5660bcc/kube-rbac-proxy-metrics/0.log" Jun 11 11:54:23.695276 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.695245 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-2gbcc_b824e753-c7d4-4355-8f4e-ea34bcb92f01/networking-console-plugin/0.log" Jun 11 11:54:23.785685 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.785648 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb"] Jun 11 11:54:23.788285 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.788267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.792735 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.792714 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tz7zj\"/\"openshift-service-ca.crt\"" Jun 11 11:54:23.793956 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.793924 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tz7zj\"/\"kube-root-ca.crt\"" Jun 11 11:54:23.794102 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.793980 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tz7zj\"/\"default-dockercfg-g9d68\"" Jun 11 11:54:23.802363 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.802341 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb"] Jun 11 11:54:23.866595 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.866562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-proc\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.866778 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.866614 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-podres\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.866778 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.866657 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-lib-modules\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.866778 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.866678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7wz6\" (UniqueName: \"kubernetes.io/projected/835e2355-0a3e-4f81-abe6-e9d612aadba6-kube-api-access-c7wz6\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.866778 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.866699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-sys\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967375 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-proc\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967375 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967346 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-podres\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-lib-modules\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967403 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7wz6\" (UniqueName: \"kubernetes.io/projected/835e2355-0a3e-4f81-abe6-e9d612aadba6-kube-api-access-c7wz6\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967410 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-proc\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-sys\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967512 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-podres\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967541 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-sys\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.967580 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.967544 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835e2355-0a3e-4f81-abe6-e9d612aadba6-lib-modules\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:23.978598 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:23.978569 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7wz6\" (UniqueName: \"kubernetes.io/projected/835e2355-0a3e-4f81-abe6-e9d612aadba6-kube-api-access-c7wz6\") pod \"perf-node-gather-daemonset-4g7hb\" (UID: \"835e2355-0a3e-4f81-abe6-e9d612aadba6\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:24.098174 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:24.098147 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:24.242073 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:24.242041 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb"] Jun 11 11:54:24.243904 ip-10-0-129-217 kubenswrapper[2560]: W0611 11:54:24.243853 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod835e2355_0a3e_4f81_abe6_e9d612aadba6.slice/crio-51029a1c313ea541b78e20a7303fd0f7697b0b29e60cbec80508f5f8c7273304 WatchSource:0}: Error finding container 51029a1c313ea541b78e20a7303fd0f7697b0b29e60cbec80508f5f8c7273304: Status 404 returned error can't find the container with id 51029a1c313ea541b78e20a7303fd0f7697b0b29e60cbec80508f5f8c7273304 Jun 11 11:54:24.520395 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:24.520300 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" event={"ID":"835e2355-0a3e-4f81-abe6-e9d612aadba6","Type":"ContainerStarted","Data":"12875986ffac1aac55a7621db074489f25ab79dd4a2a93045b2859b9a2c6b948"} Jun 11 11:54:24.520395 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:24.520361 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" event={"ID":"835e2355-0a3e-4f81-abe6-e9d612aadba6","Type":"ContainerStarted","Data":"51029a1c313ea541b78e20a7303fd0f7697b0b29e60cbec80508f5f8c7273304"} Jun 11 11:54:24.520591 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:24.520535 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:25.804172 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:25.804145 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-dzwz2_a7683dec-c29b-48cd-b04e-71c92642b429/volume-data-source-validator/0.log" Jun 11 11:54:27.037515 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:27.037483 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdfcd_d3bcc4fc-3cc9-4baa-865e-6ea851f98f89/dns/0.log" Jun 11 11:54:27.060340 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:27.060316 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdfcd_d3bcc4fc-3cc9-4baa-865e-6ea851f98f89/kube-rbac-proxy/0.log" Jun 11 11:54:27.135021 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:27.134989 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qvm9q_be25bbe1-df37-40cc-8eb0-e7d7114f24b8/dns-node-resolver/0.log" Jun 11 11:54:27.927532 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:27.927502 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s6gz4_31891d8d-f705-46ba-97a0-8434dd96a1a0/node-ca/0.log" Jun 11 11:54:28.953306 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:28.953268 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-s5rh9_9a353873-9d62-4f15-91c2-e94a8330d969/discovery/0.log" Jun 11 11:54:28.999922 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:28.999893 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bc6b598d-w2jf6_c9255614-3d88-4dfc-a8ec-ef3ecf1be41a/kube-auth-proxy/0.log" Jun 11 11:54:29.771101 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:29.771072 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fqm4h_85986698-ac25-4de0-b5cc-fdee5ab9e607/serve-healthcheck-canary/0.log" Jun 11 11:54:30.513761 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:30.513733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rq7qz_94b11cda-e619-41b3-930d-091ef0ac5308/kube-rbac-proxy/0.log" Jun 11 11:54:30.537780 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:30.537749 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rq7qz_94b11cda-e619-41b3-930d-091ef0ac5308/exporter/0.log" Jun 11 11:54:30.538109 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:30.538091 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" Jun 11 11:54:30.556551 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:30.556487 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-4g7hb" podStartSLOduration=7.556467753 podStartE2EDuration="7.556467753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:54:24.543210717 +0000 UTC m=+1305.247218424" watchObservedRunningTime="2026-06-11 11:54:30.556467753 +0000 UTC m=+1311.260475463" Jun 11 11:54:30.565826 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:30.565802 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rq7qz_94b11cda-e619-41b3-930d-091ef0ac5308/extractor/0.log" Jun 11 11:54:33.154520 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:33.154476 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-87d68b7dc-5c9sg_e0a146bc-aff9-4915-bfdc-54ea4996a0ad/nginx/0.log" Jun 11 11:54:33.210091 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:33.210058 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-v5dl2_170bf76b-301b-4d44-a027-82191a9704cf/manager/0.log" Jun 11 11:54:33.253687 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:33.253655 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-hlkcf_dbe0682c-b600-4f83-8fe7-c949ecad03c8/manager/0.log" Jun 11 11:54:33.337701 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:33.337672 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-wszmz_cab49a19-438c-4013-9ad4-203fbba67393/server/0.log" Jun 11 11:54:33.387005 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:33.386971 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-96l44_7e05d947-873c-4e13-a6d0-e1556d2655e1/manager/0.log" Jun 11 11:54:33.415740 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:33.415632 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b86f57c5-bj8mh_e93fa1e0-ce7f-4fee-8cb9-e14be3944056/manager/0.log" Jun 11 11:54:33.441843 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:33.441816 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b86f57c5-bj8mh_e93fa1e0-ce7f-4fee-8cb9-e14be3944056/copy-manifests/0.log" Jun 11 11:54:33.622381 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:33.622351 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vrjm7_73a82137-3fac-497d-9fcf-b8a779f28f62/postgres/0.log" Jun 11 11:54:35.234471 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:35.234447 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rtl55_c5f1e5f7-c912-43d6-809a-9687a982d079/openshift-lws-operator/0.log" Jun 11 11:54:39.074883 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:39.074830 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-s5rh9_9a353873-9d62-4f15-91c2-e94a8330d969/discovery/0.log" Jun 11 11:54:39.100179 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:39.100148 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bc6b598d-w2jf6_c9255614-3d88-4dfc-a8ec-ef3ecf1be41a/kube-auth-proxy/0.log" Jun 11 11:54:40.273696 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:40.273657 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-s5rh9_9a353873-9d62-4f15-91c2-e94a8330d969/discovery/0.log" Jun 11 11:54:40.300929 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:40.300895 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bc6b598d-w2jf6_c9255614-3d88-4dfc-a8ec-ef3ecf1be41a/kube-auth-proxy/0.log" Jun 11 11:54:40.772296 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:40.772263 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-b49gt_0d47ea3e-0c86-4e15-a637-36f1077f2171/migrator/0.log" Jun 11 11:54:40.794585 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:40.794558 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-b49gt_0d47ea3e-0c86-4e15-a637-36f1077f2171/graceful-termination/0.log" Jun 11 11:54:41.260926 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:41.260890 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kfjlq_3d463a97-4a7d-4130-9ab7-dd3bde06cd39/kube-storage-version-migrator-operator/1.log" Jun 11 11:54:41.261608 ip-10-0-129-217 kubenswrapper[2560]: I0611 11:54:41.261591 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kfjlq_3d463a97-4a7d-4130-9ab7-dd3bde06cd39/kube-storage-version-migrator-operator/0.log"