Jun 12 18:39:52.868492 ip-10-0-132-81 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 18:39:52.868508 ip-10-0-132-81 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 18:39:52.868518 ip-10-0-132-81 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 18:39:52.868835 ip-10-0-132-81 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 18:40:02.906366 ip-10-0-132-81 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 18:40:02.906382 ip-10-0-132-81 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c88012878cd54a059b24f96cf1567dd4 -- Jun 12 18:42:27.936822 ip-10-0-132-81 systemd[1]: Starting Kubernetes Kubelet... Jun 12 18:42:28.288341 ip-10-0-132-81 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:42:28.288341 ip-10-0-132-81 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 18:42:28.288341 ip-10-0-132-81 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:42:28.288341 ip-10-0-132-81 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 18:42:28.288341 ip-10-0-132-81 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:42:28.289438 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.288979 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 18:42:28.293145 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293129 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293145 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293151 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293155 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293159 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293162 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293165 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293168 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293176 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293179 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293182 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293185 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293187 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293190 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:28.293186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293193 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293196 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293199 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293202 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293206 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293210 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293212 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293215 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293218 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293220 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293223 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293225 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293228 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293230 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293233 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293236 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293238 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293240 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293243 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:28.293541 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293245 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293248 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293250 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293253 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293255 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293258 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293261 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293263 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293266 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293268 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293271 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293273 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293276 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293278 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293281 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293284 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293286 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293289 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293292 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293295 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:28.294035 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293297 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293300 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293302 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293305 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293307 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293310 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293312 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293315 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293317 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293319 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293322 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293324 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293326 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293329 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293331 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293334 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293336 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293339 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293342 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:28.294533 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293344 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293347 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293349 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293351 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293354 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293356 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293359 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293362 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293365 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293367 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293370 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293372 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293375 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293378 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293380 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293384 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293388 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293392 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293395 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293398 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:28.294995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293400 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293403 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293406 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293409 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293412 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293414 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.293417 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294152 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294159 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294161 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294165 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294168 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294171 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294174 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294176 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294179 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294181 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294184 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294186 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294189 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:28.295484 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294193 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294196 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294199 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294201 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294204 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294206 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294209 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294211 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294214 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294217 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294219 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294221 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294224 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294226 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294229 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294232 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294235 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294237 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294239 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294242 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:28.295985 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294244 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294247 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294249 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294252 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294254 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294259 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294263 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294266 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294269 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294272 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294274 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294277 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294280 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294283 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294286 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294290 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294293 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294297 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294300 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:28.296493 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294303 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294305 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294308 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294311 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294313 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294316 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294318 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294321 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294323 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294326 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294328 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294330 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294333 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294336 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294339 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294341 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294344 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294346 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294349 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294357 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:28.296973 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294360 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294363 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294365 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294368 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294371 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294373 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294375 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294378 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294380 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294383 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294385 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294388 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294390 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294392 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294395 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294398 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294401 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294403 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294406 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:28.297458 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294408 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294411 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294413 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294417 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294421 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294424 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294427 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294430 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294923 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294929 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294933 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294936 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294944 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294948 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294952 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294954 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294958 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294960 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:28.297954 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294964 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294967 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294970 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294973 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294976 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294978 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294981 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294983 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294986 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294988 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294991 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294993 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294996 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.294999 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295002 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295004 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295008 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295010 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295013 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295016 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:28.298398 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295019 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295021 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295024 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295026 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295029 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295031 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295034 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295042 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295044 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295047 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295049 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295052 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295055 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295059 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295062 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295064 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295067 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295069 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295073 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:28.298899 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295076 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295079 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295082 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295084 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295093 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295096 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295099 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295101 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295106 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295109 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295112 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295114 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295117 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295120 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295122 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295125 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295127 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295130 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295132 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295135 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:28.299407 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295137 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295145 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295148 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295150 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295153 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295155 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295157 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295160 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295163 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295165 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295168 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295170 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295173 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295175 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295178 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295180 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295183 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295185 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295188 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295190 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:28.299990 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295194 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295196 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295203 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295205 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295208 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295210 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295213 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295215 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295219 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295223 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295302 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295309 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295325 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295330 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295339 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295342 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295346 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295350 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295354 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295357 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295360 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295363 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 18:42:28.300507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295367 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295370 2559 flags.go:64] FLAG: --cgroup-root="" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295373 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295376 2559 flags.go:64] FLAG: --client-ca-file="" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295379 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295381 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295388 2559 flags.go:64] FLAG: --cluster-domain="" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295390 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295394 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295397 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295401 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295405 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295409 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295412 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295415 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295418 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295421 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295424 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295427 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295430 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295434 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295437 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295440 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295442 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295445 2559 flags.go:64] FLAG: --enable-server="true" Jun 12 18:42:28.301047 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295453 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295460 2559 flags.go:64] FLAG: --event-burst="100" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295463 2559 flags.go:64] FLAG: --event-qps="50" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295466 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295469 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295472 2559 flags.go:64] FLAG: --eviction-hard="" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295475 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295478 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295481 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295484 2559 flags.go:64] FLAG: --eviction-soft="" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295487 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295490 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295493 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295496 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295499 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295502 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295505 2559 flags.go:64] FLAG: --feature-gates="" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295525 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295528 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295532 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295535 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295538 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295541 2559 flags.go:64] FLAG: --help="false" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295543 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295546 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 18:42:28.301663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295549 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295552 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295555 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295559 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295562 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295564 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295567 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295570 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295579 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295583 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295585 2559 flags.go:64] FLAG: --kube-reserved="" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295588 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295591 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295593 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295596 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295599 2559 flags.go:64] FLAG: --lock-file="" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295602 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295605 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295607 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295613 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295615 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295618 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295621 2559 flags.go:64] FLAG: --logging-format="text" Jun 12 18:42:28.302313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295623 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295627 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295630 2559 flags.go:64] FLAG: --manifest-url="" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295633 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295637 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295640 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295644 2559 flags.go:64] FLAG: --max-pods="110" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295647 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295650 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295653 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295656 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295659 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295662 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295664 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295671 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295674 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295677 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295680 2559 flags.go:64] FLAG: --pod-cidr="" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295688 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295693 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295696 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295699 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295702 2559 flags.go:64] FLAG: --port="10250" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295705 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 18:42:28.302891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295708 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f371db80270c663" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295711 2559 flags.go:64] FLAG: --qos-reserved="" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295714 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295717 2559 flags.go:64] FLAG: --register-node="true" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295720 2559 flags.go:64] FLAG: --register-with-taints="" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295724 2559 flags.go:64] FLAG: --registry-burst="10" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295727 2559 flags.go:64] FLAG: --registry-qps="5" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295730 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295732 2559 flags.go:64] FLAG: --reserved-memory="" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295736 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295739 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295742 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295745 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295748 2559 flags.go:64] FLAG: --runonce="false" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295750 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295753 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295756 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295759 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295762 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295765 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295768 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295771 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295773 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295776 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295779 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295781 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 18:42:28.303492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295784 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295792 2559 flags.go:64] FLAG: --system-cgroups="" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295795 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295800 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295803 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295806 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295812 2559 flags.go:64] FLAG: --tls-min-version="" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295814 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295817 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295820 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295822 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295825 2559 flags.go:64] FLAG: --v="2" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295829 2559 flags.go:64] FLAG: --version="false" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295833 2559 flags.go:64] FLAG: --vmodule="" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295836 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.295839 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295981 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295985 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295989 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295992 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295994 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.295997 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296000 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:28.304180 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296002 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296005 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296008 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296011 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296013 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296016 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296019 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296022 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296024 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296027 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296029 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296037 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296039 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296042 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296044 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296047 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296049 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296052 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296054 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:28.304803 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296057 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296059 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296062 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296064 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296067 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296071 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296074 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296078 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296080 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296083 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296085 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296088 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296090 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296093 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296096 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296099 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296101 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296103 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296106 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296109 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:28.305266 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296111 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296113 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296116 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296118 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296121 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296129 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296133 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296136 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296139 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296141 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296144 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296147 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296149 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296151 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296154 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296156 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296159 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296164 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296167 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:28.305780 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296173 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296176 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296179 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296181 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296184 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296186 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296189 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296192 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296195 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296197 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296200 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296202 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296205 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296207 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296210 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296212 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296215 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296217 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296220 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:28.306252 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296230 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296233 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296236 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296239 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296242 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296245 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296259 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296262 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296265 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296268 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296270 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296274 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296277 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296282 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.296285 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:28.306740 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.296823 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.304114 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.304128 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.304141 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.304151 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304213 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304219 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304222 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304225 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304228 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304230 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304233 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304236 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304239 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304241 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304244 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304247 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304251 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304255 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:28.307106 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304259 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304261 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304264 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304267 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304270 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304272 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304275 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304277 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304280 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304282 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304285 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304288 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304290 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304293 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304295 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304299 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304302 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304304 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304307 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304310 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304313 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:28.307592 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304316 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304319 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304321 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304324 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304327 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304329 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304332 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304334 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304337 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304339 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304343 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304346 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304348 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304351 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304355 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304359 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304362 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304364 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304367 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304370 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:28.308096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304373 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304375 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304378 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304380 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304383 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304386 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304389 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304392 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304394 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304397 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304399 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304402 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304404 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304407 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304410 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304412 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304415 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304417 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304420 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:28.308674 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304422 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304425 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304428 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304430 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304433 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304436 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304438 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304441 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304444 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304446 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304449 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304452 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304455 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304458 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304461 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304464 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304466 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304469 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304472 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:28.309148 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304475 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304478 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304482 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304484 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304486 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304489 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.304494 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304629 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304634 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304637 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304640 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304643 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304646 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304649 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304651 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:28.309621 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304654 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304657 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304659 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304662 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304665 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304667 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304670 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304672 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304675 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304677 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304680 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304682 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304685 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304687 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304690 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304693 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304695 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304698 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304701 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304703 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:28.309995 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304706 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304709 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304711 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304714 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304718 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304721 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304724 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304727 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304729 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304732 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304734 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304737 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304739 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304742 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304744 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304747 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304750 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304752 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304755 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:28.310474 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304758 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304760 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304763 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304765 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304767 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304770 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304773 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304776 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304778 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304781 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304783 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304786 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304788 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304792 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304795 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304797 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304800 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304802 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304805 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:28.310952 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304809 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304812 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304815 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304818 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304821 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304824 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304826 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304830 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304832 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304835 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304837 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304840 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304843 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304846 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304848 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304851 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304854 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304857 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304859 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304862 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:28.311420 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304864 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304866 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304869 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304872 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304874 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304877 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304879 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304882 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304884 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304887 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304890 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304892 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:28.304894 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.304899 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:42:28.311918 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.305004 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 18:42:28.312268 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.307689 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 18:42:28.312268 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.310352 2559 server.go:1019] "Starting client certificate rotation" Jun 12 18:42:28.312268 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.310452 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:42:28.312268 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.310488 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:42:28.312671 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.312658 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:42:28.318283 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.318256 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:42:28.329533 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.329503 2559 log.go:25] "Validated CRI v1 runtime API" Jun 12 18:42:28.333186 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.333164 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:42:28.333318 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.333200 2559 log.go:25] "Validated CRI v1 image API" Jun 12 18:42:28.334252 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.334230 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 18:42:28.336506 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.336487 2559 fs.go:135] Filesystem UUIDs: map[35de3c48-7c38-402a-a8f8-d1c9d17322d0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b4e2cb8d-2ced-4cb1-9ca6-30c8c550a75b:/dev/nvme0n1p4] Jun 12 18:42:28.336588 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.336506 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 18:42:28.341535 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.341411 2559 manager.go:216] Machine: {Timestamp:2026-06-12 18:42:28.340192065 +0000 UTC m=+0.296276155 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100422 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26805d6ba4949472bd289dcfcbd923 SystemUUID:ec26805d-6ba4-9494-72bd-289dcfcbd923 BootID:c8801287-8cd5-4a05-9b24-f96cf1567dd4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:47:af:56:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:47:af:56:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:d1:92:c1:10:f5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 18:42:28.341535 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.341533 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 18:42:28.341649 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.341619 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 18:42:28.344143 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.344120 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 18:42:28.344282 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.344146 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-81.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 18:42:28.344787 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.344777 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 18:42:28.344825 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.344790 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 18:42:28.344825 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.344802 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:42:28.345490 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.345474 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:42:28.346615 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.346605 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 18:42:28.349324 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349313 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:42:28.349438 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349430 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 18:42:28.349494 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349460 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 12 18:42:28.349494 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349482 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 18:42:28.349593 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349501 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 18:42:28.349593 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349523 2559 kubelet.go:398] "Adding apiserver pod source" Jun 12 18:42:28.349593 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349532 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 18:42:28.349914 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349900 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:42:28.349956 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.349921 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:42:28.352329 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.352312 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 18:42:28.353852 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.353839 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 18:42:28.353901 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.353870 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 18:42:28.354073 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354063 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 18:42:28.354102 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354079 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 18:42:28.354102 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354086 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 18:42:28.354102 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354091 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 18:42:28.354102 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354100 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 18:42:28.354206 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354107 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 18:42:28.354479 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354470 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 18:42:28.354530 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354479 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 18:42:28.354530 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354486 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 18:42:28.354530 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354492 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 18:42:28.354530 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354501 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 18:42:28.354530 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354521 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 18:42:28.354856 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.354838 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qcpf2" Jun 12 18:42:28.355175 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.355165 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 18:42:28.355206 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.355177 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 18:42:28.358329 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.358313 2559 server.go:1268] "Started kubelet" Jun 12 18:42:28.358475 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.358416 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 18:42:28.358550 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.358507 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 18:42:28.358638 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.358618 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 18:42:28.359337 ip-10-0-132-81 systemd[1]: Started Kubernetes Kubelet. Jun 12 18:42:28.362151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.362119 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 18:42:28.363384 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.363352 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qcpf2" Jun 12 18:42:28.363784 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.363765 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 12 18:42:28.365881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.365851 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-81.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 18:42:28.366239 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.366213 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 18:42:28.366239 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.366229 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-81.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 18:42:28.366643 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.366621 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 18:42:28.366726 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.365914 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-81.ec2.internal.18b86996a4f0c810 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-81.ec2.internal,UID:ip-10-0-132-81.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-81.ec2.internal,},FirstTimestamp:2026-06-12 18:42:28.358285328 +0000 UTC m=+0.314369397,LastTimestamp:2026-06-12 18:42:28.358285328 +0000 UTC m=+0.314369397,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-81.ec2.internal,}" Jun 12 18:42:28.368967 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.368949 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 18:42:28.368967 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.368968 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 18:42:28.369105 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.369089 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:28.369705 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369685 2559 factory.go:55] Registering systemd factory Jun 12 18:42:28.369705 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369708 2559 factory.go:223] Registration of the systemd container factory successfully Jun 12 18:42:28.369917 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369892 2559 factory.go:153] Registering CRI-O factory Jun 12 18:42:28.369917 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369908 2559 factory.go:223] Registration of the crio container factory successfully Jun 12 18:42:28.370017 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369959 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 18:42:28.370017 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369967 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 18:42:28.370017 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369983 2559 factory.go:103] Registering Raw factory Jun 12 18:42:28.370017 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369993 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 18:42:28.370017 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.370008 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 18:42:28.370277 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.369997 2559 manager.go:1196] Started watching for new ooms in manager Jun 12 18:42:28.370277 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.370138 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 12 18:42:28.370277 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.370146 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 12 18:42:28.370475 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.370462 2559 manager.go:349] Starting recovery of all containers Jun 12 18:42:28.371221 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.371204 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:28.375110 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.375090 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-81.ec2.internal\" not found" node="ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.380494 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.380479 2559 manager.go:354] Recovery completed Jun 12 18:42:28.381821 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.381791 2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 12 18:42:28.384791 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.384779 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:28.386470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.386452 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:28.386557 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.386482 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:28.386557 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.386494 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:28.387110 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.387097 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 18:42:28.387110 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.387110 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:28.387222 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.387110 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 18:42:28.387222 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.387164 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:42:28.387810 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.387790 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:28.387877 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.387824 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:28.387877 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.387838 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:28.388214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.388202 2559 policy_none.go:49] "None policy: Start" Jun 12 18:42:28.388258 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.388217 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 18:42:28.388258 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.388228 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 18:42:28.389161 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.389150 2559 policy_none.go:47] "Start" Jun 12 18:42:28.432098 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.432077 2559 manager.go:337] "Starting Device Plugin manager" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.432137 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.432147 2559 server.go:87] "Starting device plugin registration server" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.432406 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.432419 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.432531 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.432622 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.432634 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.432686 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.433595 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.433647 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.434042 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.434098 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.434117 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 18:42:28.435060 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.434185 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 18:42:28.436407 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.436389 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:28.533214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.533178 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:28.534474 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.534453 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal"] Jun 12 18:42:28.534591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.534536 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:28.535065 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.535045 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:28.535151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.535080 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:28.535151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.535096 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:28.535151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.535129 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.535950 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.535936 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:28.536016 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.535966 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:28.536016 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.535981 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:28.537220 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.537208 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:28.537350 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.537335 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.537386 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.537363 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:28.538054 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.538037 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:28.538054 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.538058 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:28.538177 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.538067 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:28.538177 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.538089 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:28.538177 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.538107 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:28.538177 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.538117 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:28.539295 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.539248 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.539295 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.539289 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:28.539973 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.539953 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:28.540064 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.539985 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:28.540064 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.539999 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:28.542097 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.542085 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.542156 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.542102 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-81.ec2.internal\": node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:28.556757 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.556740 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:28.563111 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.563097 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-81.ec2.internal\" not found" node="ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.566648 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.566635 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-81.ec2.internal\" not found" node="ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.571150 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.571133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62246c668b1e4a2db5aaf0dcff6651ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"62246c668b1e4a2db5aaf0dcff6651ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.571238 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.571160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62246c668b1e4a2db5aaf0dcff6651ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"62246c668b1e4a2db5aaf0dcff6651ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.571238 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.571184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e680533310e632942124d5904acb29e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-81.ec2.internal\" (UID: \"2e680533310e632942124d5904acb29e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.657566 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.657529 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:28.671576 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.671552 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62246c668b1e4a2db5aaf0dcff6651ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"62246c668b1e4a2db5aaf0dcff6651ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.671678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.671643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62246c668b1e4a2db5aaf0dcff6651ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"62246c668b1e4a2db5aaf0dcff6651ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.671678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.671674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e680533310e632942124d5904acb29e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-81.ec2.internal\" (UID: \"2e680533310e632942124d5904acb29e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.671745 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.671607 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62246c668b1e4a2db5aaf0dcff6651ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"62246c668b1e4a2db5aaf0dcff6651ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.671745 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.671712 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e680533310e632942124d5904acb29e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-81.ec2.internal\" (UID: \"2e680533310e632942124d5904acb29e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.671745 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.671726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62246c668b1e4a2db5aaf0dcff6651ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal\" (UID: \"62246c668b1e4a2db5aaf0dcff6651ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.757646 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.757603 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:28.858464 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.858389 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:28.865585 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.865560 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.869882 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:28.869864 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" Jun 12 18:42:28.958724 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:28.958689 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:29.059286 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:29.059256 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:29.159860 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:29.159782 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:29.260380 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:29.260350 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:29.310900 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.310868 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 18:42:29.311736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.311027 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:42:29.311736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.311056 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:42:29.361376 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:29.361343 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:29.365530 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.365479 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 18:37:28 +0000 UTC" deadline="2028-03-01 00:32:24.065921428 +0000 UTC" Jun 12 18:42:29.365530 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.365507 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15053h49m54.700417408s" Jun 12 18:42:29.381579 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:29.381371 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62246c668b1e4a2db5aaf0dcff6651ee.slice/crio-37be4cbf905809485a7e494b58aab41d7c5cff8037f59e930798ffba62f56b7b WatchSource:0}: Error finding container 37be4cbf905809485a7e494b58aab41d7c5cff8037f59e930798ffba62f56b7b: Status 404 returned error can't find the container with id 37be4cbf905809485a7e494b58aab41d7c5cff8037f59e930798ffba62f56b7b Jun 12 18:42:29.381805 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:29.381792 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e680533310e632942124d5904acb29e.slice/crio-46e80ca1e2d37712ed576f904b62a45181f8a2e49de098a92beee01e6ad510e7 WatchSource:0}: Error finding container 46e80ca1e2d37712ed576f904b62a45181f8a2e49de098a92beee01e6ad510e7: Status 404 returned error can't find the container with id 46e80ca1e2d37712ed576f904b62a45181f8a2e49de098a92beee01e6ad510e7 Jun 12 18:42:29.386044 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.386029 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:42:29.419546 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.419497 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:29.438404 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.438353 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" event={"ID":"62246c668b1e4a2db5aaf0dcff6651ee","Type":"ContainerStarted","Data":"37be4cbf905809485a7e494b58aab41d7c5cff8037f59e930798ffba62f56b7b"} Jun 12 18:42:29.439321 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.439302 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" event={"ID":"2e680533310e632942124d5904acb29e","Type":"ContainerStarted","Data":"46e80ca1e2d37712ed576f904b62a45181f8a2e49de098a92beee01e6ad510e7"} Jun 12 18:42:29.462476 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:29.462450 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:29.563050 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:29.563017 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-81.ec2.internal\" not found" Jun 12 18:42:29.599276 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.599240 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:29.669626 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.669552 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" Jun 12 18:42:29.680775 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.680758 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:42:29.681649 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.681637 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" Jun 12 18:42:29.689907 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:29.689892 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:42:30.292874 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.292839 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:30.350369 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.350337 2559 apiserver.go:52] "Watching apiserver" Jun 12 18:42:30.357474 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.357442 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 18:42:30.359352 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.359325 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd","openshift-dns/node-resolver-72px9","openshift-image-registry/node-ca-bhlgq","openshift-multus/multus-6q8dn","openshift-network-diagnostics/network-check-target-42b55","openshift-network-operator/iptables-alerter-p4qkt","kube-system/global-pull-secret-syncer-c9dvj","kube-system/konnectivity-agent-5t29d","kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8m27p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal","openshift-multus/multus-additional-cni-plugins-55dzb","openshift-multus/network-metrics-daemon-w9jgg","openshift-ovn-kubernetes/ovnkube-node-8rzwn"] Jun 12 18:42:30.360934 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.360914 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.361026 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.361000 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:30.361988 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.361969 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:30.362080 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.362036 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:30.363125 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.363102 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.364955 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.364876 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.365981 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.365852 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 18:42:30.365981 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.365866 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 18:42:30.365981 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.365940 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 18:42:30.366228 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.366136 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rplwc\"" Jun 12 18:42:30.366734 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.366716 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:30.366832 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.366790 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:30.367387 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.367368 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qhbfb\"" Jun 12 18:42:30.367951 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.367651 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 18:42:30.367951 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.367718 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 18:42:30.367951 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.367775 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.368123 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.367951 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 18:42:30.368123 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.368023 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 18:42:30.369111 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.369093 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.369532 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.369245 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 18:42:30.370344 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.370324 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.370545 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.370503 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsrfh\"" Jun 12 18:42:30.370785 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.370768 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:42:30.370897 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.370882 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 18:42:30.371021 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.371004 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 18:42:30.372072 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.371923 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 18:42:30.372072 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.371928 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 18:42:30.372232 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.372167 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xdv8r\"" Jun 12 18:42:30.372306 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.372239 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 18:42:30.372664 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.372646 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.374220 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.373706 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 18:42:30.374220 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.373924 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 18:42:30.374220 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.373924 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 18:42:30.374220 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.374158 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wgxs8\"" Jun 12 18:42:30.374434 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.374321 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 18:42:30.374482 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.374446 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 18:42:30.374766 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.374745 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 18:42:30.376275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.375845 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.377147 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.377128 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:30.379278 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379252 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.379377 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379296 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 18:42:30.379377 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379362 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:42:30.379735 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379714 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 18:42:30.379735 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379731 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4zjsh\"" Jun 12 18:42:30.379883 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379759 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 18:42:30.379983 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpfck\" (UniqueName: \"kubernetes.io/projected/a4132cdd-aeff-47a4-85f6-c909030f4987-kube-api-access-cpfck\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.380095 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379995 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lggkz\"" Jun 12 18:42:30.380095 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.379993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.380095 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-socket-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e225712-648e-4818-b391-ad52555e9cb6-multus-daemon-config\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380157 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-kubelet-config\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-cnibin\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-systemd-units\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-var-lib-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfxhm\" (UniqueName: \"kubernetes.io/projected/d3134413-987f-49fb-990f-68dce93609ac-kube-api-access-hfxhm\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-cni-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-cni-multus\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-multus-certs\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.380433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-serviceca\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-etc-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-conf-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-systemd\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-ovnkube-script-lib\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-registration-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e225712-648e-4818-b391-ad52555e9cb6-cni-binary-copy\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-hostroot\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380658 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-node-log\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-device-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-dbus\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380783 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tfd57\"" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380802 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-cni-netd\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-sys-fs\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:30.381079 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qpl7\" (UniqueName: \"kubernetes.io/projected/0d94de43-46c3-46b0-a2a0-5fad08021d00-kube-api-access-8qpl7\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-kubelet\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-cni-bin\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg5wl\" (UniqueName: \"kubernetes.io/projected/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-kube-api-access-fg5wl\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.380988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52200dfa-499a-438c-92be-e663ad4ad742-iptables-alerter-script\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-slash\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-cni-bin\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-log-socket\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3134413-987f-49fb-990f-68dce93609ac-ovn-node-metrics-cert\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381166 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-system-cni-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-socket-dir-parent\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-k8s-cni-cncf-io\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-kubelet\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk2lj\" (UniqueName: \"kubernetes.io/projected/6e225712-648e-4818-b391-ad52555e9cb6-kube-api-access-nk2lj\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-run-netns\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.381761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-env-overrides\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381413 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9mj\" (UniqueName: \"kubernetes.io/projected/52200dfa-499a-438c-92be-e663ad4ad742-kube-api-access-6l9mj\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-ovn\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-ovnkube-config\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381473 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-os-release\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-netns\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381539 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-etc-kubernetes\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52200dfa-499a-438c-92be-e663ad4ad742-host-slash\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381587 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-host\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.382348 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.381619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.384838 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.384820 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 18:42:30.384838 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.384832 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9j8b2\"" Jun 12 18:42:30.385074 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.385059 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 18:42:30.389469 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.389449 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:42:30.399017 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.398996 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:30.411398 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.411380 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7s9fz" Jun 12 18:42:30.416056 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.416037 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7s9fz" Jun 12 18:42:30.471204 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.471174 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 18:42:30.481813 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.481788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-conf-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.481984 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.481818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-systemd\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.481984 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.481839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-ovnkube-script-lib\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.481984 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.481841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-conf-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.481984 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.481889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-systemd\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.481984 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.481937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-registration-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.481984 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.481973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e225712-648e-4818-b391-ad52555e9cb6-cni-binary-copy\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.481996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-hostroot\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482024 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysconfig\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482022 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-registration-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482090 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-hostroot\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fc2ebe4-5e34-4694-8763-cd333f6201f6-tmp\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-node-log\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482194 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-device-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-dbus\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85f5ac9f-073a-4ced-a359-aa15eff4a649-agent-certs\") pod \"konnectivity-agent-5t29d\" (UID: \"85f5ac9f-073a-4ced-a359-aa15eff4a649\") " pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-node-log\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cni-binary-copy\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.482299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482341 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-cni-netd\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482345 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-dbus\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-sys-fs\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482380 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-device-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-kubernetes\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482423 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysctl-d\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-ovnkube-script-lib\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482480 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e225712-648e-4818-b391-ad52555e9cb6-cni-binary-copy\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-cni-netd\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cnibin\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qpl7\" (UniqueName: \"kubernetes.io/projected/0d94de43-46c3-46b0-a2a0-5fad08021d00-kube-api-access-8qpl7\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-kubelet\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-cni-bin\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea99fb9a-6275-4e18-9fb5-37accb14df31-tmp-dir\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.482660 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:30.482865 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-sys-fs\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-kubelet\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-run\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482703 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-cni-bin\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-tuned\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-system-cni-dir\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.482814 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:30.982771208 +0000 UTC m=+2.938855279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg5wl\" (UniqueName: \"kubernetes.io/projected/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-kube-api-access-fg5wl\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52200dfa-499a-438c-92be-e663ad4ad742-iptables-alerter-script\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-slash\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-cni-bin\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482944 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea99fb9a-6275-4e18-9fb5-37accb14df31-hosts-file\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-slash\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.482968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c748\" (UniqueName: \"kubernetes.io/projected/ea99fb9a-6275-4e18-9fb5-37accb14df31-kube-api-access-6c748\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-cni-bin\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-host\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.483591 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85f5ac9f-073a-4ced-a359-aa15eff4a649-konnectivity-ca\") pod \"konnectivity-agent-5t29d\" (UID: \"85f5ac9f-073a-4ced-a359-aa15eff4a649\") " pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-log-socket\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-systemd\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-var-lib-kubelet\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483153 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-log-socket\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-os-release\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3134413-987f-49fb-990f-68dce93609ac-ovn-node-metrics-cert\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-system-cni-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483273 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-socket-dir-parent\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-k8s-cni-cncf-io\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-kubelet\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-system-cni-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk2lj\" (UniqueName: \"kubernetes.io/projected/6e225712-648e-4818-b391-ad52555e9cb6-kube-api-access-nk2lj\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-k8s-cni-cncf-io\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-run-netns\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-kubelet\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-env-overrides\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483404 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-run-netns\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-socket-dir-parent\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483456 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9mj\" (UniqueName: \"kubernetes.io/projected/52200dfa-499a-438c-92be-e663ad4ad742-kube-api-access-6l9mj\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-ovn\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483533 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483546 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-run-ovn\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483627 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-ovnkube-config\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-os-release\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483686 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-netns\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52200dfa-499a-438c-92be-e663ad4ad742-iptables-alerter-script\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483710 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-etc-kubernetes\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-netns\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483738 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-os-release\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysctl-conf\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.484965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-etc-kubernetes\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwp7\" (UniqueName: \"kubernetes.io/projected/4fc2ebe4-5e34-4694-8763-cd333f6201f6-kube-api-access-qxwp7\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52200dfa-499a-438c-92be-e663ad4ad742-host-slash\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-host\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52200dfa-499a-438c-92be-e663ad4ad742-host-slash\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483873 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483912 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-host\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpfck\" (UniqueName: \"kubernetes.io/projected/a4132cdd-aeff-47a4-85f6-c909030f4987-kube-api-access-cpfck\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.483989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-lib-modules\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-socket-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-env-overrides\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.484092 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.484152 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret podName:767bbb80-13c3-40bd-a9f4-cb65eddd3f6e nodeName:}" failed. No retries permitted until 2026-06-12 18:42:30.984134903 +0000 UTC m=+2.940218966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret") pod "global-pull-secret-syncer-c9dvj" (UID: "767bbb80-13c3-40bd-a9f4-cb65eddd3f6e") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:30.485525 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e225712-648e-4818-b391-ad52555e9cb6-multus-daemon-config\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-kubelet-config\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-sys\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-cnibin\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3134413-987f-49fb-990f-68dce93609ac-ovnkube-config\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-kubelet-config\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzrdt\" (UniqueName: \"kubernetes.io/projected/51ccac4d-e403-42e2-9cfd-feb86d13ced2-kube-api-access-jzrdt\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-cnibin\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-systemd-units\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-systemd-units\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-var-lib-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484375 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-var-lib-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfxhm\" (UniqueName: \"kubernetes.io/projected/d3134413-987f-49fb-990f-68dce93609ac-kube-api-access-hfxhm\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-cni-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4132cdd-aeff-47a4-85f6-c909030f4987-socket-dir\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-cni-multus\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-multus-certs\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484476 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-var-lib-cni-multus\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484500 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-multus-cni-dir\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-modprobe-d\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484536 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e225712-648e-4818-b391-ad52555e9cb6-host-run-multus-certs\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-serviceca\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-etc-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484646 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e225712-648e-4818-b391-ad52555e9cb6-multus-daemon-config\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484682 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3134413-987f-49fb-990f-68dce93609ac-etc-openvswitch\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484810 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 18:42:30.486709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.484982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-serviceca\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.487965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.487946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3134413-987f-49fb-990f-68dce93609ac-ovn-node-metrics-cert\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.489063 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.489044 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:30.489174 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.489070 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:30.489174 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.489084 2559 projected.go:196] Error preparing data for projected volume kube-api-access-xgqrf for pod openshift-network-diagnostics/network-check-target-42b55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:30.489174 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.489147 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf podName:4b3ec26b-d2c8-4697-b446-2ec3d1af6969 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:30.989129886 +0000 UTC m=+2.945213962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqrf" (UniqueName: "kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf") pod "network-check-target-42b55" (UID: "4b3ec26b-d2c8-4697-b446-2ec3d1af6969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:30.491650 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.491594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg5wl\" (UniqueName: \"kubernetes.io/projected/a1b4c353-dfe3-42a7-8d3b-556fe4e6e758-kube-api-access-fg5wl\") pod \"node-ca-bhlgq\" (UID: \"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758\") " pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.492124 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.492020 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qpl7\" (UniqueName: \"kubernetes.io/projected/0d94de43-46c3-46b0-a2a0-5fad08021d00-kube-api-access-8qpl7\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:30.492280 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.492257 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9mj\" (UniqueName: \"kubernetes.io/projected/52200dfa-499a-438c-92be-e663ad4ad742-kube-api-access-6l9mj\") pod \"iptables-alerter-p4qkt\" (UID: \"52200dfa-499a-438c-92be-e663ad4ad742\") " pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.492666 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.492632 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk2lj\" (UniqueName: \"kubernetes.io/projected/6e225712-648e-4818-b391-ad52555e9cb6-kube-api-access-nk2lj\") pod \"multus-6q8dn\" (UID: \"6e225712-648e-4818-b391-ad52555e9cb6\") " pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.492944 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.492926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpfck\" (UniqueName: \"kubernetes.io/projected/a4132cdd-aeff-47a4-85f6-c909030f4987-kube-api-access-cpfck\") pod \"aws-ebs-csi-driver-node-qbkmd\" (UID: \"a4132cdd-aeff-47a4-85f6-c909030f4987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.495318 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.495298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfxhm\" (UniqueName: \"kubernetes.io/projected/d3134413-987f-49fb-990f-68dce93609ac-kube-api-access-hfxhm\") pod \"ovnkube-node-8rzwn\" (UID: \"d3134413-987f-49fb-990f-68dce93609ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.585446 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-modprobe-d\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585446 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysconfig\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585446 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fc2ebe4-5e34-4694-8763-cd333f6201f6-tmp\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585446 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585442 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85f5ac9f-073a-4ced-a359-aa15eff4a649-agent-certs\") pod \"konnectivity-agent-5t29d\" (UID: \"85f5ac9f-073a-4ced-a359-aa15eff4a649\") " pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cni-binary-copy\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585537 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysconfig\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-modprobe-d\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-kubernetes\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-kubernetes\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysctl-d\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cnibin\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea99fb9a-6275-4e18-9fb5-37accb14df31-tmp-dir\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585724 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-run\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-tuned\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.585780 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585781 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-system-cni-dir\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea99fb9a-6275-4e18-9fb5-37accb14df31-hosts-file\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c748\" (UniqueName: \"kubernetes.io/projected/ea99fb9a-6275-4e18-9fb5-37accb14df31-kube-api-access-6c748\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-host\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585941 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85f5ac9f-073a-4ced-a359-aa15eff4a649-konnectivity-ca\") pod \"konnectivity-agent-5t29d\" (UID: \"85f5ac9f-073a-4ced-a359-aa15eff4a649\") " pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.585970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-systemd\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586006 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-var-lib-kubelet\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-os-release\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysctl-conf\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwp7\" (UniqueName: \"kubernetes.io/projected/4fc2ebe4-5e34-4694-8763-cd333f6201f6-kube-api-access-qxwp7\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586141 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-system-cni-dir\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586195 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-lib-modules\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-sys\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586265 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysctl-d\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.586332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586273 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzrdt\" (UniqueName: \"kubernetes.io/projected/51ccac4d-e403-42e2-9cfd-feb86d13ced2-kube-api-access-jzrdt\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586447 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea99fb9a-6275-4e18-9fb5-37accb14df31-tmp-dir\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586143 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cnibin\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586592 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-os-release\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea99fb9a-6275-4e18-9fb5-37accb14df31-hosts-file\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586685 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-cni-binary-copy\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586717 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51ccac4d-e403-42e2-9cfd-feb86d13ced2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586748 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-run\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586865 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-sysctl-conf\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586903 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-systemd\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.586966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-var-lib-kubelet\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.587063 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-lib-modules\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.587116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-host\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.587137 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.587132 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fc2ebe4-5e34-4694-8763-cd333f6201f6-sys\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.587625 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.587266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/85f5ac9f-073a-4ced-a359-aa15eff4a649-konnectivity-ca\") pod \"konnectivity-agent-5t29d\" (UID: \"85f5ac9f-073a-4ced-a359-aa15eff4a649\") " pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:30.587664 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.587631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51ccac4d-e403-42e2-9cfd-feb86d13ced2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.588526 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.588483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fc2ebe4-5e34-4694-8763-cd333f6201f6-tmp\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.588717 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.588693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fc2ebe4-5e34-4694-8763-cd333f6201f6-etc-tuned\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.589229 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.589209 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/85f5ac9f-073a-4ced-a359-aa15eff4a649-agent-certs\") pod \"konnectivity-agent-5t29d\" (UID: \"85f5ac9f-073a-4ced-a359-aa15eff4a649\") " pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:30.594151 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.594128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c748\" (UniqueName: \"kubernetes.io/projected/ea99fb9a-6275-4e18-9fb5-37accb14df31-kube-api-access-6c748\") pod \"node-resolver-72px9\" (UID: \"ea99fb9a-6275-4e18-9fb5-37accb14df31\") " pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.594434 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.594416 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzrdt\" (UniqueName: \"kubernetes.io/projected/51ccac4d-e403-42e2-9cfd-feb86d13ced2-kube-api-access-jzrdt\") pod \"multus-additional-cni-plugins-55dzb\" (UID: \"51ccac4d-e403-42e2-9cfd-feb86d13ced2\") " pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.594537 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.594500 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwp7\" (UniqueName: \"kubernetes.io/projected/4fc2ebe4-5e34-4694-8763-cd333f6201f6-kube-api-access-qxwp7\") pod \"tuned-8m27p\" (UID: \"4fc2ebe4-5e34-4694-8763-cd333f6201f6\") " pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.675635 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.675599 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bhlgq" Jun 12 18:42:30.683918 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.683893 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6q8dn" Jun 12 18:42:30.691670 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.691647 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p4qkt" Jun 12 18:42:30.697493 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.697475 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:30.703482 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.703462 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" Jun 12 18:42:30.710091 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.710072 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-72px9" Jun 12 18:42:30.716669 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.716651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8m27p" Jun 12 18:42:30.723491 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.723469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:30.728905 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.728888 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-55dzb" Jun 12 18:42:30.988016 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.987933 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:30.988016 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:30.988000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:30.988205 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.988086 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:30.988205 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.988105 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:30.988205 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.988149 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:31.988131383 +0000 UTC m=+3.944215459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:30.988205 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:30.988173 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret podName:767bbb80-13c3-40bd-a9f4-cb65eddd3f6e nodeName:}" failed. No retries permitted until 2026-06-12 18:42:31.988163423 +0000 UTC m=+3.944247488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret") pod "global-pull-secret-syncer-c9dvj" (UID: "767bbb80-13c3-40bd-a9f4-cb65eddd3f6e") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:31.089057 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.088983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:31.089214 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:31.089159 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:31.089214 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:31.089177 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:31.089214 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:31.089189 2559 projected.go:196] Error preparing data for projected volume kube-api-access-xgqrf for pod openshift-network-diagnostics/network-check-target-42b55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:31.089367 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:31.089251 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf podName:4b3ec26b-d2c8-4697-b446-2ec3d1af6969 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:32.089231677 +0000 UTC m=+4.045315761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqrf" (UniqueName: "kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf") pod "network-check-target-42b55" (UID: "4b3ec26b-d2c8-4697-b446-2ec3d1af6969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:31.219667 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:31.219632 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e225712_648e_4818_b391_ad52555e9cb6.slice/crio-e8df6c614cc3bc566c7da83a18aa43d6434bf040a669febae11f5abac75427e2 WatchSource:0}: Error finding container e8df6c614cc3bc566c7da83a18aa43d6434bf040a669febae11f5abac75427e2: Status 404 returned error can't find the container with id e8df6c614cc3bc566c7da83a18aa43d6434bf040a669febae11f5abac75427e2 Jun 12 18:42:31.220286 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:31.220260 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3134413_987f_49fb_990f_68dce93609ac.slice/crio-504ebb4ff8233949205378fa53ba3d2359a0fe6a1d5c1f4d5840f4e87616ab77 WatchSource:0}: Error finding container 504ebb4ff8233949205378fa53ba3d2359a0fe6a1d5c1f4d5840f4e87616ab77: Status 404 returned error can't find the container with id 504ebb4ff8233949205378fa53ba3d2359a0fe6a1d5c1f4d5840f4e87616ab77 Jun 12 18:42:31.221175 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:31.221156 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4132cdd_aeff_47a4_85f6_c909030f4987.slice/crio-37c4db8df284812896cca72ac0f3451e5f0341f310dd99d979dd429f703bda5b WatchSource:0}: Error finding container 37c4db8df284812896cca72ac0f3451e5f0341f310dd99d979dd429f703bda5b: Status 404 returned error can't find the container with id 37c4db8df284812896cca72ac0f3451e5f0341f310dd99d979dd429f703bda5b Jun 12 18:42:31.222102 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:31.222069 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ccac4d_e403_42e2_9cfd_feb86d13ced2.slice/crio-30b01315883086cc234e9265a631b6dfe3ab78234e42e4ff1f59130159ed0c40 WatchSource:0}: Error finding container 30b01315883086cc234e9265a631b6dfe3ab78234e42e4ff1f59130159ed0c40: Status 404 returned error can't find the container with id 30b01315883086cc234e9265a631b6dfe3ab78234e42e4ff1f59130159ed0c40 Jun 12 18:42:31.226000 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:31.225977 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f5ac9f_073a_4ced_a359_aa15eff4a649.slice/crio-fb21803cd33ee3af6589c678b20059e54bf1559b0c4922cfa266806fd5996ff2 WatchSource:0}: Error finding container fb21803cd33ee3af6589c678b20059e54bf1559b0c4922cfa266806fd5996ff2: Status 404 returned error can't find the container with id fb21803cd33ee3af6589c678b20059e54bf1559b0c4922cfa266806fd5996ff2 Jun 12 18:42:31.227921 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:31.227898 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52200dfa_499a_438c_92be_e663ad4ad742.slice/crio-ebd93b5e151a2a49b65d64c5f6682288c19e4d821d252a0bb1f5a2463d560c6b WatchSource:0}: Error finding container ebd93b5e151a2a49b65d64c5f6682288c19e4d821d252a0bb1f5a2463d560c6b: Status 404 returned error can't find the container with id ebd93b5e151a2a49b65d64c5f6682288c19e4d821d252a0bb1f5a2463d560c6b Jun 12 18:42:31.228336 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:31.228314 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b4c353_dfe3_42a7_8d3b_556fe4e6e758.slice/crio-52551c11966e902ae27b99dd27ef6a0953d3174217565cb14354c249dfe0793b WatchSource:0}: Error finding container 52551c11966e902ae27b99dd27ef6a0953d3174217565cb14354c249dfe0793b: Status 404 returned error can't find the container with id 52551c11966e902ae27b99dd27ef6a0953d3174217565cb14354c249dfe0793b Jun 12 18:42:31.229638 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:42:31.229582 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc2ebe4_5e34_4694_8763_cd333f6201f6.slice/crio-9f520cc91f38cea8a6c362d881ab1d6ac10c5ba9a723d7fc9f3825bf55eda553 WatchSource:0}: Error finding container 9f520cc91f38cea8a6c362d881ab1d6ac10c5ba9a723d7fc9f3825bf55eda553: Status 404 returned error can't find the container with id 9f520cc91f38cea8a6c362d881ab1d6ac10c5ba9a723d7fc9f3825bf55eda553 Jun 12 18:42:31.418241 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.418166 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:37:30 +0000 UTC" deadline="2027-11-12 15:59:08.462783119 +0000 UTC" Jun 12 18:42:31.418241 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.418236 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12429h16m37.044550773s" Jun 12 18:42:31.444918 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.444888 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" event={"ID":"2e680533310e632942124d5904acb29e","Type":"ContainerStarted","Data":"aecf4df2bd2ee2c55c2310479bff801c7cbc508636b81b42af4e7284cebd7003"} Jun 12 18:42:31.446283 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.446258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bhlgq" event={"ID":"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758","Type":"ContainerStarted","Data":"52551c11966e902ae27b99dd27ef6a0953d3174217565cb14354c249dfe0793b"} Jun 12 18:42:31.447358 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.447337 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-72px9" event={"ID":"ea99fb9a-6275-4e18-9fb5-37accb14df31","Type":"ContainerStarted","Data":"2d6e9ec8aaf0f75b0ef1bae9fd83aa66a0711814667d8a927a412f03ffa40cc9"} Jun 12 18:42:31.448450 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.448429 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55dzb" event={"ID":"51ccac4d-e403-42e2-9cfd-feb86d13ced2","Type":"ContainerStarted","Data":"30b01315883086cc234e9265a631b6dfe3ab78234e42e4ff1f59130159ed0c40"} Jun 12 18:42:31.449568 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.449542 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" event={"ID":"a4132cdd-aeff-47a4-85f6-c909030f4987","Type":"ContainerStarted","Data":"37c4db8df284812896cca72ac0f3451e5f0341f310dd99d979dd429f703bda5b"} Jun 12 18:42:31.451637 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.451613 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6q8dn" event={"ID":"6e225712-648e-4818-b391-ad52555e9cb6","Type":"ContainerStarted","Data":"e8df6c614cc3bc566c7da83a18aa43d6434bf040a669febae11f5abac75427e2"} Jun 12 18:42:31.453266 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.453235 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8m27p" event={"ID":"4fc2ebe4-5e34-4694-8763-cd333f6201f6","Type":"ContainerStarted","Data":"9f520cc91f38cea8a6c362d881ab1d6ac10c5ba9a723d7fc9f3825bf55eda553"} Jun 12 18:42:31.454258 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.454235 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5t29d" event={"ID":"85f5ac9f-073a-4ced-a359-aa15eff4a649","Type":"ContainerStarted","Data":"fb21803cd33ee3af6589c678b20059e54bf1559b0c4922cfa266806fd5996ff2"} Jun 12 18:42:31.455229 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.455201 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p4qkt" event={"ID":"52200dfa-499a-438c-92be-e663ad4ad742","Type":"ContainerStarted","Data":"ebd93b5e151a2a49b65d64c5f6682288c19e4d821d252a0bb1f5a2463d560c6b"} Jun 12 18:42:31.456118 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.456100 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"504ebb4ff8233949205378fa53ba3d2359a0fe6a1d5c1f4d5840f4e87616ab77"} Jun 12 18:42:31.462670 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.462623 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-81.ec2.internal" podStartSLOduration=2.462611747 podStartE2EDuration="2.462611747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:31.462355481 +0000 UTC m=+3.418439561" watchObservedRunningTime="2026-06-12 18:42:31.462611747 +0000 UTC m=+3.418695827" Jun 12 18:42:31.996227 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.996142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:31.996423 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:31.996334 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:31.996423 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:31.996409 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:33.996385663 +0000 UTC m=+5.952469737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:31.996858 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:31.996645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:31.996858 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:31.996776 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:31.996858 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:31.996838 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret podName:767bbb80-13c3-40bd-a9f4-cb65eddd3f6e nodeName:}" failed. No retries permitted until 2026-06-12 18:42:33.99682279 +0000 UTC m=+5.952906861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret") pod "global-pull-secret-syncer-c9dvj" (UID: "767bbb80-13c3-40bd-a9f4-cb65eddd3f6e") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:32.098481 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:32.097842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:32.098481 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:32.098051 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:32.098481 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:32.098071 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:32.098481 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:32.098085 2559 projected.go:196] Error preparing data for projected volume kube-api-access-xgqrf for pod openshift-network-diagnostics/network-check-target-42b55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:32.098481 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:32.098144 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf podName:4b3ec26b-d2c8-4697-b446-2ec3d1af6969 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:34.098125343 +0000 UTC m=+6.054209404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqrf" (UniqueName: "kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf") pod "network-check-target-42b55" (UID: "4b3ec26b-d2c8-4697-b446-2ec3d1af6969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:32.419417 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:32.419318 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:37:30 +0000 UTC" deadline="2028-02-05 10:55:36.464352326 +0000 UTC" Jun 12 18:42:32.419417 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:32.419361 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14464h13m4.044996867s" Jun 12 18:42:32.437224 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:32.437195 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:32.437362 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:32.437327 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:32.437746 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:32.437726 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:32.437855 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:32.437836 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:32.437915 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:32.437891 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:32.437968 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:32.437954 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:32.483183 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:32.483143 2559 generic.go:356] "Generic (PLEG): container finished" podID="62246c668b1e4a2db5aaf0dcff6651ee" containerID="dc9c2e1956ac1a8dad5dc60fe861dda8d538a5ecda34b2ddbf610c006069269b" exitCode=0 Jun 12 18:42:32.483846 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:32.483732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" event={"ID":"62246c668b1e4a2db5aaf0dcff6651ee","Type":"ContainerDied","Data":"dc9c2e1956ac1a8dad5dc60fe861dda8d538a5ecda34b2ddbf610c006069269b"} Jun 12 18:42:33.502539 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:33.501784 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" event={"ID":"62246c668b1e4a2db5aaf0dcff6651ee","Type":"ContainerStarted","Data":"5669f3416e2131a80516820f0002ef98d20b0a17060b4db9192905f761a1f84e"} Jun 12 18:42:34.013944 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:34.013900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:34.014127 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:34.013992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:34.014202 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.014146 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:34.014265 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.014214 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:38.01419532 +0000 UTC m=+9.970279378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:34.014606 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.014480 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:34.014606 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.014559 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret podName:767bbb80-13c3-40bd-a9f4-cb65eddd3f6e nodeName:}" failed. No retries permitted until 2026-06-12 18:42:38.014541032 +0000 UTC m=+9.970625093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret") pod "global-pull-secret-syncer-c9dvj" (UID: "767bbb80-13c3-40bd-a9f4-cb65eddd3f6e") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:34.115596 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:34.114957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:34.115596 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.115132 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:34.115596 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.115152 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:34.115596 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.115165 2559 projected.go:196] Error preparing data for projected volume kube-api-access-xgqrf for pod openshift-network-diagnostics/network-check-target-42b55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:34.115596 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.115225 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf podName:4b3ec26b-d2c8-4697-b446-2ec3d1af6969 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:38.11520504 +0000 UTC m=+10.071289100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqrf" (UniqueName: "kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf") pod "network-check-target-42b55" (UID: "4b3ec26b-d2c8-4697-b446-2ec3d1af6969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:34.435697 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:34.435152 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:34.435697 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.435280 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:34.435697 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:34.435504 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:34.435697 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.435649 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:34.435697 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:34.435684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:34.436033 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:34.435751 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:36.434907 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:36.434872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:36.434907 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:36.434898 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:36.435424 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:36.434996 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:36.435424 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:36.435003 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:36.435424 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:36.435198 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:36.435424 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:36.435236 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:38.046288 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:38.046204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:38.046776 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.046319 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:38.046776 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.046380 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret podName:767bbb80-13c3-40bd-a9f4-cb65eddd3f6e nodeName:}" failed. No retries permitted until 2026-06-12 18:42:46.046364644 +0000 UTC m=+18.002448722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret") pod "global-pull-secret-syncer-c9dvj" (UID: "767bbb80-13c3-40bd-a9f4-cb65eddd3f6e") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:38.046776 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:38.046363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:38.046776 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.046598 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:38.046776 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.046662 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:46.046643908 +0000 UTC m=+18.002727965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:38.147751 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:38.147712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:38.147928 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.147901 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:38.147928 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.147925 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:38.148059 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.147939 2559 projected.go:196] Error preparing data for projected volume kube-api-access-xgqrf for pod openshift-network-diagnostics/network-check-target-42b55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:38.148059 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.148006 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf podName:4b3ec26b-d2c8-4697-b446-2ec3d1af6969 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:46.14798694 +0000 UTC m=+18.104071014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqrf" (UniqueName: "kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf") pod "network-check-target-42b55" (UID: "4b3ec26b-d2c8-4697-b446-2ec3d1af6969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:38.435548 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:38.435261 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:38.435703 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.435583 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:38.436103 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:38.435954 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:38.436103 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.436052 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:38.436611 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:38.436383 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:38.436611 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:38.436497 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:40.435824 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:40.435311 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:40.435824 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:40.435318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:40.435824 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:40.435456 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:40.435824 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:40.435547 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:40.435824 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:40.435583 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:40.435824 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:40.435634 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:42.435122 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:42.435083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:42.435621 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:42.435142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:42.435621 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:42.435087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:42.435621 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:42.435254 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:42.435621 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:42.435312 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:42.435621 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:42.435372 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:44.435252 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:44.435216 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:44.435725 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:44.435260 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:44.435725 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:44.435227 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:44.435725 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:44.435338 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:44.435725 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:44.435431 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:44.435725 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:44.435524 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:46.104024 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:46.103979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:46.104489 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:46.104078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:46.104489 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.104146 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:46.104489 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.104203 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:46.104489 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.104221 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret podName:767bbb80-13c3-40bd-a9f4-cb65eddd3f6e nodeName:}" failed. No retries permitted until 2026-06-12 18:43:02.10420152 +0000 UTC m=+34.060285599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret") pod "global-pull-secret-syncer-c9dvj" (UID: "767bbb80-13c3-40bd-a9f4-cb65eddd3f6e") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:46.104489 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.104253 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:02.104235831 +0000 UTC m=+34.060319909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:46.205221 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:46.205182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:46.205401 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.205316 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:46.205401 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.205333 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:46.205401 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.205346 2559 projected.go:196] Error preparing data for projected volume kube-api-access-xgqrf for pod openshift-network-diagnostics/network-check-target-42b55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:46.205401 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.205398 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf podName:4b3ec26b-d2c8-4697-b446-2ec3d1af6969 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:02.205381894 +0000 UTC m=+34.161465969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqrf" (UniqueName: "kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf") pod "network-check-target-42b55" (UID: "4b3ec26b-d2c8-4697-b446-2ec3d1af6969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:46.435169 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:46.435078 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:46.435328 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.435211 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:46.435328 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:46.435078 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:46.435328 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:46.435285 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:46.435477 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.435383 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:46.435477 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:46.435467 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:48.437711 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:48.437679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:48.438161 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:48.437679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:48.438161 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:48.437802 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:48.438161 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:48.437683 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:48.438161 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:48.437882 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:48.438161 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:48.437929 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:50.435466 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.435289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:50.436309 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.435292 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:50.436309 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:50.435564 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:50.436309 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.435358 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:50.436309 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:50.435661 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:50.436309 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:50.435749 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:50.539881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.539819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8m27p" event={"ID":"4fc2ebe4-5e34-4694-8763-cd333f6201f6","Type":"ContainerStarted","Data":"ad820442c689af9a5d04cd54c2025b7147a8cb8d219a8a5f2add6d01e110ff18"} Jun 12 18:42:50.541419 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.541390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5t29d" event={"ID":"85f5ac9f-073a-4ced-a359-aa15eff4a649","Type":"ContainerStarted","Data":"e046d2f0d8cf5426e6981006e24bd296f785259c654529b1b995ac3189b70743"} Jun 12 18:42:50.544215 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.544194 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:42:50.544678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.544603 2559 generic.go:356] "Generic (PLEG): container finished" podID="d3134413-987f-49fb-990f-68dce93609ac" containerID="a9bfd037b3e3d2ed9ebbeb03a17543fe09c282d632ab430f62f90d1426ce802f" exitCode=1 Jun 12 18:42:50.544678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.544669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"90b31a36c2fb90922928cf27ff37acbb8945c62f6bc23bbdebe0e084b5a696c2"} Jun 12 18:42:50.544847 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.544730 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"e61effbb7c8f1747ec63f9cfd4c2eb3d21847a60c844622c3bd4f3d94805fafb"} Jun 12 18:42:50.544847 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.544764 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"c7ef317cd942d128e3070a14b8683de6d24c94288d9bd6087a64689b4b660d7e"} Jun 12 18:42:50.544847 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.544801 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerDied","Data":"a9bfd037b3e3d2ed9ebbeb03a17543fe09c282d632ab430f62f90d1426ce802f"} Jun 12 18:42:50.544847 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.544845 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"2e6c3a4cf7ade824f0b699b0878e4fd04b3c2640a92c02b593936b210a868141"} Jun 12 18:42:50.546065 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.546040 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bhlgq" event={"ID":"a1b4c353-dfe3-42a7-8d3b-556fe4e6e758","Type":"ContainerStarted","Data":"7b0eaaf140e8a076ec7fc005bb8aeb2ecde0be040337434a3ea24e2de62fee05"} Jun 12 18:42:50.550710 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.550688 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-72px9" event={"ID":"ea99fb9a-6275-4e18-9fb5-37accb14df31","Type":"ContainerStarted","Data":"71ba93e76ce072bff43e437808e890f29d718ce419fac687450c79eb68b6f905"} Jun 12 18:42:50.552050 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.552026 2559 generic.go:356] "Generic (PLEG): container finished" podID="51ccac4d-e403-42e2-9cfd-feb86d13ced2" containerID="3d06a5a5ac2b0f89b47363afabb3591c877ed3d80d430f13bc9a5ff45282d2b1" exitCode=0 Jun 12 18:42:50.552142 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.552090 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55dzb" event={"ID":"51ccac4d-e403-42e2-9cfd-feb86d13ced2","Type":"ContainerDied","Data":"3d06a5a5ac2b0f89b47363afabb3591c877ed3d80d430f13bc9a5ff45282d2b1"} Jun 12 18:42:50.553550 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.553505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" event={"ID":"a4132cdd-aeff-47a4-85f6-c909030f4987","Type":"ContainerStarted","Data":"de8b76535d6c218cc8d109fca5ecf94c468eab0e1adaf610aeb88feff09c85f5"} Jun 12 18:42:50.554820 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.554798 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6q8dn" event={"ID":"6e225712-648e-4818-b391-ad52555e9cb6","Type":"ContainerStarted","Data":"1b8b8b55067f5cff602917d86f6cf2cf263b8abfb2bbeeb5b51ffd03e8e1c663"} Jun 12 18:42:50.558004 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.557968 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8m27p" podStartSLOduration=3.8977475 podStartE2EDuration="22.557957101s" totalImagesPullingTime="18.660209601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:50.557867441 +0000 UTC m=+22.513951522" watchObservedRunningTime="2026-06-12 18:42:50.557957101 +0000 UTC m=+22.514041179" Jun 12 18:42:50.558084 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.558056 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-81.ec2.internal" podStartSLOduration=21.558050876 podStartE2EDuration="21.558050876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:33.517721258 +0000 UTC m=+5.473805337" watchObservedRunningTime="2026-06-12 18:42:50.558050876 +0000 UTC m=+22.514134954" Jun 12 18:42:50.575377 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.575326 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6q8dn" podStartSLOduration=3.800326564 podStartE2EDuration="22.575312795s" totalImagesPullingTime="18.774986231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:50.574878611 +0000 UTC m=+22.530962689" watchObservedRunningTime="2026-06-12 18:42:50.575312795 +0000 UTC m=+22.531396874" Jun 12 18:42:50.592482 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.592430 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bhlgq" podStartSLOduration=3.9022307830000003 podStartE2EDuration="22.592415041s" totalImagesPullingTime="18.690184258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:50.591784559 +0000 UTC m=+22.547868637" watchObservedRunningTime="2026-06-12 18:42:50.592415041 +0000 UTC m=+22.548499120" Jun 12 18:42:50.607880 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.607825 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-72px9" podStartSLOduration=3.941111028 podStartE2EDuration="22.607801953s" totalImagesPullingTime="18.666690925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:50.607291598 +0000 UTC m=+22.563375679" watchObservedRunningTime="2026-06-12 18:42:50.607801953 +0000 UTC m=+22.563886034" Jun 12 18:42:50.653402 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:50.653139 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5t29d" podStartSLOduration=3.989269675 podStartE2EDuration="22.653119987s" totalImagesPullingTime="18.663850312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:50.629053209 +0000 UTC m=+22.585137289" watchObservedRunningTime="2026-06-12 18:42:50.653119987 +0000 UTC m=+22.609204066" Jun 12 18:42:51.495610 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:51.495589 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 18:42:51.560824 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:51.560783 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:42:51.561363 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:51.561330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"e56b868757b1964f04f861d262839a36ead47f4a07175bc448084eb5273e6852"} Jun 12 18:42:51.563388 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:51.563364 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" event={"ID":"a4132cdd-aeff-47a4-85f6-c909030f4987","Type":"ContainerStarted","Data":"9ac933684fe91fdb5eefc04e222784b13d548420e33674434104ae1954eed5bd"} Jun 12 18:42:51.565087 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:51.565045 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p4qkt" event={"ID":"52200dfa-499a-438c-92be-e663ad4ad742","Type":"ContainerStarted","Data":"97331fc02646e41cae5008ba095fe5a64106d0734baccd13e0408a605164d209"} Jun 12 18:42:52.434755 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:52.434717 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:52.434924 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:52.434731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:52.434924 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:52.434852 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:52.434924 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:52.434865 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:52.435081 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:52.434940 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:52.435081 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:52.435061 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:52.448684 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:52.448592 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T18:42:51.495606435Z","UUID":"0c745d0b-7383-4597-9487-491d34752c3a","Handler":null,"Name":"","Endpoint":""} Jun 12 18:42:52.450274 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:52.450255 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 18:42:52.450392 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:52.450295 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 18:42:53.572554 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:53.572529 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:42:53.573171 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:53.572954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"c0cf33f528d5497e017ac4b3c4845432abf0a87ea51274c141dcb4faf942a895"} Jun 12 18:42:53.575114 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:53.575090 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" event={"ID":"a4132cdd-aeff-47a4-85f6-c909030f4987","Type":"ContainerStarted","Data":"d2f8782b6155a45142ebe41d55dee2cfdcdf395290954cf31b7d2ea4fbe4b239"} Jun 12 18:42:53.595792 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:53.595744 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p4qkt" podStartSLOduration=6.902932823 podStartE2EDuration="25.595731802s" totalImagesPullingTime="18.692798979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:51.583330286 +0000 UTC m=+23.539414359" watchObservedRunningTime="2026-06-12 18:42:53.595731802 +0000 UTC m=+25.551815881" Jun 12 18:42:53.596172 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:53.596151 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbkmd" podStartSLOduration=4.690372949 podStartE2EDuration="25.596144943s" totalImagesPullingTime="20.905771994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:53.595485342 +0000 UTC m=+25.551569424" watchObservedRunningTime="2026-06-12 18:42:53.596144943 +0000 UTC m=+25.552229022" Jun 12 18:42:54.423900 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:54.423873 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:54.424484 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:54.424471 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:54.434834 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:54.434807 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:54.434984 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:54.434844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:54.434984 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:54.434814 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:54.434984 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:54.434931 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:54.435108 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:54.435021 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:54.435108 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:54.435100 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:56.435094 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:56.434749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:56.435094 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:56.434767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:56.435094 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:56.435051 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:56.436162 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:56.434776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:56.436162 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:56.435158 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:56.436162 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:56.435203 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:56.584902 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:56.584880 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:42:56.585206 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:56.585180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"cdef7d044bd754c88b19f7b5523b3ed3f4c28f08960bb2bab755f1072fab0f4c"} Jun 12 18:42:56.588395 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:56.588361 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:56.588542 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:56.588507 2559 scope.go:117] "RemoveContainer" containerID="a9bfd037b3e3d2ed9ebbeb03a17543fe09c282d632ab430f62f90d1426ce802f" Jun 12 18:42:56.607171 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:56.607148 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:57.596793 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:57.596688 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:42:57.597309 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:57.597164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" event={"ID":"d3134413-987f-49fb-990f-68dce93609ac","Type":"ContainerStarted","Data":"473d47ae2ba285969382529283287fbd669b6b3de34b3031c40806187b788698"} Jun 12 18:42:57.597309 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:57.597235 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 18:42:57.597650 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:57.597628 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:57.599526 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:57.599488 2559 generic.go:356] "Generic (PLEG): container finished" podID="51ccac4d-e403-42e2-9cfd-feb86d13ced2" containerID="6ced0f4044b0de5aafc4427ba3be8abf885ba6fb10bb157c6d9e3ee746d80be9" exitCode=0 Jun 12 18:42:57.599625 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:57.599547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55dzb" event={"ID":"51ccac4d-e403-42e2-9cfd-feb86d13ced2","Type":"ContainerDied","Data":"6ced0f4044b0de5aafc4427ba3be8abf885ba6fb10bb157c6d9e3ee746d80be9"} Jun 12 18:42:57.619448 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:57.619409 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:57.630618 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:57.629189 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" podStartSLOduration=10.877625084 podStartE2EDuration="29.62916957s" totalImagesPullingTime="18.751544486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:57.626289347 +0000 UTC m=+29.582373427" watchObservedRunningTime="2026-06-12 18:42:57.62916957 +0000 UTC m=+29.585253651" Jun 12 18:42:58.384327 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.384147 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w9jgg"] Jun 12 18:42:58.384490 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.384439 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:42:58.384565 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:58.384545 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:42:58.387747 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.387723 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-42b55"] Jun 12 18:42:58.387864 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.387825 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:42:58.387939 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:58.387916 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:42:58.388384 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.388359 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c9dvj"] Jun 12 18:42:58.388501 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.388456 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:42:58.388587 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:42:58.388564 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:42:58.593903 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.593827 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:58.594051 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.593946 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 18:42:58.594458 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.594434 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5t29d" Jun 12 18:42:58.601716 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.601694 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 18:42:58.614493 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:58.614468 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:42:59.605765 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:59.605731 2559 generic.go:356] "Generic (PLEG): container finished" podID="51ccac4d-e403-42e2-9cfd-feb86d13ced2" containerID="de8699259058a644927aae9b04f7b5f6b1edc1d60df169e46efadc632b2c331e" exitCode=0 Jun 12 18:42:59.606211 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:42:59.605804 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55dzb" event={"ID":"51ccac4d-e403-42e2-9cfd-feb86d13ced2","Type":"ContainerDied","Data":"de8699259058a644927aae9b04f7b5f6b1edc1d60df169e46efadc632b2c331e"} Jun 12 18:43:00.434976 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:00.434944 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:43:00.434976 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:00.434958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:43:00.435180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:00.434958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:43:00.435180 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:00.435050 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:43:00.435180 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:00.435131 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:43:00.435295 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:00.435204 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:43:01.612526 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:01.612287 2559 generic.go:356] "Generic (PLEG): container finished" podID="51ccac4d-e403-42e2-9cfd-feb86d13ced2" containerID="ca792fe9feecd0285fce10e30d9fbdf83853a6241def067e0c51a983cb46cb7f" exitCode=0 Jun 12 18:43:01.612526 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:01.612373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55dzb" event={"ID":"51ccac4d-e403-42e2-9cfd-feb86d13ced2","Type":"ContainerDied","Data":"ca792fe9feecd0285fce10e30d9fbdf83853a6241def067e0c51a983cb46cb7f"} Jun 12 18:43:02.118376 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:02.118350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:43:02.118559 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:02.118391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:43:02.118559 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.118504 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:43:02.118638 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.118580 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret podName:767bbb80-13c3-40bd-a9f4-cb65eddd3f6e nodeName:}" failed. No retries permitted until 2026-06-12 18:43:34.118564089 +0000 UTC m=+66.074648146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret") pod "global-pull-secret-syncer-c9dvj" (UID: "767bbb80-13c3-40bd-a9f4-cb65eddd3f6e") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:43:02.118638 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.118504 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:43:02.118712 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.118661 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:34.118647058 +0000 UTC m=+66.074731136 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:43:02.218770 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:02.218736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:43:02.218934 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.218855 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:43:02.218934 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.218869 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:43:02.218934 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.218878 2559 projected.go:196] Error preparing data for projected volume kube-api-access-xgqrf for pod openshift-network-diagnostics/network-check-target-42b55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:43:02.218934 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.218923 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf podName:4b3ec26b-d2c8-4697-b446-2ec3d1af6969 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:34.218910309 +0000 UTC m=+66.174994366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqrf" (UniqueName: "kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf") pod "network-check-target-42b55" (UID: "4b3ec26b-d2c8-4697-b446-2ec3d1af6969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:43:02.435302 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:02.435207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:43:02.435302 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:02.435249 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:43:02.435542 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:02.435207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:43:02.435542 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.435327 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:43:02.435542 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.435424 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c9dvj" podUID="767bbb80-13c3-40bd-a9f4-cb65eddd3f6e" Jun 12 18:43:02.435542 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:02.435528 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42b55" podUID="4b3ec26b-d2c8-4697-b446-2ec3d1af6969" Jun 12 18:43:03.838846 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.838753 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-81.ec2.internal" event="NodeReady" Jun 12 18:43:03.839185 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.838875 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 18:43:03.886658 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.886626 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zsflt"] Jun 12 18:43:03.902250 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.902213 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nd44b"] Jun 12 18:43:03.902464 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.902367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:03.905807 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.905651 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 18:43:03.905807 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.905672 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 18:43:03.906052 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.905926 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkhgt\"" Jun 12 18:43:03.916168 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.916139 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nd44b"] Jun 12 18:43:03.916278 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.916177 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zsflt"] Jun 12 18:43:03.916278 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.916235 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nd44b" Jun 12 18:43:03.919481 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.919464 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 18:43:03.919700 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.919686 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 18:43:03.919751 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.919713 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jmkqw\"" Jun 12 18:43:03.919751 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:03.919714 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 18:43:04.031526 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.031491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3276bc51-9677-4b76-a756-af3ea2b6e648-tmp-dir\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.031689 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.031545 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.031689 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.031583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28edbe43-9f3a-47f9-ba58-78d9c98ef1d4-cert\") pod \"ingress-canary-nd44b\" (UID: \"28edbe43-9f3a-47f9-ba58-78d9c98ef1d4\") " pod="openshift-ingress-canary/ingress-canary-nd44b" Jun 12 18:43:04.031689 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.031623 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvb5w\" (UniqueName: \"kubernetes.io/projected/28edbe43-9f3a-47f9-ba58-78d9c98ef1d4-kube-api-access-gvb5w\") pod \"ingress-canary-nd44b\" (UID: \"28edbe43-9f3a-47f9-ba58-78d9c98ef1d4\") " pod="openshift-ingress-canary/ingress-canary-nd44b" Jun 12 18:43:04.031689 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.031661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3276bc51-9677-4b76-a756-af3ea2b6e648-config-volume\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.031689 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.031679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh8mp\" (UniqueName: \"kubernetes.io/projected/3276bc51-9677-4b76-a756-af3ea2b6e648-kube-api-access-vh8mp\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.132894 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.132816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.132894 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.132876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28edbe43-9f3a-47f9-ba58-78d9c98ef1d4-cert\") pod \"ingress-canary-nd44b\" (UID: \"28edbe43-9f3a-47f9-ba58-78d9c98ef1d4\") " pod="openshift-ingress-canary/ingress-canary-nd44b" Jun 12 18:43:04.132894 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.132896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvb5w\" (UniqueName: \"kubernetes.io/projected/28edbe43-9f3a-47f9-ba58-78d9c98ef1d4-kube-api-access-gvb5w\") pod \"ingress-canary-nd44b\" (UID: \"28edbe43-9f3a-47f9-ba58-78d9c98ef1d4\") " pod="openshift-ingress-canary/ingress-canary-nd44b" Jun 12 18:43:04.133174 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.132916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3276bc51-9677-4b76-a756-af3ea2b6e648-config-volume\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.133174 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.132931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh8mp\" (UniqueName: \"kubernetes.io/projected/3276bc51-9677-4b76-a756-af3ea2b6e648-kube-api-access-vh8mp\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.133174 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.132957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3276bc51-9677-4b76-a756-af3ea2b6e648-tmp-dir\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.133174 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:04.132965 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:04.133174 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:04.133039 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:04.633017154 +0000 UTC m=+36.589101211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:43:04.133389 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.133266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3276bc51-9677-4b76-a756-af3ea2b6e648-tmp-dir\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.133483 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.133463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3276bc51-9677-4b76-a756-af3ea2b6e648-config-volume\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.137190 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.137164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28edbe43-9f3a-47f9-ba58-78d9c98ef1d4-cert\") pod \"ingress-canary-nd44b\" (UID: \"28edbe43-9f3a-47f9-ba58-78d9c98ef1d4\") " pod="openshift-ingress-canary/ingress-canary-nd44b" Jun 12 18:43:04.144155 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.144126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvb5w\" (UniqueName: \"kubernetes.io/projected/28edbe43-9f3a-47f9-ba58-78d9c98ef1d4-kube-api-access-gvb5w\") pod \"ingress-canary-nd44b\" (UID: \"28edbe43-9f3a-47f9-ba58-78d9c98ef1d4\") " pod="openshift-ingress-canary/ingress-canary-nd44b" Jun 12 18:43:04.144296 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.144278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh8mp\" (UniqueName: \"kubernetes.io/projected/3276bc51-9677-4b76-a756-af3ea2b6e648-kube-api-access-vh8mp\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.224488 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.224456 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nd44b" Jun 12 18:43:04.435305 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.435238 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:43:04.435305 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.435281 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:43:04.435493 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.435238 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:43:04.438294 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.438273 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-knsbj\"" Jun 12 18:43:04.439691 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.439670 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:43:04.439796 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.439747 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:43:04.439796 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.439753 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g7n4k\"" Jun 12 18:43:04.439796 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.439749 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:43:04.439796 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.439791 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:43:04.442382 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.442364 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nd44b"] Jun 12 18:43:04.446075 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:43:04.446053 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28edbe43_9f3a_47f9_ba58_78d9c98ef1d4.slice/crio-42262691b9159f81d1b65ceb228d1c80b3ac7f4f01d63d864700e403ddfbec33 WatchSource:0}: Error finding container 42262691b9159f81d1b65ceb228d1c80b3ac7f4f01d63d864700e403ddfbec33: Status 404 returned error can't find the container with id 42262691b9159f81d1b65ceb228d1c80b3ac7f4f01d63d864700e403ddfbec33 Jun 12 18:43:04.620847 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.620815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nd44b" event={"ID":"28edbe43-9f3a-47f9-ba58-78d9c98ef1d4","Type":"ContainerStarted","Data":"42262691b9159f81d1b65ceb228d1c80b3ac7f4f01d63d864700e403ddfbec33"} Jun 12 18:43:04.636574 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:04.636542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:04.636741 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:04.636690 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:04.636809 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:04.636758 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:05.636737943 +0000 UTC m=+37.592822014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:43:05.646693 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:05.646657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:05.647033 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:05.646809 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:05.647033 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:05.646878 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:07.646860385 +0000 UTC m=+39.602944462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:43:06.627442 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:06.627260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nd44b" event={"ID":"28edbe43-9f3a-47f9-ba58-78d9c98ef1d4","Type":"ContainerStarted","Data":"4894177fc797d1fdd384fd44703570142d104272ddc8f0ba975c22f4fd2ca51b"} Jun 12 18:43:06.644250 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:06.644197 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nd44b" podStartSLOduration=1.611246606 podStartE2EDuration="3.644177233s" totalImagesPullingTime="2.032930627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:43:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:06.643701361 +0000 UTC m=+38.599785442" watchObservedRunningTime="2026-06-12 18:43:06.644177233 +0000 UTC m=+38.600261312" Jun 12 18:43:07.663245 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:07.663209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:07.663717 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:07.663365 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:07.663717 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:07.663424 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:11.663408869 +0000 UTC m=+43.619492926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:43:11.692033 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:11.691993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:11.692428 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:11.692161 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:11.692428 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:11.692226 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:19.692209803 +0000 UTC m=+51.648293864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:43:14.647675 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:14.647595 2559 generic.go:356] "Generic (PLEG): container finished" podID="51ccac4d-e403-42e2-9cfd-feb86d13ced2" containerID="8d01274b2fa0b92f6f244248eb8a8feb4150508c2157af60e72240adc1511d94" exitCode=0 Jun 12 18:43:14.647675 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:14.647658 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55dzb" event={"ID":"51ccac4d-e403-42e2-9cfd-feb86d13ced2","Type":"ContainerDied","Data":"8d01274b2fa0b92f6f244248eb8a8feb4150508c2157af60e72240adc1511d94"} Jun 12 18:43:15.653252 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:15.653212 2559 generic.go:356] "Generic (PLEG): container finished" podID="51ccac4d-e403-42e2-9cfd-feb86d13ced2" containerID="aab2a3adb291fccda21ffdd8a68fd6b97d3df7e1a3b2c50eb7dec820bb1078ff" exitCode=0 Jun 12 18:43:15.653637 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:15.653252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55dzb" event={"ID":"51ccac4d-e403-42e2-9cfd-feb86d13ced2","Type":"ContainerDied","Data":"aab2a3adb291fccda21ffdd8a68fd6b97d3df7e1a3b2c50eb7dec820bb1078ff"} Jun 12 18:43:16.658691 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:16.658659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-55dzb" event={"ID":"51ccac4d-e403-42e2-9cfd-feb86d13ced2","Type":"ContainerStarted","Data":"289afc48e610031e93a03b900f33e5cad208240327e777b225ed0144ac23b864"} Jun 12 18:43:16.682589 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:16.682533 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-55dzb" podStartSLOduration=9.321040503 podStartE2EDuration="48.682501305s" totalImagesPullingTime="39.361460802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:16.68053862 +0000 UTC m=+48.636622690" watchObservedRunningTime="2026-06-12 18:43:16.682501305 +0000 UTC m=+48.638585388" Jun 12 18:43:19.746759 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:19.746702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:19.747435 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:19.746885 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:19.747435 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:19.746970 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:35.746949474 +0000 UTC m=+67.703033533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:43:26.643702 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.643664 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq"] Jun 12 18:43:26.645667 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.645653 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.658378 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.658357 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 18:43:26.658665 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.658649 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 18:43:26.659242 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.659222 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 12 18:43:26.663449 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.663432 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 12 18:43:26.663929 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.663915 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 12 18:43:26.678437 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.678415 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 18:43:26.679574 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.679548 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq"] Jun 12 18:43:26.683419 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.683404 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 12 18:43:26.794695 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.794653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hknk9\" (UniqueName: \"kubernetes.io/projected/56ef3b29-07a4-4384-b760-318e552bfe91-kube-api-access-hknk9\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.794695 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.794693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ef3b29-07a4-4384-b760-318e552bfe91-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.794933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.794713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.794933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.794756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-hub\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.794933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.794784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-ca\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.794933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.794834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.895900 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.895815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-ca\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.895900 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.895851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.895900 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.895887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hknk9\" (UniqueName: \"kubernetes.io/projected/56ef3b29-07a4-4384-b760-318e552bfe91-kube-api-access-hknk9\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.896141 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.895914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ef3b29-07a4-4384-b760-318e552bfe91-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.896141 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.895942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.896141 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.896001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-hub\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.896667 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.896640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ef3b29-07a4-4384-b760-318e552bfe91-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.899333 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.899307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-ca\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.899476 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.899455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-hub\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.899570 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.899555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.899655 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.899637 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56ef3b29-07a4-4384-b760-318e552bfe91-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.906116 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.906090 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hknk9\" (UniqueName: \"kubernetes.io/projected/56ef3b29-07a4-4384-b760-318e552bfe91-kube-api-access-hknk9\") pod \"cluster-proxy-proxy-agent-7bff6bc99d-dv8nq\" (UID: \"56ef3b29-07a4-4384-b760-318e552bfe91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:26.963236 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:26.963209 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:43:27.085989 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:27.085957 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq"] Jun 12 18:43:27.088864 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:43:27.088841 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56ef3b29_07a4_4384_b760_318e552bfe91.slice/crio-b8a51a8a1e6449781ad2b756aee31672d67b73d4819cd31e43641faf3ed7d6c0 WatchSource:0}: Error finding container b8a51a8a1e6449781ad2b756aee31672d67b73d4819cd31e43641faf3ed7d6c0: Status 404 returned error can't find the container with id b8a51a8a1e6449781ad2b756aee31672d67b73d4819cd31e43641faf3ed7d6c0 Jun 12 18:43:27.683500 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:27.683467 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" event={"ID":"56ef3b29-07a4-4384-b760-318e552bfe91","Type":"ContainerStarted","Data":"b8a51a8a1e6449781ad2b756aee31672d67b73d4819cd31e43641faf3ed7d6c0"} Jun 12 18:43:30.619875 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:30.619840 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8rzwn" Jun 12 18:43:30.692892 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:30.692858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" event={"ID":"56ef3b29-07a4-4384-b760-318e552bfe91","Type":"ContainerStarted","Data":"e3816163a1fd993f7ff9c40710499e489f54ac25af59b17a04233ab7fc1e2312"} Jun 12 18:43:30.693006 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:30.692906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" event={"ID":"56ef3b29-07a4-4384-b760-318e552bfe91","Type":"ContainerStarted","Data":"638e8ba513e6333f95bb2d2840668d9f1ed1cf91c6486aada2dc6a0eeb63e98f"} Jun 12 18:43:31.697136 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:31.697104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" event={"ID":"56ef3b29-07a4-4384-b760-318e552bfe91","Type":"ContainerStarted","Data":"a067da379f084c826cb343f00ab91f3ba126828cdcd9f7f42629137be265061e"} Jun 12 18:43:31.715377 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:31.715323 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" podStartSLOduration=2.268785193 podStartE2EDuration="5.715307972s" totalImagesPullingTime="3.446522779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:31.714660827 +0000 UTC m=+63.670744905" watchObservedRunningTime="2026-06-12 18:43:31.715307972 +0000 UTC m=+63.671392050" Jun 12 18:43:34.149289 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.149242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:43:34.149289 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.149302 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:43:34.152325 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.152303 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:43:34.152325 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.152312 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:43:34.160070 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:34.160041 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:43:34.160182 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:34.160114 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:44:38.160091354 +0000 UTC m=+130.116175432 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : secret "metrics-daemon-secret" not found Jun 12 18:43:34.162019 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.162002 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/767bbb80-13c3-40bd-a9f4-cb65eddd3f6e-original-pull-secret\") pod \"global-pull-secret-syncer-c9dvj\" (UID: \"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e\") " pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:43:34.250604 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.250564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:43:34.253710 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.253690 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:43:34.264000 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.263982 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:43:34.273638 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.273614 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqrf\" (UniqueName: \"kubernetes.io/projected/4b3ec26b-d2c8-4697-b446-2ec3d1af6969-kube-api-access-xgqrf\") pod \"network-check-target-42b55\" (UID: \"4b3ec26b-d2c8-4697-b446-2ec3d1af6969\") " pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:43:34.452381 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.452354 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c9dvj" Jun 12 18:43:34.460153 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.460127 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-knsbj\"" Jun 12 18:43:34.467587 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.467558 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:43:34.595673 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.595633 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c9dvj"] Jun 12 18:43:34.599096 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:43:34.599076 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767bbb80_13c3_40bd_a9f4_cb65eddd3f6e.slice/crio-e4dd77f947ddec1d3590dbe2087da9aa70d2609724e80e44a57340b466c3e225 WatchSource:0}: Error finding container e4dd77f947ddec1d3590dbe2087da9aa70d2609724e80e44a57340b466c3e225: Status 404 returned error can't find the container with id e4dd77f947ddec1d3590dbe2087da9aa70d2609724e80e44a57340b466c3e225 Jun 12 18:43:34.604480 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.604459 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-42b55"] Jun 12 18:43:34.607604 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:43:34.607578 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3ec26b_d2c8_4697_b446_2ec3d1af6969.slice/crio-6aea4f756b1ae74e9315d0e9e3a452043cd8c05b61f604cb94e43da0c33fb918 WatchSource:0}: Error finding container 6aea4f756b1ae74e9315d0e9e3a452043cd8c05b61f604cb94e43da0c33fb918: Status 404 returned error can't find the container with id 6aea4f756b1ae74e9315d0e9e3a452043cd8c05b61f604cb94e43da0c33fb918 Jun 12 18:43:34.705930 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.705828 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-42b55" event={"ID":"4b3ec26b-d2c8-4697-b446-2ec3d1af6969","Type":"ContainerStarted","Data":"6aea4f756b1ae74e9315d0e9e3a452043cd8c05b61f604cb94e43da0c33fb918"} Jun 12 18:43:34.706840 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:34.706818 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c9dvj" event={"ID":"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e","Type":"ContainerStarted","Data":"e4dd77f947ddec1d3590dbe2087da9aa70d2609724e80e44a57340b466c3e225"} Jun 12 18:43:35.762287 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:35.762247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:43:35.762801 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:35.762376 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:35.762801 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:43:35.762467 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:44:07.76244155 +0000 UTC m=+99.718525625 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:43:39.726458 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:39.726420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-42b55" event={"ID":"4b3ec26b-d2c8-4697-b446-2ec3d1af6969","Type":"ContainerStarted","Data":"7039f472a148314394840e1eb895f3cb3630e6bb3d13ace2e1c33bee72dce346"} Jun 12 18:43:39.726948 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:39.726534 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:43:39.727847 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:39.727821 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c9dvj" event={"ID":"767bbb80-13c3-40bd-a9f4-cb65eddd3f6e","Type":"ContainerStarted","Data":"5b951553f373bf79e02486402fcadf5016b2257760b6d9b455aea00719ffe3e9"} Jun 12 18:43:39.743855 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:39.743805 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-42b55" podStartSLOduration=67.296613453 podStartE2EDuration="1m11.743791923s" totalImagesPullingTime="4.44717847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:39.743233766 +0000 UTC m=+71.699317860" watchObservedRunningTime="2026-06-12 18:43:39.743791923 +0000 UTC m=+71.699876001" Jun 12 18:43:39.759225 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:43:39.759180 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c9dvj" podStartSLOduration=67.301129918 podStartE2EDuration="1m11.759166257s" totalImagesPullingTime="4.458036339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:39.75812513 +0000 UTC m=+71.714209229" watchObservedRunningTime="2026-06-12 18:43:39.759166257 +0000 UTC m=+71.715250337" Jun 12 18:44:07.784004 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:44:07.783866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:44:07.784474 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:44:07.784026 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:44:07.784474 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:44:07.784089 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:45:11.784073808 +0000 UTC m=+163.740157878 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:44:10.733023 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:44:10.732988 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-42b55" Jun 12 18:44:38.195339 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:44:38.195280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:44:38.195858 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:44:38.195433 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:44:38.195858 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:44:38.195532 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs podName:0d94de43-46c3-46b0-a2a0-5fad08021d00 nodeName:}" failed. No retries permitted until 2026-06-12 18:46:40.195497083 +0000 UTC m=+252.151581157 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs") pod "network-metrics-daemon-w9jgg" (UID: "0d94de43-46c3-46b0-a2a0-5fad08021d00") : secret "metrics-daemon-secret" not found Jun 12 18:45:06.914828 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:45:06.914785 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zsflt" podUID="3276bc51-9677-4b76-a756-af3ea2b6e648" Jun 12 18:45:06.978840 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:45:06.978813 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsflt" Jun 12 18:45:07.447269 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:45:07.447234 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w9jgg" podUID="0d94de43-46c3-46b0-a2a0-5fad08021d00" Jun 12 18:45:11.826121 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:45:11.826082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:45:11.826554 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:45:11.826235 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:45:11.826554 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:45:11.826300 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls podName:3276bc51-9677-4b76-a756-af3ea2b6e648 nodeName:}" failed. No retries permitted until 2026-06-12 18:47:13.82628385 +0000 UTC m=+285.782367906 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls") pod "dns-default-zsflt" (UID: "3276bc51-9677-4b76-a756-af3ea2b6e648") : secret "dns-default-metrics-tls" not found Jun 12 18:45:20.434552 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:45:20.434451 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:46:05.799804 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.799769 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6"] Jun 12 18:46:05.801625 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.801610 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:05.804693 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.804666 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 12 18:46:05.804693 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.804681 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 12 18:46:05.804923 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.804714 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 12 18:46:05.804923 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.804724 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:46:05.805969 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.805952 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tgqm6\"" Jun 12 18:46:05.815208 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.815186 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6"] Jun 12 18:46:05.897967 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.897930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhxsn\" (UniqueName: \"kubernetes.io/projected/f9997ce2-45a9-4334-89ce-0e4215941d8e-kube-api-access-qhxsn\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:05.898159 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.898007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9997ce2-45a9-4334-89ce-0e4215941d8e-config\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:05.898159 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.898065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9997ce2-45a9-4334-89ce-0e4215941d8e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:05.998709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.998668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9997ce2-45a9-4334-89ce-0e4215941d8e-config\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:05.998709 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.998711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9997ce2-45a9-4334-89ce-0e4215941d8e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:05.998921 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.998731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhxsn\" (UniqueName: \"kubernetes.io/projected/f9997ce2-45a9-4334-89ce-0e4215941d8e-kube-api-access-qhxsn\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:05.999295 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:05.999277 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9997ce2-45a9-4334-89ce-0e4215941d8e-config\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:06.000908 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:06.000890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9997ce2-45a9-4334-89ce-0e4215941d8e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:06.007279 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:06.007246 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhxsn\" (UniqueName: \"kubernetes.io/projected/f9997ce2-45a9-4334-89ce-0e4215941d8e-kube-api-access-qhxsn\") pod \"service-ca-operator-7ccbfd59dc-2chc6\" (UID: \"f9997ce2-45a9-4334-89ce-0e4215941d8e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:06.109814 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:06.109718 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" Jun 12 18:46:06.229617 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:06.229584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6"] Jun 12 18:46:06.232884 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:06.232851 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9997ce2_45a9_4334_89ce_0e4215941d8e.slice/crio-991a27090b37f310342e64f51867a3d4d8a339499284126610775cda9e07439b WatchSource:0}: Error finding container 991a27090b37f310342e64f51867a3d4d8a339499284126610775cda9e07439b: Status 404 returned error can't find the container with id 991a27090b37f310342e64f51867a3d4d8a339499284126610775cda9e07439b Jun 12 18:46:07.143470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:07.143433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" event={"ID":"f9997ce2-45a9-4334-89ce-0e4215941d8e","Type":"ContainerStarted","Data":"991a27090b37f310342e64f51867a3d4d8a339499284126610775cda9e07439b"} Jun 12 18:46:09.153069 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.153035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" event={"ID":"f9997ce2-45a9-4334-89ce-0e4215941d8e","Type":"ContainerStarted","Data":"133cd9216056a8bf5c4fd2d507798833bf469a1b399ab2757c22d19f6f29db46"} Jun 12 18:46:09.169988 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.169935 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" podStartSLOduration=2.00434447 podStartE2EDuration="4.169916264s" totalImagesPullingTime="2.165571794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:09.168863155 +0000 UTC m=+221.124947233" watchObservedRunningTime="2026-06-12 18:46:09.169916264 +0000 UTC m=+221.126000344" Jun 12 18:46:09.731829 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.731795 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cc5wp"] Jun 12 18:46:09.735951 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.734641 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.737991 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.737969 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-btpxq\"" Jun 12 18:46:09.739365 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.739349 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 18:46:09.739458 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.739377 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 18:46:09.739458 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.739377 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 18:46:09.739596 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.739379 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 18:46:09.762403 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.762378 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cc5wp"] Jun 12 18:46:09.830080 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.830051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89dd6b03-ffb3-4c94-95d6-49a88430211f-data-volume\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.830256 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.830109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.830256 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.830171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.830256 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.830207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj4qr\" (UniqueName: \"kubernetes.io/projected/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-api-access-pj4qr\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.830256 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.830245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89dd6b03-ffb3-4c94-95d6-49a88430211f-crio-socket\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.931074 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.931041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.931074 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.931077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.931329 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.931097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj4qr\" (UniqueName: \"kubernetes.io/projected/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-api-access-pj4qr\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.931329 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.931127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89dd6b03-ffb3-4c94-95d6-49a88430211f-crio-socket\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.931329 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:09.931163 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:09.931329 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:09.931191 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:09.931329 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.931167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89dd6b03-ffb3-4c94-95d6-49a88430211f-data-volume\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.931329 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:09.931233 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:10.431214014 +0000 UTC m=+222.387298070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : configmap "kube-rbac-proxy" not found Jun 12 18:46:09.931329 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:09.931261 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:10.431254035 +0000 UTC m=+222.387338092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:09.931329 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.931271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89dd6b03-ffb3-4c94-95d6-49a88430211f-crio-socket\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.931687 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.931464 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89dd6b03-ffb3-4c94-95d6-49a88430211f-data-volume\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:09.942032 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:09.942007 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj4qr\" (UniqueName: \"kubernetes.io/projected/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-api-access-pj4qr\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:10.435156 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:10.435101 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:10.435156 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:10.435160 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:10.435654 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:10.435240 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:10.435654 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:10.435288 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:10.435654 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:10.435325 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:11.435297203 +0000 UTC m=+223.391381262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : configmap "kube-rbac-proxy" not found Jun 12 18:46:10.435654 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:10.435349 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:11.435333315 +0000 UTC m=+223.391417371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:11.443669 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:11.443631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:11.443669 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:11.443666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:11.444151 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:11.443755 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:11.444151 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:11.443776 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:11.444151 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:11.443824 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:13.443811283 +0000 UTC m=+225.399895343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:11.444151 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:11.443837 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:13.443831179 +0000 UTC m=+225.399915236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : configmap "kube-rbac-proxy" not found Jun 12 18:46:12.153433 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.153394 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-bwph2"] Jun 12 18:46:12.156582 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.156565 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.161396 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.161374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 12 18:46:12.161710 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.161694 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bdx75\"" Jun 12 18:46:12.162426 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.162405 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 12 18:46:12.162532 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.162465 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 12 18:46:12.162722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.162708 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 12 18:46:12.175875 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.175854 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-bwph2"] Jun 12 18:46:12.249953 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.249924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-signing-cabundle\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.250131 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.249973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-signing-key\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.250131 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.250043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-579rs\" (UniqueName: \"kubernetes.io/projected/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-kube-api-access-579rs\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.350430 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.350393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-signing-cabundle\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.350611 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.350449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-signing-key\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.350611 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.350527 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-579rs\" (UniqueName: \"kubernetes.io/projected/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-kube-api-access-579rs\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.351063 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.351041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-signing-cabundle\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.352830 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.352808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-signing-key\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.359386 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.359362 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-579rs\" (UniqueName: \"kubernetes.io/projected/122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1-kube-api-access-579rs\") pod \"service-ca-7b994bc59-bwph2\" (UID: \"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1\") " pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.465633 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.465599 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-bwph2" Jun 12 18:46:12.574002 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.573979 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-72px9_ea99fb9a-6275-4e18-9fb5-37accb14df31/dns-node-resolver/0.log" Jun 12 18:46:12.596718 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:12.596692 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-bwph2"] Jun 12 18:46:12.600300 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:12.600271 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122ad7ef_bf31_4c6f_9fd9_d0a5700acbb1.slice/crio-3d647222b19714fb1058cc098e3ff8bbe611ed2b41b582f1a0bcdb58cd200fd7 WatchSource:0}: Error finding container 3d647222b19714fb1058cc098e3ff8bbe611ed2b41b582f1a0bcdb58cd200fd7: Status 404 returned error can't find the container with id 3d647222b19714fb1058cc098e3ff8bbe611ed2b41b582f1a0bcdb58cd200fd7 Jun 12 18:46:13.166134 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:13.166104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-bwph2" event={"ID":"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1","Type":"ContainerStarted","Data":"56b60e13fd554caf2e54dd3d3e3902e817df460b163ec4788f0588641228676d"} Jun 12 18:46:13.166305 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:13.166149 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-bwph2" event={"ID":"122ad7ef-bf31-4c6f-9fd9-d0a5700acbb1","Type":"ContainerStarted","Data":"3d647222b19714fb1058cc098e3ff8bbe611ed2b41b582f1a0bcdb58cd200fd7"} Jun 12 18:46:13.184891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:13.184834 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-bwph2" podStartSLOduration=1.184813942 podStartE2EDuration="1.184813942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:13.182528338 +0000 UTC m=+225.138612408" watchObservedRunningTime="2026-06-12 18:46:13.184813942 +0000 UTC m=+225.140898024" Jun 12 18:46:13.376275 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:13.376250 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bhlgq_a1b4c353-dfe3-42a7-8d3b-556fe4e6e758/node-ca/0.log" Jun 12 18:46:13.459039 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:13.458946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:13.459039 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:13.458981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:13.459237 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:13.459095 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:13.459237 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:13.459107 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:13.459237 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:13.459163 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:17.459147143 +0000 UTC m=+229.415231202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:13.459237 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:13.459178 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:17.459172136 +0000 UTC m=+229.415256192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : configmap "kube-rbac-proxy" not found Jun 12 18:46:14.368061 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:14.368031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nd44b_28edbe43-9f3a-47f9-ba58-78d9c98ef1d4/serve-healthcheck-canary/0.log" Jun 12 18:46:17.494264 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:17.494228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:17.494264 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:17.494268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:17.494771 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:17.494357 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:17.494771 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:17.494378 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:17.494771 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:17.494428 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:25.494412474 +0000 UTC m=+237.450496534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : configmap "kube-rbac-proxy" not found Jun 12 18:46:17.494771 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:17.494480 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls podName:89dd6b03-ffb3-4c94-95d6-49a88430211f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:25.494470671 +0000 UTC m=+237.450554730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cc5wp" (UID: "89dd6b03-ffb3-4c94-95d6-49a88430211f") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:25.553643 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:25.553608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:25.553643 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:25.553647 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:25.554225 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:25.554192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89dd6b03-ffb3-4c94-95d6-49a88430211f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:25.555948 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:25.555920 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89dd6b03-ffb3-4c94-95d6-49a88430211f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc5wp\" (UID: \"89dd6b03-ffb3-4c94-95d6-49a88430211f\") " pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:25.645078 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:25.645045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cc5wp" Jun 12 18:46:25.769220 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:25.769190 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cc5wp"] Jun 12 18:46:25.772217 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:25.772188 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89dd6b03_ffb3_4c94_95d6_49a88430211f.slice/crio-d852f7da953e6374dbd15a3a8c598edeef29f0f82bad2d5344f4ee9ee92bc193 WatchSource:0}: Error finding container d852f7da953e6374dbd15a3a8c598edeef29f0f82bad2d5344f4ee9ee92bc193: Status 404 returned error can't find the container with id d852f7da953e6374dbd15a3a8c598edeef29f0f82bad2d5344f4ee9ee92bc193 Jun 12 18:46:26.213055 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:26.212974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc5wp" event={"ID":"89dd6b03-ffb3-4c94-95d6-49a88430211f","Type":"ContainerStarted","Data":"d852f7da953e6374dbd15a3a8c598edeef29f0f82bad2d5344f4ee9ee92bc193"} Jun 12 18:46:29.224979 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:29.224939 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc5wp" event={"ID":"89dd6b03-ffb3-4c94-95d6-49a88430211f","Type":"ContainerStarted","Data":"c52f09ccf4b0f4a3f91df3301a59cd9d9065f727457564665729429ad9158f37"} Jun 12 18:46:30.231692 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:30.231655 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc5wp" event={"ID":"89dd6b03-ffb3-4c94-95d6-49a88430211f","Type":"ContainerStarted","Data":"5ef7ae9b5924e49ed615a0db945dd87ae5447a1f31b58c18efa152847cede43a"} Jun 12 18:46:32.240395 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.240353 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc5wp" event={"ID":"89dd6b03-ffb3-4c94-95d6-49a88430211f","Type":"ContainerStarted","Data":"c20f612e530790fbf3bd0b5f34e839390081e0e6e01b55e5ebd41cde5a9c2258"} Jun 12 18:46:32.260204 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.260155 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cc5wp" podStartSLOduration=17.645863459 podStartE2EDuration="23.260139089s" totalImagesPullingTime="5.61427563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:46:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:32.258169523 +0000 UTC m=+244.214253635" watchObservedRunningTime="2026-06-12 18:46:32.260139089 +0000 UTC m=+244.216223168" Jun 12 18:46:32.761585 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.761551 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-b7b9w"] Jun 12 18:46:32.764344 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.764328 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-b7b9w" Jun 12 18:46:32.767467 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.767437 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 18:46:32.767612 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.767532 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 18:46:32.767612 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.767546 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tbgz2\"" Jun 12 18:46:32.788872 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.788843 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-b7b9w"] Jun 12 18:46:32.908394 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:32.908358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljbwf\" (UniqueName: \"kubernetes.io/projected/9a70aab3-2a5e-484d-a56b-08f10c93eaa4-kube-api-access-ljbwf\") pod \"downloads-694c955b9-b7b9w\" (UID: \"9a70aab3-2a5e-484d-a56b-08f10c93eaa4\") " pod="openshift-console/downloads-694c955b9-b7b9w" Jun 12 18:46:33.009282 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:33.009240 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljbwf\" (UniqueName: \"kubernetes.io/projected/9a70aab3-2a5e-484d-a56b-08f10c93eaa4-kube-api-access-ljbwf\") pod \"downloads-694c955b9-b7b9w\" (UID: \"9a70aab3-2a5e-484d-a56b-08f10c93eaa4\") " pod="openshift-console/downloads-694c955b9-b7b9w" Jun 12 18:46:33.017735 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:33.017667 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljbwf\" (UniqueName: \"kubernetes.io/projected/9a70aab3-2a5e-484d-a56b-08f10c93eaa4-kube-api-access-ljbwf\") pod \"downloads-694c955b9-b7b9w\" (UID: \"9a70aab3-2a5e-484d-a56b-08f10c93eaa4\") " pod="openshift-console/downloads-694c955b9-b7b9w" Jun 12 18:46:33.072763 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:33.072729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-b7b9w" Jun 12 18:46:33.204692 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:33.204657 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-b7b9w"] Jun 12 18:46:33.209051 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:33.209024 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a70aab3_2a5e_484d_a56b_08f10c93eaa4.slice/crio-db33f2178e9bcfcb9a1ac14df9db1909680a79d60d00e6be6d8bd59c3760bd1f WatchSource:0}: Error finding container db33f2178e9bcfcb9a1ac14df9db1909680a79d60d00e6be6d8bd59c3760bd1f: Status 404 returned error can't find the container with id db33f2178e9bcfcb9a1ac14df9db1909680a79d60d00e6be6d8bd59c3760bd1f Jun 12 18:46:33.244346 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:33.244313 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-b7b9w" event={"ID":"9a70aab3-2a5e-484d-a56b-08f10c93eaa4","Type":"ContainerStarted","Data":"db33f2178e9bcfcb9a1ac14df9db1909680a79d60d00e6be6d8bd59c3760bd1f"} Jun 12 18:46:35.815141 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.815106 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x"] Jun 12 18:46:35.818394 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.818373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:35.822722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.822468 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 18:46:35.822722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.822492 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 18:46:35.822722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.822504 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 18:46:35.822722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.822587 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bbtn7\"" Jun 12 18:46:35.822722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.822470 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 18:46:35.822722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.822474 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 18:46:35.829809 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.828845 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x"] Jun 12 18:46:35.931405 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.931367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f02022-93f0-449a-b645-c538b42ade99-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:35.931599 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.931566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f02022-93f0-449a-b645-c538b42ade99-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:35.931655 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.931606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/58f02022-93f0-449a-b645-c538b42ade99-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:35.931711 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:35.931659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpd6v\" (UniqueName: \"kubernetes.io/projected/58f02022-93f0-449a-b645-c538b42ade99-kube-api-access-mpd6v\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.032690 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.032653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f02022-93f0-449a-b645-c538b42ade99-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.032878 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.032699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/58f02022-93f0-449a-b645-c538b42ade99-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.032878 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.032728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpd6v\" (UniqueName: \"kubernetes.io/projected/58f02022-93f0-449a-b645-c538b42ade99-kube-api-access-mpd6v\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.032878 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.032750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f02022-93f0-449a-b645-c538b42ade99-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.033486 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.033454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f02022-93f0-449a-b645-c538b42ade99-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.035157 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.035135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/58f02022-93f0-449a-b645-c538b42ade99-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.035248 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.035159 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f02022-93f0-449a-b645-c538b42ade99-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.041430 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.041409 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpd6v\" (UniqueName: \"kubernetes.io/projected/58f02022-93f0-449a-b645-c538b42ade99-kube-api-access-mpd6v\") pod \"prometheus-operator-864fcfc6f9-ndg9x\" (UID: \"58f02022-93f0-449a-b645-c538b42ade99\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.132745 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.132661 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" Jun 12 18:46:36.273933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:36.273844 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x"] Jun 12 18:46:36.276502 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:36.276460 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f02022_93f0_449a_b645_c538b42ade99.slice/crio-80a0dc66af6f733aab5fd0036ddb31f1676b41a6c9b97fc216830088f047df6e WatchSource:0}: Error finding container 80a0dc66af6f733aab5fd0036ddb31f1676b41a6c9b97fc216830088f047df6e: Status 404 returned error can't find the container with id 80a0dc66af6f733aab5fd0036ddb31f1676b41a6c9b97fc216830088f047df6e Jun 12 18:46:37.261422 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:37.261387 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" event={"ID":"58f02022-93f0-449a-b645-c538b42ade99","Type":"ContainerStarted","Data":"80a0dc66af6f733aab5fd0036ddb31f1676b41a6c9b97fc216830088f047df6e"} Jun 12 18:46:38.267836 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:38.267797 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" event={"ID":"58f02022-93f0-449a-b645-c538b42ade99","Type":"ContainerStarted","Data":"9aff4a8fb7928f9d0f130074062429849a5a31f051b2a5b8005ec491644b4beb"} Jun 12 18:46:38.268272 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:38.267861 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" event={"ID":"58f02022-93f0-449a-b645-c538b42ade99","Type":"ContainerStarted","Data":"7b4908c09f66644980c97376ee2919ed049e5561ae642eb7fbe1abdafbe6cbaa"} Jun 12 18:46:38.291960 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:38.291911 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ndg9x" podStartSLOduration=1.822411984 podStartE2EDuration="3.291895337s" totalImagesPullingTime="1.469483353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:38.290077067 +0000 UTC m=+250.246161147" watchObservedRunningTime="2026-06-12 18:46:38.291895337 +0000 UTC m=+250.247979416" Jun 12 18:46:40.198040 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.197945 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2sdh7"] Jun 12 18:46:40.202041 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.202013 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.204775 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.204622 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 18:46:40.204775 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.204638 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-89dlx\"" Jun 12 18:46:40.204932 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.204894 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 18:46:40.205051 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.205032 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 18:46:40.266900 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.266852 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:46:40.269523 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.269487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d94de43-46c3-46b0-a2a0-5fad08021d00-metrics-certs\") pod \"network-metrics-daemon-w9jgg\" (UID: \"0d94de43-46c3-46b0-a2a0-5fad08021d00\") " pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:46:40.367473 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-sys\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.367473 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367478 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-tls\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.367736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367539 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-metrics-client-ca\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.367736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.367736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367609 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-root\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.367736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-wtmp\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.367736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-textfile\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.367736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.367736 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.367717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djn8b\" (UniqueName: \"kubernetes.io/projected/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-kube-api-access-djn8b\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djn8b\" (UniqueName: \"kubernetes.io/projected/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-kube-api-access-djn8b\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468383 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-sys\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468383 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-tls\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468383 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-metrics-client-ca\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468383 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468383 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-root\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468383 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-wtmp\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468383 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-textfile\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.468745 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-textfile\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.469233 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468855 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.469233 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-sys\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.469233 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.468949 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-root\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.469233 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:40.468971 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 18:46:40.469233 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:46:40.469028 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-tls podName:a1ff73da-ae44-4a71-b76e-e680f8e1f1f7 nodeName:}" failed. No retries permitted until 2026-06-12 18:46:40.969010737 +0000 UTC m=+252.925094806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-tls") pod "node-exporter-2sdh7" (UID: "a1ff73da-ae44-4a71-b76e-e680f8e1f1f7") : secret "node-exporter-tls" not found Jun 12 18:46:40.469233 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.469037 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-metrics-client-ca\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.469233 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.469075 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-wtmp\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.471761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.471740 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.479155 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.479098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djn8b\" (UniqueName: \"kubernetes.io/projected/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-kube-api-access-djn8b\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.538606 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.538574 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g7n4k\"" Jun 12 18:46:40.546892 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.546866 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9jgg" Jun 12 18:46:40.699351 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.699264 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w9jgg"] Jun 12 18:46:40.703287 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:40.703246 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d94de43_46c3_46b0_a2a0_5fad08021d00.slice/crio-fe7ff627cf326fce2886bd8aef82fb311b4fc1569761e51a885ef888eefb5b47 WatchSource:0}: Error finding container fe7ff627cf326fce2886bd8aef82fb311b4fc1569761e51a885ef888eefb5b47: Status 404 returned error can't find the container with id fe7ff627cf326fce2886bd8aef82fb311b4fc1569761e51a885ef888eefb5b47 Jun 12 18:46:40.973505 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.973470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-tls\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:40.976188 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:40.976164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1ff73da-ae44-4a71-b76e-e680f8e1f1f7-node-exporter-tls\") pod \"node-exporter-2sdh7\" (UID: \"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7\") " pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:41.115616 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:41.115580 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2sdh7" Jun 12 18:46:41.129635 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:41.129605 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ff73da_ae44_4a71_b76e_e680f8e1f1f7.slice/crio-b324ee9febd6d02e6e37b7fdfce1bca721acbf566d8fb579a2330f8b68c18721 WatchSource:0}: Error finding container b324ee9febd6d02e6e37b7fdfce1bca721acbf566d8fb579a2330f8b68c18721: Status 404 returned error can't find the container with id b324ee9febd6d02e6e37b7fdfce1bca721acbf566d8fb579a2330f8b68c18721 Jun 12 18:46:41.280862 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:41.280776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9jgg" event={"ID":"0d94de43-46c3-46b0-a2a0-5fad08021d00","Type":"ContainerStarted","Data":"fe7ff627cf326fce2886bd8aef82fb311b4fc1569761e51a885ef888eefb5b47"} Jun 12 18:46:41.282731 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:41.282693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sdh7" event={"ID":"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7","Type":"ContainerStarted","Data":"b324ee9febd6d02e6e37b7fdfce1bca721acbf566d8fb579a2330f8b68c18721"} Jun 12 18:46:42.288656 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:42.288614 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9jgg" event={"ID":"0d94de43-46c3-46b0-a2a0-5fad08021d00","Type":"ContainerStarted","Data":"7742acff78146a7d4398e02bf93dcff69a2bfa678c6016efdb7644830a4eb795"} Jun 12 18:46:42.289126 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:42.288680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9jgg" event={"ID":"0d94de43-46c3-46b0-a2a0-5fad08021d00","Type":"ContainerStarted","Data":"f5f0f186c6810162267d934669730fcc09e87ea405faedd9f58c57c1e8279cc3"} Jun 12 18:46:42.307571 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:42.307466 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w9jgg" podStartSLOduration=253.286075979 podStartE2EDuration="4m14.307444285s" totalImagesPullingTime="1.021368306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:42.306871158 +0000 UTC m=+254.262955250" watchObservedRunningTime="2026-06-12 18:46:42.307444285 +0000 UTC m=+254.263528365" Jun 12 18:46:43.157767 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.157725 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-ccf9b8d46-552s4"] Jun 12 18:46:43.162294 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.162269 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.165233 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.165172 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 18:46:43.165416 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.165396 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 18:46:43.165541 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.165438 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6p9vdb714ugp6\"" Jun 12 18:46:43.165541 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.165467 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hshqd\"" Jun 12 18:46:43.165661 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.165173 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 18:46:43.165661 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.165571 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 18:46:43.166400 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.166341 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 18:46:43.173940 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.173916 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ccf9b8d46-552s4"] Jun 12 18:46:43.187831 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.187803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-grpc-tls\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.187993 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.187856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.187993 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.187913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.187993 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.187944 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48fe0e72-5494-4902-8f6c-4d23cabcf27b-metrics-client-ca\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.187993 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.187970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mddwp\" (UniqueName: \"kubernetes.io/projected/48fe0e72-5494-4902-8f6c-4d23cabcf27b-kube-api-access-mddwp\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.188188 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.188045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-tls\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.188188 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.188099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.188188 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.188121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.288570 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.288530 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48fe0e72-5494-4902-8f6c-4d23cabcf27b-metrics-client-ca\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.288764 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.288584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mddwp\" (UniqueName: \"kubernetes.io/projected/48fe0e72-5494-4902-8f6c-4d23cabcf27b-kube-api-access-mddwp\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.288764 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.288635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-tls\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.288764 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.288671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.288764 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.288698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.288764 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.288735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-grpc-tls\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.289347 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.288775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.289347 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.288809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.289461 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.289376 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48fe0e72-5494-4902-8f6c-4d23cabcf27b-metrics-client-ca\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.293894 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.293834 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-tls\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.294014 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.293987 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.295436 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.295361 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-grpc-tls\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.296954 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.296930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.297619 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.297567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.299539 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.298303 2559 generic.go:356] "Generic (PLEG): container finished" podID="a1ff73da-ae44-4a71-b76e-e680f8e1f1f7" containerID="046738ea5738b56f34df1a00d915dc920fefa05290f4a2541293219a46fa737a" exitCode=0 Jun 12 18:46:43.299539 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.299291 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sdh7" event={"ID":"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7","Type":"ContainerDied","Data":"046738ea5738b56f34df1a00d915dc920fefa05290f4a2541293219a46fa737a"} Jun 12 18:46:43.299973 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.299565 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48fe0e72-5494-4902-8f6c-4d23cabcf27b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.299973 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.299689 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mddwp\" (UniqueName: \"kubernetes.io/projected/48fe0e72-5494-4902-8f6c-4d23cabcf27b-kube-api-access-mddwp\") pod \"thanos-querier-ccf9b8d46-552s4\" (UID: \"48fe0e72-5494-4902-8f6c-4d23cabcf27b\") " pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:43.474622 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:43.474537 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:44.309234 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.309194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sdh7" event={"ID":"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7","Type":"ContainerStarted","Data":"d0eced44bb66be8982a17ebea55bd76913fe5a447146f1b7f99a3986f13de0d3"} Jun 12 18:46:44.471261 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.471223 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c6f58749c-nc4z9"] Jun 12 18:46:44.474881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.474852 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.477959 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.477796 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 12 18:46:44.477959 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.477808 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 18:46:44.479312 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.479288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 12 18:46:44.479441 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.479350 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c1ukn7jiamq0q\"" Jun 12 18:46:44.479441 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.479288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rfql8\"" Jun 12 18:46:44.479441 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.479398 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 12 18:46:44.483696 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.483674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c6f58749c-nc4z9"] Jun 12 18:46:44.503681 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.503633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-secret-metrics-server-tls\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.503785 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.503700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-secret-metrics-server-client-certs\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.503785 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.503749 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7cb\" (UniqueName: \"kubernetes.io/projected/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-kube-api-access-wd7cb\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.503872 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.503784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-client-ca-bundle\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.503872 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.503808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-audit-log\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.503872 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.503834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.504011 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.503878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-metrics-server-audit-profiles\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.605249 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.605162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-client-ca-bundle\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.605249 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.605219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-audit-log\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.605470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.605260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.605470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.605291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-metrics-server-audit-profiles\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.605470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.605353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-secret-metrics-server-tls\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.605470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.605408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-secret-metrics-server-client-certs\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.605470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.605434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7cb\" (UniqueName: \"kubernetes.io/projected/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-kube-api-access-wd7cb\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.605767 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.605706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-audit-log\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.606368 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.606335 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.606634 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.606610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-metrics-server-audit-profiles\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.608459 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.608436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-secret-metrics-server-client-certs\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.608595 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.608470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-secret-metrics-server-tls\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.609131 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.609108 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-client-ca-bundle\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.614273 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.614252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7cb\" (UniqueName: \"kubernetes.io/projected/b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91-kube-api-access-wd7cb\") pod \"metrics-server-c6f58749c-nc4z9\" (UID: \"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91\") " pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:44.788677 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:44.788633 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:46:50.685037 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:50.685014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ccf9b8d46-552s4"] Jun 12 18:46:50.686376 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:50.686349 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fe0e72_5494_4902_8f6c_4d23cabcf27b.slice/crio-26ae13ad7fa6c7494b923befc98d9d39e2f99c63ada824fc68545e9934b2a5bf WatchSource:0}: Error finding container 26ae13ad7fa6c7494b923befc98d9d39e2f99c63ada824fc68545e9934b2a5bf: Status 404 returned error can't find the container with id 26ae13ad7fa6c7494b923befc98d9d39e2f99c63ada824fc68545e9934b2a5bf Jun 12 18:46:50.690438 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:50.690414 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c6f58749c-nc4z9"] Jun 12 18:46:50.693123 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:46:50.693089 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5030eaa_d5e1_4b34_b5a5_f5b4bb6a0b91.slice/crio-1ddb115ef656179672ca59eab62b9cbb0424a9dbf9f0788f61eff6361eebde90 WatchSource:0}: Error finding container 1ddb115ef656179672ca59eab62b9cbb0424a9dbf9f0788f61eff6361eebde90: Status 404 returned error can't find the container with id 1ddb115ef656179672ca59eab62b9cbb0424a9dbf9f0788f61eff6361eebde90 Jun 12 18:46:51.344338 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:51.344289 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" event={"ID":"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91","Type":"ContainerStarted","Data":"1ddb115ef656179672ca59eab62b9cbb0424a9dbf9f0788f61eff6361eebde90"} Jun 12 18:46:51.347294 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:51.347208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" event={"ID":"48fe0e72-5494-4902-8f6c-4d23cabcf27b","Type":"ContainerStarted","Data":"26ae13ad7fa6c7494b923befc98d9d39e2f99c63ada824fc68545e9934b2a5bf"} Jun 12 18:46:51.351213 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:51.350938 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2sdh7" event={"ID":"a1ff73da-ae44-4a71-b76e-e680f8e1f1f7","Type":"ContainerStarted","Data":"a11b28328aa3414bf82b06ca0fb426f5e6bf1e7cae0a8e105602e23ffe54963e"} Jun 12 18:46:51.354112 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:51.354004 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-b7b9w" event={"ID":"9a70aab3-2a5e-484d-a56b-08f10c93eaa4","Type":"ContainerStarted","Data":"39c39edad086a376bd4685c917c5808931fafb0e73e605f0cf073119775c7bc1"} Jun 12 18:46:51.354307 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:51.354246 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-b7b9w" Jun 12 18:46:51.364416 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:51.364354 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-b7b9w" Jun 12 18:46:51.413549 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:51.413345 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2sdh7" podStartSLOduration=9.964427851 podStartE2EDuration="11.413323404s" totalImagesPullingTime="1.379705587s" totalInitContainerRuntime="69.189966ms" isStatefulPod=true podCreationTimestamp="2026-06-12 18:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:51.411757667 +0000 UTC m=+263.367841757" watchObservedRunningTime="2026-06-12 18:46:51.413323404 +0000 UTC m=+263.369407487" Jun 12 18:46:51.436396 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:51.435138 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-b7b9w" podStartSLOduration=1.9982481939999999 podStartE2EDuration="19.435114748s" totalImagesPullingTime="17.436866554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:51.433902566 +0000 UTC m=+263.389986646" watchObservedRunningTime="2026-06-12 18:46:51.435114748 +0000 UTC m=+263.391198832" Jun 12 18:46:54.370161 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:54.369804 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" event={"ID":"b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91","Type":"ContainerStarted","Data":"745109acb425c8f09d7dcf187d9b51d3b91e23d7f516b079af9fd5992047104e"} Jun 12 18:46:54.372677 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:54.372649 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" event={"ID":"48fe0e72-5494-4902-8f6c-4d23cabcf27b","Type":"ContainerStarted","Data":"2075eb2e2753772b009f3cc474514bd3c2abf9512506d061afcd245f08d3d8db"} Jun 12 18:46:54.372810 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:54.372731 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" event={"ID":"48fe0e72-5494-4902-8f6c-4d23cabcf27b","Type":"ContainerStarted","Data":"7e4eed55557ea0922089173c9c345f1c67bd0d7397a5829195381439a6a5d03b"} Jun 12 18:46:54.372810 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:54.372777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" event={"ID":"48fe0e72-5494-4902-8f6c-4d23cabcf27b","Type":"ContainerStarted","Data":"4deab9ae1bfdee1d38af41c5879367af6158d05a5faf2a441dd834ca4247e8f9"} Jun 12 18:46:54.388670 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:54.388569 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" podStartSLOduration=7.192732242 podStartE2EDuration="10.388550295s" totalImagesPullingTime="3.195818053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:54.38663528 +0000 UTC m=+266.342719360" watchObservedRunningTime="2026-06-12 18:46:54.388550295 +0000 UTC m=+266.344634375" Jun 12 18:46:56.385362 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:56.385274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" event={"ID":"48fe0e72-5494-4902-8f6c-4d23cabcf27b","Type":"ContainerStarted","Data":"6534ca705d39de1479a3ed57cdf264e9748a3a9d5b337d118fa61e92d5141579"} Jun 12 18:46:56.385855 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:56.385363 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" event={"ID":"48fe0e72-5494-4902-8f6c-4d23cabcf27b","Type":"ContainerStarted","Data":"c5984ca63b89669f6ea6c529ac98f75743f3540a5c116c5f680d950beece8b76"} Jun 12 18:46:56.385855 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:56.385410 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" event={"ID":"48fe0e72-5494-4902-8f6c-4d23cabcf27b","Type":"ContainerStarted","Data":"7d4a7ea9c0b32f85b4b8d88d0edc853c5f6dd1e9e575276372c621aae41eb06b"} Jun 12 18:46:56.385855 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:56.385499 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:46:56.409432 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:46:56.409376 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" podStartSLOduration=8.607479673 podStartE2EDuration="13.409356507s" totalImagesPullingTime="4.801876834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:56.408486638 +0000 UTC m=+268.364570757" watchObservedRunningTime="2026-06-12 18:46:56.409356507 +0000 UTC m=+268.365440591" Jun 12 18:47:02.397087 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:02.397060 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-ccf9b8d46-552s4" Jun 12 18:47:04.789561 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:04.789503 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:47:04.790026 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:04.789599 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:47:09.980274 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:47:09.980232 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zsflt" podUID="3276bc51-9677-4b76-a756-af3ea2b6e648" Jun 12 18:47:10.438033 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:10.438006 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsflt" Jun 12 18:47:13.854832 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:13.854795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:47:13.857073 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:13.857051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3276bc51-9677-4b76-a756-af3ea2b6e648-metrics-tls\") pod \"dns-default-zsflt\" (UID: \"3276bc51-9677-4b76-a756-af3ea2b6e648\") " pod="openshift-dns/dns-default-zsflt" Jun 12 18:47:14.042028 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:14.041993 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkhgt\"" Jun 12 18:47:14.049457 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:14.049432 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsflt" Jun 12 18:47:14.179965 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:14.179929 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zsflt"] Jun 12 18:47:14.183163 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:47:14.183133 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3276bc51_9677_4b76_a756_af3ea2b6e648.slice/crio-b6cf136881b627f284f45f53f6c1bf65e7ffe5ac566c026f9902446d3d717789 WatchSource:0}: Error finding container b6cf136881b627f284f45f53f6c1bf65e7ffe5ac566c026f9902446d3d717789: Status 404 returned error can't find the container with id b6cf136881b627f284f45f53f6c1bf65e7ffe5ac566c026f9902446d3d717789 Jun 12 18:47:14.452302 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:14.452269 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsflt" event={"ID":"3276bc51-9677-4b76-a756-af3ea2b6e648","Type":"ContainerStarted","Data":"b6cf136881b627f284f45f53f6c1bf65e7ffe5ac566c026f9902446d3d717789"} Jun 12 18:47:16.461175 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:16.461141 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsflt" event={"ID":"3276bc51-9677-4b76-a756-af3ea2b6e648","Type":"ContainerStarted","Data":"c5d9827a9c65bac19b101952ae47fa543fcf72a8d456308b412e7d0292bffd5b"} Jun 12 18:47:17.470309 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:17.470275 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsflt" event={"ID":"3276bc51-9677-4b76-a756-af3ea2b6e648","Type":"ContainerStarted","Data":"db08b3b8ecc91d8487f5bceba0c098ad4c9b901d3da655e2e627987628efdc3c"} Jun 12 18:47:17.470750 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:17.470402 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zsflt" Jun 12 18:47:17.492045 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:17.491999 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zsflt" podStartSLOduration=252.394038793 podStartE2EDuration="4m14.491957854s" totalImagesPullingTime="2.097919061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:43:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:47:17.490918658 +0000 UTC m=+289.447002751" watchObservedRunningTime="2026-06-12 18:47:17.491957854 +0000 UTC m=+289.448041977" Jun 12 18:47:20.210445 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:20.210411 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c6f58749c-nc4z9_b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91/metrics-server/0.log" Jun 12 18:47:20.609559 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:20.609473 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sdh7_a1ff73da-ae44-4a71-b76e-e680f8e1f1f7/init-textfile/0.log" Jun 12 18:47:20.810292 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:20.810265 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sdh7_a1ff73da-ae44-4a71-b76e-e680f8e1f1f7/node-exporter/0.log" Jun 12 18:47:21.009946 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:21.009916 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sdh7_a1ff73da-ae44-4a71-b76e-e680f8e1f1f7/kube-rbac-proxy/0.log" Jun 12 18:47:24.412000 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:24.411972 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-ndg9x_58f02022-93f0-449a-b645-c538b42ade99/prometheus-operator/0.log" Jun 12 18:47:24.608958 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:24.608927 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-ndg9x_58f02022-93f0-449a-b645-c538b42ade99/kube-rbac-proxy/0.log" Jun 12 18:47:24.794695 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:24.794625 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:47:24.798614 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:24.798583 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c6f58749c-nc4z9" Jun 12 18:47:25.009442 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:25.009413 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/thanos-query/0.log" Jun 12 18:47:25.209448 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:25.209423 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/kube-rbac-proxy-web/0.log" Jun 12 18:47:25.409822 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:25.409794 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/kube-rbac-proxy/0.log" Jun 12 18:47:25.609643 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:25.609569 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/prom-label-proxy/0.log" Jun 12 18:47:25.809168 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:25.809144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/kube-rbac-proxy-rules/0.log" Jun 12 18:47:26.009568 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:26.009540 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/kube-rbac-proxy-metrics/0.log" Jun 12 18:47:26.965231 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:26.965189 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" podUID="56ef3b29-07a4-4384-b760-318e552bfe91" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:47:27.213891 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:27.213864 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-b7b9w_9a70aab3-2a5e-484d-a56b-08f10c93eaa4/download-server/0.log" Jun 12 18:47:27.476357 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:27.476325 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zsflt" Jun 12 18:47:28.210183 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:28.210149 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zsflt_3276bc51-9677-4b76-a756-af3ea2b6e648/dns/0.log" Jun 12 18:47:28.389613 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:28.389579 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:47:28.391607 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:28.391585 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:47:28.395819 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:28.395796 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 18:47:28.410165 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:28.410139 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zsflt_3276bc51-9677-4b76-a756-af3ea2b6e648/kube-rbac-proxy/0.log" Jun 12 18:47:28.817837 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:28.817809 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-72px9_ea99fb9a-6275-4e18-9fb5-37accb14df31/dns-node-resolver/0.log" Jun 12 18:47:29.609898 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:29.609871 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bhlgq_a1b4c353-dfe3-42a7-8d3b-556fe4e6e758/node-ca/0.log" Jun 12 18:47:30.611787 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:30.611752 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nd44b_28edbe43-9f3a-47f9-ba58-78d9c98ef1d4/serve-healthcheck-canary/0.log" Jun 12 18:47:36.964289 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:36.964248 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" podUID="56ef3b29-07a4-4384-b760-318e552bfe91" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:47:39.552652 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:39.552555 2559 generic.go:356] "Generic (PLEG): container finished" podID="f9997ce2-45a9-4334-89ce-0e4215941d8e" containerID="133cd9216056a8bf5c4fd2d507798833bf469a1b399ab2757c22d19f6f29db46" exitCode=0 Jun 12 18:47:39.552652 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:39.552621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" event={"ID":"f9997ce2-45a9-4334-89ce-0e4215941d8e","Type":"ContainerDied","Data":"133cd9216056a8bf5c4fd2d507798833bf469a1b399ab2757c22d19f6f29db46"} Jun 12 18:47:39.553222 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:39.552997 2559 scope.go:117] "RemoveContainer" containerID="133cd9216056a8bf5c4fd2d507798833bf469a1b399ab2757c22d19f6f29db46" Jun 12 18:47:40.557378 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:40.557340 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2chc6" event={"ID":"f9997ce2-45a9-4334-89ce-0e4215941d8e","Type":"ContainerStarted","Data":"b0aa8ad3b128f24b4ed9d30f0d39abbf585e8b25b605da52cfed0cc21365a5fd"} Jun 12 18:47:46.965116 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:46.965077 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" podUID="56ef3b29-07a4-4384-b760-318e552bfe91" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:47:46.965579 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:46.965160 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" Jun 12 18:47:46.965665 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:46.965632 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a067da379f084c826cb343f00ab91f3ba126828cdcd9f7f42629137be265061e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 12 18:47:46.965713 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:46.965684 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" podUID="56ef3b29-07a4-4384-b760-318e552bfe91" containerName="service-proxy" containerID="cri-o://a067da379f084c826cb343f00ab91f3ba126828cdcd9f7f42629137be265061e" gracePeriod=30 Jun 12 18:47:47.584423 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:47.584390 2559 generic.go:356] "Generic (PLEG): container finished" podID="56ef3b29-07a4-4384-b760-318e552bfe91" containerID="a067da379f084c826cb343f00ab91f3ba126828cdcd9f7f42629137be265061e" exitCode=2 Jun 12 18:47:47.584637 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:47.584448 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" event={"ID":"56ef3b29-07a4-4384-b760-318e552bfe91","Type":"ContainerDied","Data":"a067da379f084c826cb343f00ab91f3ba126828cdcd9f7f42629137be265061e"} Jun 12 18:47:47.584637 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:47:47.584481 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bff6bc99d-dv8nq" event={"ID":"56ef3b29-07a4-4384-b760-318e552bfe91","Type":"ContainerStarted","Data":"3280b276495c20afd5fab514ea5138e97b8e37d516b6a4feaa828d9fc625ba5e"} Jun 12 18:50:49.715127 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.715093 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf"] Jun 12 18:50:49.717316 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.717298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.720078 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.720051 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x9fn8\"" Jun 12 18:50:49.720224 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.720131 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 18:50:49.721281 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.721262 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 18:50:49.728870 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.728847 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf"] Jun 12 18:50:49.791563 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.791526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.791563 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.791561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxptx\" (UniqueName: \"kubernetes.io/projected/ebc143e6-3d93-4180-a7e0-6028e86177c0-kube-api-access-xxptx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.791754 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.791680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.892526 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.892486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.892678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.892608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.892678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.892638 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxptx\" (UniqueName: \"kubernetes.io/projected/ebc143e6-3d93-4180-a7e0-6028e86177c0-kube-api-access-xxptx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.892827 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.892809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.892886 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.892870 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:49.904848 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:49.904823 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxptx\" (UniqueName: \"kubernetes.io/projected/ebc143e6-3d93-4180-a7e0-6028e86177c0-kube-api-access-xxptx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:50.026082 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:50.026008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:50:50.156105 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:50.156074 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf"] Jun 12 18:50:50.158891 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:50:50.158865 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc143e6_3d93_4180_a7e0_6028e86177c0.slice/crio-29f66c8f4b6754074c09093c8e7fef849669530b1f16e99ed18311dfef30c7d2 WatchSource:0}: Error finding container 29f66c8f4b6754074c09093c8e7fef849669530b1f16e99ed18311dfef30c7d2: Status 404 returned error can't find the container with id 29f66c8f4b6754074c09093c8e7fef849669530b1f16e99ed18311dfef30c7d2 Jun 12 18:50:50.160864 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:50.160848 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:50:50.217761 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:50.217728 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" event={"ID":"ebc143e6-3d93-4180-a7e0-6028e86177c0","Type":"ContainerStarted","Data":"29f66c8f4b6754074c09093c8e7fef849669530b1f16e99ed18311dfef30c7d2"} Jun 12 18:50:54.105132 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.105100 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2"] Jun 12 18:50:54.106946 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.106930 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" Jun 12 18:50:54.109650 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.109629 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 18:50:54.111088 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.111070 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 18:50:54.111195 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.111174 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tzwk5\"" Jun 12 18:50:54.119776 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.119743 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2"] Jun 12 18:50:54.226864 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.226836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9c4f6db-4f91-4280-9b49-11793d9f471c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z9rs2\" (UID: \"d9c4f6db-4f91-4280-9b49-11793d9f471c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" Jun 12 18:50:54.227020 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.226895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqvs\" (UniqueName: \"kubernetes.io/projected/d9c4f6db-4f91-4280-9b49-11793d9f471c-kube-api-access-gxqvs\") pod \"cert-manager-cainjector-5d99449ffd-z9rs2\" (UID: \"d9c4f6db-4f91-4280-9b49-11793d9f471c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" Jun 12 18:50:54.327991 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.327963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqvs\" (UniqueName: \"kubernetes.io/projected/d9c4f6db-4f91-4280-9b49-11793d9f471c-kube-api-access-gxqvs\") pod \"cert-manager-cainjector-5d99449ffd-z9rs2\" (UID: \"d9c4f6db-4f91-4280-9b49-11793d9f471c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" Jun 12 18:50:54.328168 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.328016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9c4f6db-4f91-4280-9b49-11793d9f471c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z9rs2\" (UID: \"d9c4f6db-4f91-4280-9b49-11793d9f471c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" Jun 12 18:50:54.350097 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.350061 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9c4f6db-4f91-4280-9b49-11793d9f471c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z9rs2\" (UID: \"d9c4f6db-4f91-4280-9b49-11793d9f471c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" Jun 12 18:50:54.350235 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.350163 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqvs\" (UniqueName: \"kubernetes.io/projected/d9c4f6db-4f91-4280-9b49-11793d9f471c-kube-api-access-gxqvs\") pod \"cert-manager-cainjector-5d99449ffd-z9rs2\" (UID: \"d9c4f6db-4f91-4280-9b49-11793d9f471c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" Jun 12 18:50:54.416180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.416149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" Jun 12 18:50:54.561406 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:54.561364 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2"] Jun 12 18:50:54.568652 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:50:54.568615 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9c4f6db_4f91_4280_9b49_11793d9f471c.slice/crio-5ebe331c18504d108e4b9c2777b95230576562f605ec7ade0ff2178089cfdcf0 WatchSource:0}: Error finding container 5ebe331c18504d108e4b9c2777b95230576562f605ec7ade0ff2178089cfdcf0: Status 404 returned error can't find the container with id 5ebe331c18504d108e4b9c2777b95230576562f605ec7ade0ff2178089cfdcf0 Jun 12 18:50:55.242174 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:50:55.242070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" event={"ID":"d9c4f6db-4f91-4280-9b49-11793d9f471c","Type":"ContainerStarted","Data":"5ebe331c18504d108e4b9c2777b95230576562f605ec7ade0ff2178089cfdcf0"} Jun 12 18:51:00.261830 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:00.261800 2559 generic.go:356] "Generic (PLEG): container finished" podID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerID="3d1bd3fcb6b9d21b4487d090b41d143b4efe6480b97969049ac4963568e98700" exitCode=0 Jun 12 18:51:00.262277 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:00.261897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" event={"ID":"ebc143e6-3d93-4180-a7e0-6028e86177c0","Type":"ContainerDied","Data":"3d1bd3fcb6b9d21b4487d090b41d143b4efe6480b97969049ac4963568e98700"} Jun 12 18:51:00.263394 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:00.263373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" event={"ID":"d9c4f6db-4f91-4280-9b49-11793d9f471c","Type":"ContainerStarted","Data":"088e3dc8d41bee7ddaf9d80f52aaf3fad85ffcd02997cdc77b7953ed3b7d7b9e"} Jun 12 18:51:00.300108 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:00.300057 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z9rs2" podStartSLOduration=1.550636036 podStartE2EDuration="6.30004367s" totalImagesPullingTime="4.749407634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:51:00.299976757 +0000 UTC m=+512.256060848" watchObservedRunningTime="2026-06-12 18:51:00.30004367 +0000 UTC m=+512.256127750" Jun 12 18:51:03.276066 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:03.276036 2559 generic.go:356] "Generic (PLEG): container finished" podID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerID="568fdd49678ccf673e7002f75321dd76e0cd7a99c6999661cf8870ba92d691dc" exitCode=0 Jun 12 18:51:03.276452 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:03.276087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" event={"ID":"ebc143e6-3d93-4180-a7e0-6028e86177c0","Type":"ContainerDied","Data":"568fdd49678ccf673e7002f75321dd76e0cd7a99c6999661cf8870ba92d691dc"} Jun 12 18:51:11.309862 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:11.309828 2559 generic.go:356] "Generic (PLEG): container finished" podID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerID="410e063fb0b02e67470c66eb50c11badea3d7237fe2aca2aca241a0b09c7005c" exitCode=0 Jun 12 18:51:11.310230 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:11.309875 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" event={"ID":"ebc143e6-3d93-4180-a7e0-6028e86177c0","Type":"ContainerDied","Data":"410e063fb0b02e67470c66eb50c11badea3d7237fe2aca2aca241a0b09c7005c"} Jun 12 18:51:12.469285 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.469254 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:51:12.579985 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.579907 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxptx\" (UniqueName: \"kubernetes.io/projected/ebc143e6-3d93-4180-a7e0-6028e86177c0-kube-api-access-xxptx\") pod \"ebc143e6-3d93-4180-a7e0-6028e86177c0\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " Jun 12 18:51:12.579985 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.579945 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-bundle\") pod \"ebc143e6-3d93-4180-a7e0-6028e86177c0\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " Jun 12 18:51:12.579985 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.579968 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-util\") pod \"ebc143e6-3d93-4180-a7e0-6028e86177c0\" (UID: \"ebc143e6-3d93-4180-a7e0-6028e86177c0\") " Jun 12 18:51:12.580337 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.580309 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-bundle" (OuterVolumeSpecName: "bundle") pod "ebc143e6-3d93-4180-a7e0-6028e86177c0" (UID: "ebc143e6-3d93-4180-a7e0-6028e86177c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:51:12.582101 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.582079 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc143e6-3d93-4180-a7e0-6028e86177c0-kube-api-access-xxptx" (OuterVolumeSpecName: "kube-api-access-xxptx") pod "ebc143e6-3d93-4180-a7e0-6028e86177c0" (UID: "ebc143e6-3d93-4180-a7e0-6028e86177c0"). InnerVolumeSpecName "kube-api-access-xxptx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:51:12.585424 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.585398 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-util" (OuterVolumeSpecName: "util") pod "ebc143e6-3d93-4180-a7e0-6028e86177c0" (UID: "ebc143e6-3d93-4180-a7e0-6028e86177c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:51:12.681160 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.681126 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxptx\" (UniqueName: \"kubernetes.io/projected/ebc143e6-3d93-4180-a7e0-6028e86177c0-kube-api-access-xxptx\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:51:12.681160 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.681152 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:51:12.681160 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:12.681161 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebc143e6-3d93-4180-a7e0-6028e86177c0-util\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:51:13.318797 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:13.318762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" event={"ID":"ebc143e6-3d93-4180-a7e0-6028e86177c0","Type":"ContainerDied","Data":"29f66c8f4b6754074c09093c8e7fef849669530b1f16e99ed18311dfef30c7d2"} Jun 12 18:51:13.318946 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:13.318809 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29f66c8f4b6754074c09093c8e7fef849669530b1f16e99ed18311dfef30c7d2" Jun 12 18:51:13.318946 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:13.318773 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvvxjf" Jun 12 18:51:18.051468 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.051379 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp"] Jun 12 18:51:18.051978 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.051771 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerName="pull" Jun 12 18:51:18.051978 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.051789 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerName="pull" Jun 12 18:51:18.051978 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.051810 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerName="util" Jun 12 18:51:18.051978 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.051819 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerName="util" Jun 12 18:51:18.051978 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.051842 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerName="extract" Jun 12 18:51:18.051978 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.051852 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerName="extract" Jun 12 18:51:18.051978 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.051910 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc143e6-3d93-4180-a7e0-6028e86177c0" containerName="extract" Jun 12 18:51:18.054989 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.054968 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" Jun 12 18:51:18.057834 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.057814 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gq7gp\"" Jun 12 18:51:18.057991 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.057974 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:51:18.058995 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.058981 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 18:51:18.069390 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.069369 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp"] Jun 12 18:51:18.220171 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.220140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e934e707-648e-4102-ab3d-b1aecba059b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6vzp\" (UID: \"e934e707-648e-4102-ab3d-b1aecba059b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" Jun 12 18:51:18.220328 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.220191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs2nc\" (UniqueName: \"kubernetes.io/projected/e934e707-648e-4102-ab3d-b1aecba059b4-kube-api-access-qs2nc\") pod \"openshift-lws-operator-fd8ccff4c-q6vzp\" (UID: \"e934e707-648e-4102-ab3d-b1aecba059b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" Jun 12 18:51:18.321470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.321379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e934e707-648e-4102-ab3d-b1aecba059b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6vzp\" (UID: \"e934e707-648e-4102-ab3d-b1aecba059b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" Jun 12 18:51:18.321470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.321427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs2nc\" (UniqueName: \"kubernetes.io/projected/e934e707-648e-4102-ab3d-b1aecba059b4-kube-api-access-qs2nc\") pod \"openshift-lws-operator-fd8ccff4c-q6vzp\" (UID: \"e934e707-648e-4102-ab3d-b1aecba059b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" Jun 12 18:51:18.321819 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.321796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e934e707-648e-4102-ab3d-b1aecba059b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6vzp\" (UID: \"e934e707-648e-4102-ab3d-b1aecba059b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" Jun 12 18:51:18.330490 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.330466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs2nc\" (UniqueName: \"kubernetes.io/projected/e934e707-648e-4102-ab3d-b1aecba059b4-kube-api-access-qs2nc\") pod \"openshift-lws-operator-fd8ccff4c-q6vzp\" (UID: \"e934e707-648e-4102-ab3d-b1aecba059b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" Jun 12 18:51:18.363645 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.363620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" Jun 12 18:51:18.493634 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:18.493606 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp"] Jun 12 18:51:18.496686 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:51:18.496655 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode934e707_648e_4102_ab3d_b1aecba059b4.slice/crio-4c3d748ad8c9b7e02c7aa62b622e29e2e4d8149723034e150ffcf84a6ffdbf83 WatchSource:0}: Error finding container 4c3d748ad8c9b7e02c7aa62b622e29e2e4d8149723034e150ffcf84a6ffdbf83: Status 404 returned error can't find the container with id 4c3d748ad8c9b7e02c7aa62b622e29e2e4d8149723034e150ffcf84a6ffdbf83 Jun 12 18:51:19.341178 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:19.341142 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" event={"ID":"e934e707-648e-4102-ab3d-b1aecba059b4","Type":"ContainerStarted","Data":"4c3d748ad8c9b7e02c7aa62b622e29e2e4d8149723034e150ffcf84a6ffdbf83"} Jun 12 18:51:20.346778 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:20.346676 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" event={"ID":"e934e707-648e-4102-ab3d-b1aecba059b4","Type":"ContainerStarted","Data":"305f7d3f6f8c5a35cd68726ce72e2ac999086caaab8757fe868e446ea51bc99a"} Jun 12 18:51:20.369172 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:20.369124 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6vzp" podStartSLOduration=0.803548278 podStartE2EDuration="2.369108334s" totalImagesPullingTime="1.565560056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:51:20.367937914 +0000 UTC m=+532.324021992" watchObservedRunningTime="2026-06-12 18:51:20.369108334 +0000 UTC m=+532.325192412" Jun 12 18:51:38.335609 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.335571 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf"] Jun 12 18:51:38.337870 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.337851 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.340853 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.340834 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 18:51:38.341147 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.341134 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 18:51:38.341379 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.341364 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 18:51:38.341845 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.341832 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m8m9l\"" Jun 12 18:51:38.342599 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.342582 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 18:51:38.365450 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.365423 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf"] Jun 12 18:51:38.365683 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.365664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd474\" (UniqueName: \"kubernetes.io/projected/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-kube-api-access-wd474\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.365733 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.365699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-tmp\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.365790 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.365772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-manifests\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.365824 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.365810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.365860 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.365836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-webhook-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.466939 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.466912 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-manifests\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.467130 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.466945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.467130 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.466969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-webhook-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.467130 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.467015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd474\" (UniqueName: \"kubernetes.io/projected/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-kube-api-access-wd474\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.467130 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.467044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-tmp\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.467366 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.467338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-manifests\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.469380 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.469357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-tmp\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.469691 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.469603 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.469752 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.469725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-webhook-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.478300 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.478271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd474\" (UniqueName: \"kubernetes.io/projected/f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76-kube-api-access-wd474\") pod \"opendatahub-operator-controller-manager-ffbc465cb-g4spf\" (UID: \"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.647272 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.647188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:38.788658 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:38.788629 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf"] Jun 12 18:51:38.791205 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:51:38.791178 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13a20ce_e1d0_4cb9_b206_ffc77b0cbc76.slice/crio-f376d511901658c090249b8c9c4bc86ba73160e4921124335abe73e84c0f31c7 WatchSource:0}: Error finding container f376d511901658c090249b8c9c4bc86ba73160e4921124335abe73e84c0f31c7: Status 404 returned error can't find the container with id f376d511901658c090249b8c9c4bc86ba73160e4921124335abe73e84c0f31c7 Jun 12 18:51:39.418222 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:39.418173 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" event={"ID":"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76","Type":"ContainerStarted","Data":"f376d511901658c090249b8c9c4bc86ba73160e4921124335abe73e84c0f31c7"} Jun 12 18:51:42.432045 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:42.432004 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" event={"ID":"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76","Type":"ContainerStarted","Data":"a25f040c5f0eb0a65d14f92aec1f87da87b55f2492b2d4c7528d1e52739ed545"} Jun 12 18:51:43.437439 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:43.437402 2559 generic.go:356] "Generic (PLEG): container finished" podID="f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76" containerID="a25f040c5f0eb0a65d14f92aec1f87da87b55f2492b2d4c7528d1e52739ed545" exitCode=0 Jun 12 18:51:43.437828 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:43.437461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" event={"ID":"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76","Type":"ContainerDied","Data":"a25f040c5f0eb0a65d14f92aec1f87da87b55f2492b2d4c7528d1e52739ed545"} Jun 12 18:51:44.442874 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:44.442838 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" event={"ID":"f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76","Type":"ContainerStarted","Data":"120235adb1d851f16837e1149f1b572c371a6bfea7849b344a5817c05060a216"} Jun 12 18:51:44.443261 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:44.442931 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:44.469104 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:44.469058 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" podStartSLOduration=2.02622418 podStartE2EDuration="6.469044382s" totalImagesPullingTime="3.374639923s" totalInitContainerRuntime="1.068180279s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:51:44.467757494 +0000 UTC m=+556.423841575" watchObservedRunningTime="2026-06-12 18:51:44.469044382 +0000 UTC m=+556.425128461" Jun 12 18:51:55.449722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:55.449688 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-g4spf" Jun 12 18:51:57.926615 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:57.926579 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc"] Jun 12 18:51:57.930985 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:57.930966 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:57.934459 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:57.934439 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 18:51:57.934727 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:57.934705 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 18:51:57.935845 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:57.935827 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x9fn8\"" Jun 12 18:51:57.952313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:57.952291 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc"] Jun 12 18:51:58.021886 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.021851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.021886 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.021890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6547d\" (UniqueName: \"kubernetes.io/projected/c586ba19-ec06-4872-bb3d-8b9f517abd5f-kube-api-access-6547d\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.022133 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.021917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.123350 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.123312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.123350 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.123360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6547d\" (UniqueName: \"kubernetes.io/projected/c586ba19-ec06-4872-bb3d-8b9f517abd5f-kube-api-access-6547d\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.123575 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.123391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.123795 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.123774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.123837 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.123778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.159764 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.159736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6547d\" (UniqueName: \"kubernetes.io/projected/c586ba19-ec06-4872-bb3d-8b9f517abd5f-kube-api-access-6547d\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.242346 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.242260 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:51:58.349932 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.349900 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zsdfh"] Jun 12 18:51:58.353980 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.353961 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:58.357075 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.357056 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 12 18:51:58.357468 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.357452 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6kvh8\"" Jun 12 18:51:58.359848 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.359824 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft"] Jun 12 18:51:58.363505 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.363489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.366211 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.366188 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 18:51:58.366294 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.366211 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 18:51:58.366294 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.366270 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 18:51:58.366414 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.366323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6tttj\"" Jun 12 18:51:58.366622 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.366605 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 18:51:58.372870 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.372849 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zsdfh"] Jun 12 18:51:58.379099 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.379073 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft"] Jun 12 18:51:58.394991 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.394969 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc"] Jun 12 18:51:58.397412 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:51:58.397392 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc586ba19_ec06_4872_bb3d_8b9f517abd5f.slice/crio-de17c55b87e87b6cfbd7f418b4acac25d89fa4682be36a41baf58e44121210f8 WatchSource:0}: Error finding container de17c55b87e87b6cfbd7f418b4acac25d89fa4682be36a41baf58e44121210f8: Status 404 returned error can't find the container with id de17c55b87e87b6cfbd7f418b4acac25d89fa4682be36a41baf58e44121210f8 Jun 12 18:51:58.425391 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.425361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-tmp\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.425527 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.425394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5swps\" (UniqueName: \"kubernetes.io/projected/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-kube-api-access-5swps\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.425527 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.425494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kd96\" (UniqueName: \"kubernetes.io/projected/63abac2d-6ddb-4446-9d40-1235a6833218-kube-api-access-4kd96\") pod \"odh-model-controller-6dc94f689f-zsdfh\" (UID: \"63abac2d-6ddb-4446-9d40-1235a6833218\") " pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:58.425653 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.425554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63abac2d-6ddb-4446-9d40-1235a6833218-cert\") pod \"odh-model-controller-6dc94f689f-zsdfh\" (UID: \"63abac2d-6ddb-4446-9d40-1235a6833218\") " pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:58.425653 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.425610 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-tls-certs\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.502756 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.502722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" event={"ID":"c586ba19-ec06-4872-bb3d-8b9f517abd5f","Type":"ContainerStarted","Data":"854a5247dc1c8d827fd9745ff6ffd1ff2dc26b04752f2c71578f8471fcd67ff8"} Jun 12 18:51:58.502895 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.502773 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" event={"ID":"c586ba19-ec06-4872-bb3d-8b9f517abd5f","Type":"ContainerStarted","Data":"de17c55b87e87b6cfbd7f418b4acac25d89fa4682be36a41baf58e44121210f8"} Jun 12 18:51:58.526988 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.526961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kd96\" (UniqueName: \"kubernetes.io/projected/63abac2d-6ddb-4446-9d40-1235a6833218-kube-api-access-4kd96\") pod \"odh-model-controller-6dc94f689f-zsdfh\" (UID: \"63abac2d-6ddb-4446-9d40-1235a6833218\") " pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:58.527129 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.526995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63abac2d-6ddb-4446-9d40-1235a6833218-cert\") pod \"odh-model-controller-6dc94f689f-zsdfh\" (UID: \"63abac2d-6ddb-4446-9d40-1235a6833218\") " pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:58.527129 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.527017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-tls-certs\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.527129 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.527062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-tmp\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.527129 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.527087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5swps\" (UniqueName: \"kubernetes.io/projected/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-kube-api-access-5swps\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.527129 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:51:58.527122 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 12 18:51:58.527388 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:51:58.527207 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63abac2d-6ddb-4446-9d40-1235a6833218-cert podName:63abac2d-6ddb-4446-9d40-1235a6833218 nodeName:}" failed. No retries permitted until 2026-06-12 18:51:59.027187509 +0000 UTC m=+570.983271570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/63abac2d-6ddb-4446-9d40-1235a6833218-cert") pod "odh-model-controller-6dc94f689f-zsdfh" (UID: "63abac2d-6ddb-4446-9d40-1235a6833218") : secret "odh-model-controller-webhook-cert" not found Jun 12 18:51:58.529558 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.529532 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-tmp\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.529672 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.529598 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-tls-certs\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.539981 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.539952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5swps\" (UniqueName: \"kubernetes.io/projected/b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79-kube-api-access-5swps\") pod \"kube-auth-proxy-5c8b58c9c7-f79ft\" (UID: \"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.541416 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.541390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kd96\" (UniqueName: \"kubernetes.io/projected/63abac2d-6ddb-4446-9d40-1235a6833218-kube-api-access-4kd96\") pod \"odh-model-controller-6dc94f689f-zsdfh\" (UID: \"63abac2d-6ddb-4446-9d40-1235a6833218\") " pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:58.674910 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.674881 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" Jun 12 18:51:58.829283 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:58.829085 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft"] Jun 12 18:51:58.831805 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:51:58.831776 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a7d148_a8c5_46e8_9e46_e76dfb3a6f79.slice/crio-924f024d47ae1c97bc55c39118db934180ff1197deb251900ea5fc3c05ef958d WatchSource:0}: Error finding container 924f024d47ae1c97bc55c39118db934180ff1197deb251900ea5fc3c05ef958d: Status 404 returned error can't find the container with id 924f024d47ae1c97bc55c39118db934180ff1197deb251900ea5fc3c05ef958d Jun 12 18:51:59.030583 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.030487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63abac2d-6ddb-4446-9d40-1235a6833218-cert\") pod \"odh-model-controller-6dc94f689f-zsdfh\" (UID: \"63abac2d-6ddb-4446-9d40-1235a6833218\") " pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:59.032866 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.032849 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63abac2d-6ddb-4446-9d40-1235a6833218-cert\") pod \"odh-model-controller-6dc94f689f-zsdfh\" (UID: \"63abac2d-6ddb-4446-9d40-1235a6833218\") " pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:59.264687 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.264648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:51:59.442170 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.442149 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zsdfh"] Jun 12 18:51:59.443767 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:51:59.443732 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63abac2d_6ddb_4446_9d40_1235a6833218.slice/crio-15442fb761e0c2229d6aad7d1ace8dbbf8f7491def9c31d134b89d6794e5e862 WatchSource:0}: Error finding container 15442fb761e0c2229d6aad7d1ace8dbbf8f7491def9c31d134b89d6794e5e862: Status 404 returned error can't find the container with id 15442fb761e0c2229d6aad7d1ace8dbbf8f7491def9c31d134b89d6794e5e862 Jun 12 18:51:59.454602 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.454569 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gt92z"] Jun 12 18:51:59.459506 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.459487 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:51:59.462244 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.462224 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 12 18:51:59.479148 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.479122 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gt92z"] Jun 12 18:51:59.508585 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.508555 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" event={"ID":"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79","Type":"ContainerStarted","Data":"924f024d47ae1c97bc55c39118db934180ff1197deb251900ea5fc3c05ef958d"} Jun 12 18:51:59.509687 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.509664 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" event={"ID":"63abac2d-6ddb-4446-9d40-1235a6833218","Type":"ContainerStarted","Data":"15442fb761e0c2229d6aad7d1ace8dbbf8f7491def9c31d134b89d6794e5e862"} Jun 12 18:51:59.510988 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.510962 2559 generic.go:356] "Generic (PLEG): container finished" podID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerID="854a5247dc1c8d827fd9745ff6ffd1ff2dc26b04752f2c71578f8471fcd67ff8" exitCode=0 Jun 12 18:51:59.511067 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.510997 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" event={"ID":"c586ba19-ec06-4872-bb3d-8b9f517abd5f","Type":"ContainerDied","Data":"854a5247dc1c8d827fd9745ff6ffd1ff2dc26b04752f2c71578f8471fcd67ff8"} Jun 12 18:51:59.535198 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.535159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b39694-e96b-4138-b880-cbfc43174d14-tls-certs\") pod \"model-serving-api-5dd488fc48-gt92z\" (UID: \"35b39694-e96b-4138-b880-cbfc43174d14\") " pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:51:59.535366 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.535302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkfbf\" (UniqueName: \"kubernetes.io/projected/35b39694-e96b-4138-b880-cbfc43174d14-kube-api-access-jkfbf\") pod \"model-serving-api-5dd488fc48-gt92z\" (UID: \"35b39694-e96b-4138-b880-cbfc43174d14\") " pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:51:59.635974 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.635894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkfbf\" (UniqueName: \"kubernetes.io/projected/35b39694-e96b-4138-b880-cbfc43174d14-kube-api-access-jkfbf\") pod \"model-serving-api-5dd488fc48-gt92z\" (UID: \"35b39694-e96b-4138-b880-cbfc43174d14\") " pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:51:59.635974 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.635957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b39694-e96b-4138-b880-cbfc43174d14-tls-certs\") pod \"model-serving-api-5dd488fc48-gt92z\" (UID: \"35b39694-e96b-4138-b880-cbfc43174d14\") " pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:51:59.638740 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.638705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b39694-e96b-4138-b880-cbfc43174d14-tls-certs\") pod \"model-serving-api-5dd488fc48-gt92z\" (UID: \"35b39694-e96b-4138-b880-cbfc43174d14\") " pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:51:59.654853 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.654826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkfbf\" (UniqueName: \"kubernetes.io/projected/35b39694-e96b-4138-b880-cbfc43174d14-kube-api-access-jkfbf\") pod \"model-serving-api-5dd488fc48-gt92z\" (UID: \"35b39694-e96b-4138-b880-cbfc43174d14\") " pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:51:59.772582 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.772544 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:51:59.934035 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:51:59.933962 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gt92z"] Jun 12 18:51:59.937991 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:51:59.937951 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b39694_e96b_4138_b880_cbfc43174d14.slice/crio-04dff2d256cb3e558b60ae0a611abe55a4177bccc2038d031e18d02e8ed712a3 WatchSource:0}: Error finding container 04dff2d256cb3e558b60ae0a611abe55a4177bccc2038d031e18d02e8ed712a3: Status 404 returned error can't find the container with id 04dff2d256cb3e558b60ae0a611abe55a4177bccc2038d031e18d02e8ed712a3 Jun 12 18:52:00.519338 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:00.519291 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-gt92z" event={"ID":"35b39694-e96b-4138-b880-cbfc43174d14","Type":"ContainerStarted","Data":"04dff2d256cb3e558b60ae0a611abe55a4177bccc2038d031e18d02e8ed712a3"} Jun 12 18:52:04.538976 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.538938 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" event={"ID":"b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79","Type":"ContainerStarted","Data":"e78e741ad0f59be06556afa6ba99172073664a66ca4767f1eaa71660a872cf6a"} Jun 12 18:52:04.540458 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.540433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" event={"ID":"63abac2d-6ddb-4446-9d40-1235a6833218","Type":"ContainerStarted","Data":"964abfbc2e390b84d1c88ed105bc3c5a8b259e9b903fd85097c791848ed3972b"} Jun 12 18:52:04.540571 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.540501 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:52:04.541807 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.541779 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-gt92z" event={"ID":"35b39694-e96b-4138-b880-cbfc43174d14","Type":"ContainerStarted","Data":"d0f8b6a378859ba4d261df8300f2c5847e48cc3bba8c2dec1ad2d76cba2aa09d"} Jun 12 18:52:04.541927 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.541827 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:52:04.543574 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.543551 2559 generic.go:356] "Generic (PLEG): container finished" podID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerID="654daf63a425484483738444f69b5bf6bc4932d9d0f12cca728b889c5ec8fc09" exitCode=0 Jun 12 18:52:04.543663 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.543580 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" event={"ID":"c586ba19-ec06-4872-bb3d-8b9f517abd5f","Type":"ContainerDied","Data":"654daf63a425484483738444f69b5bf6bc4932d9d0f12cca728b889c5ec8fc09"} Jun 12 18:52:04.558410 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.558370 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-f79ft" podStartSLOduration=1.484968776 podStartE2EDuration="6.558353125s" totalImagesPullingTime="5.073384349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:04.55629904 +0000 UTC m=+576.512383122" watchObservedRunningTime="2026-06-12 18:52:04.558353125 +0000 UTC m=+576.514437204" Jun 12 18:52:04.578779 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.577956 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" podStartSLOduration=2.115912711 podStartE2EDuration="6.577939132s" totalImagesPullingTime="4.462026421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:04.577057304 +0000 UTC m=+576.533141384" watchObservedRunningTime="2026-06-12 18:52:04.577939132 +0000 UTC m=+576.534023213" Jun 12 18:52:04.598053 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:04.598005 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-gt92z" podStartSLOduration=1.6229834319999998 podStartE2EDuration="5.59799038s" totalImagesPullingTime="3.975006948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:04.596742926 +0000 UTC m=+576.552827018" watchObservedRunningTime="2026-06-12 18:52:04.59799038 +0000 UTC m=+576.554074496" Jun 12 18:52:05.550132 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:05.550102 2559 generic.go:356] "Generic (PLEG): container finished" podID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerID="47df60376bcb3a5606ff8af8bf3dfbb814ce2ed17bf0b5fadbe9144612f034a7" exitCode=0 Jun 12 18:52:05.550553 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:05.550187 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" event={"ID":"c586ba19-ec06-4872-bb3d-8b9f517abd5f","Type":"ContainerDied","Data":"47df60376bcb3a5606ff8af8bf3dfbb814ce2ed17bf0b5fadbe9144612f034a7"} Jun 12 18:52:06.681499 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.681465 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:52:06.800606 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.800579 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-util\") pod \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " Jun 12 18:52:06.800769 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.800644 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-bundle\") pod \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " Jun 12 18:52:06.800769 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.800685 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6547d\" (UniqueName: \"kubernetes.io/projected/c586ba19-ec06-4872-bb3d-8b9f517abd5f-kube-api-access-6547d\") pod \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\" (UID: \"c586ba19-ec06-4872-bb3d-8b9f517abd5f\") " Jun 12 18:52:06.801435 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.801401 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-bundle" (OuterVolumeSpecName: "bundle") pod "c586ba19-ec06-4872-bb3d-8b9f517abd5f" (UID: "c586ba19-ec06-4872-bb3d-8b9f517abd5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:52:06.802698 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.802676 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c586ba19-ec06-4872-bb3d-8b9f517abd5f-kube-api-access-6547d" (OuterVolumeSpecName: "kube-api-access-6547d") pod "c586ba19-ec06-4872-bb3d-8b9f517abd5f" (UID: "c586ba19-ec06-4872-bb3d-8b9f517abd5f"). InnerVolumeSpecName "kube-api-access-6547d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:52:06.805677 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.805631 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-util" (OuterVolumeSpecName: "util") pod "c586ba19-ec06-4872-bb3d-8b9f517abd5f" (UID: "c586ba19-ec06-4872-bb3d-8b9f517abd5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:52:06.901929 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.901896 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-util\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:52:06.901929 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.901923 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c586ba19-ec06-4872-bb3d-8b9f517abd5f-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:52:06.901929 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:06.901933 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6547d\" (UniqueName: \"kubernetes.io/projected/c586ba19-ec06-4872-bb3d-8b9f517abd5f-kube-api-access-6547d\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:52:07.560333 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:07.560294 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" event={"ID":"c586ba19-ec06-4872-bb3d-8b9f517abd5f","Type":"ContainerDied","Data":"de17c55b87e87b6cfbd7f418b4acac25d89fa4682be36a41baf58e44121210f8"} Jun 12 18:52:07.560501 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:07.560350 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de17c55b87e87b6cfbd7f418b4acac25d89fa4682be36a41baf58e44121210f8" Jun 12 18:52:07.560501 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:07.560306 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06lqvgc" Jun 12 18:52:08.361399 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.361365 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-299s9"] Jun 12 18:52:08.361840 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.361825 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerName="extract" Jun 12 18:52:08.361881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.361843 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerName="extract" Jun 12 18:52:08.361881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.361864 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerName="util" Jun 12 18:52:08.361881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.361872 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerName="util" Jun 12 18:52:08.361968 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.361886 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerName="pull" Jun 12 18:52:08.361968 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.361895 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerName="pull" Jun 12 18:52:08.362029 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.361980 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c586ba19-ec06-4872-bb3d-8b9f517abd5f" containerName="extract" Jun 12 18:52:08.365955 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.365939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:08.370202 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.370182 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 12 18:52:08.370320 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.370251 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-t5qjn\"" Jun 12 18:52:08.373231 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.373210 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8"] Jun 12 18:52:08.377164 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.377149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:08.387051 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.387033 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 12 18:52:08.387547 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.387532 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-d78xl\"" Jun 12 18:52:08.397979 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.397958 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-299s9"] Jun 12 18:52:08.407598 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.407556 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8"] Jun 12 18:52:08.518181 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.518148 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/169d6904-ce01-402a-aa12-805f6fd8f925-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-n9jh8\" (UID: \"169d6904-ce01-402a-aa12-805f6fd8f925\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:08.518390 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.518199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb9jj\" (UniqueName: \"kubernetes.io/projected/169d6904-ce01-402a-aa12-805f6fd8f925-kube-api-access-kb9jj\") pod \"llmisvc-controller-manager-864bfd7bc9-n9jh8\" (UID: \"169d6904-ce01-402a-aa12-805f6fd8f925\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:08.518390 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.518304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c94a910d-35d8-41e5-8ca7-235b5f09fb55-cert\") pod \"kserve-controller-manager-69fc866d76-299s9\" (UID: \"c94a910d-35d8-41e5-8ca7-235b5f09fb55\") " pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:08.518390 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.518349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg7bh\" (UniqueName: \"kubernetes.io/projected/c94a910d-35d8-41e5-8ca7-235b5f09fb55-kube-api-access-zg7bh\") pod \"kserve-controller-manager-69fc866d76-299s9\" (UID: \"c94a910d-35d8-41e5-8ca7-235b5f09fb55\") " pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:08.619026 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.618933 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c94a910d-35d8-41e5-8ca7-235b5f09fb55-cert\") pod \"kserve-controller-manager-69fc866d76-299s9\" (UID: \"c94a910d-35d8-41e5-8ca7-235b5f09fb55\") " pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:08.619026 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.618998 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg7bh\" (UniqueName: \"kubernetes.io/projected/c94a910d-35d8-41e5-8ca7-235b5f09fb55-kube-api-access-zg7bh\") pod \"kserve-controller-manager-69fc866d76-299s9\" (UID: \"c94a910d-35d8-41e5-8ca7-235b5f09fb55\") " pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:08.619233 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.619049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/169d6904-ce01-402a-aa12-805f6fd8f925-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-n9jh8\" (UID: \"169d6904-ce01-402a-aa12-805f6fd8f925\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:08.619233 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.619086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb9jj\" (UniqueName: \"kubernetes.io/projected/169d6904-ce01-402a-aa12-805f6fd8f925-kube-api-access-kb9jj\") pod \"llmisvc-controller-manager-864bfd7bc9-n9jh8\" (UID: \"169d6904-ce01-402a-aa12-805f6fd8f925\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:08.619233 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:52:08.619196 2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 12 18:52:08.619442 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:52:08.619261 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169d6904-ce01-402a-aa12-805f6fd8f925-cert podName:169d6904-ce01-402a-aa12-805f6fd8f925 nodeName:}" failed. No retries permitted until 2026-06-12 18:52:09.119240702 +0000 UTC m=+581.075324768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/169d6904-ce01-402a-aa12-805f6fd8f925-cert") pod "llmisvc-controller-manager-864bfd7bc9-n9jh8" (UID: "169d6904-ce01-402a-aa12-805f6fd8f925") : secret "llmisvc-webhook-server-cert" not found Jun 12 18:52:08.621630 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.621608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c94a910d-35d8-41e5-8ca7-235b5f09fb55-cert\") pod \"kserve-controller-manager-69fc866d76-299s9\" (UID: \"c94a910d-35d8-41e5-8ca7-235b5f09fb55\") " pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:08.642139 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.642106 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg7bh\" (UniqueName: \"kubernetes.io/projected/c94a910d-35d8-41e5-8ca7-235b5f09fb55-kube-api-access-zg7bh\") pod \"kserve-controller-manager-69fc866d76-299s9\" (UID: \"c94a910d-35d8-41e5-8ca7-235b5f09fb55\") " pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:08.642282 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.642120 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb9jj\" (UniqueName: \"kubernetes.io/projected/169d6904-ce01-402a-aa12-805f6fd8f925-kube-api-access-kb9jj\") pod \"llmisvc-controller-manager-864bfd7bc9-n9jh8\" (UID: \"169d6904-ce01-402a-aa12-805f6fd8f925\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:08.676713 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.676670 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:08.839843 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:08.839808 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-299s9"] Jun 12 18:52:08.843302 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:52:08.843278 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94a910d_35d8_41e5_8ca7_235b5f09fb55.slice/crio-0380d1dcfd2526ddf15e748743ac80748186c2ec674cfc917034ddbfb5896f05 WatchSource:0}: Error finding container 0380d1dcfd2526ddf15e748743ac80748186c2ec674cfc917034ddbfb5896f05: Status 404 returned error can't find the container with id 0380d1dcfd2526ddf15e748743ac80748186c2ec674cfc917034ddbfb5896f05 Jun 12 18:52:09.123664 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:09.123628 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/169d6904-ce01-402a-aa12-805f6fd8f925-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-n9jh8\" (UID: \"169d6904-ce01-402a-aa12-805f6fd8f925\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:09.125963 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:09.125933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/169d6904-ce01-402a-aa12-805f6fd8f925-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-n9jh8\" (UID: \"169d6904-ce01-402a-aa12-805f6fd8f925\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:09.286306 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:09.286272 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:09.461750 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:09.461721 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8"] Jun 12 18:52:09.462866 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:52:09.462841 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod169d6904_ce01_402a_aa12_805f6fd8f925.slice/crio-b5b52f783b6daa69f9e796ff6914bb0807c84a930871be4f7b3669f3f0a4b739 WatchSource:0}: Error finding container b5b52f783b6daa69f9e796ff6914bb0807c84a930871be4f7b3669f3f0a4b739: Status 404 returned error can't find the container with id b5b52f783b6daa69f9e796ff6914bb0807c84a930871be4f7b3669f3f0a4b739 Jun 12 18:52:09.570560 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:09.570501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" event={"ID":"169d6904-ce01-402a-aa12-805f6fd8f925","Type":"ContainerStarted","Data":"b5b52f783b6daa69f9e796ff6914bb0807c84a930871be4f7b3669f3f0a4b739"} Jun 12 18:52:09.571674 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:09.571647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" event={"ID":"c94a910d-35d8-41e5-8ca7-235b5f09fb55","Type":"ContainerStarted","Data":"0380d1dcfd2526ddf15e748743ac80748186c2ec674cfc917034ddbfb5896f05"} Jun 12 18:52:12.588520 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.588480 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" event={"ID":"c94a910d-35d8-41e5-8ca7-235b5f09fb55","Type":"ContainerStarted","Data":"dea9449af308e37be7f9d99cfe4cb847f2f9b30652683bef02eb06d63142395b"} Jun 12 18:52:12.589020 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.588577 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:12.651472 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.651415 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" podStartSLOduration=1.817063465 podStartE2EDuration="4.651400515s" totalImagesPullingTime="2.83433705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:12.648437486 +0000 UTC m=+584.604521567" watchObservedRunningTime="2026-06-12 18:52:12.651400515 +0000 UTC m=+584.607484606" Jun 12 18:52:12.659316 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.659290 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj"] Jun 12 18:52:12.671880 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.671830 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.675754 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.675729 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 18:52:12.675878 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.675730 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 18:52:12.675878 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.675832 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x9fn8\"" Jun 12 18:52:12.753589 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.753558 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj"] Jun 12 18:52:12.758160 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.758133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.758301 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.758196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.758301 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.758280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85d5\" (UniqueName: \"kubernetes.io/projected/be4b6a1f-3654-4cf7-8974-c303a680cd82-kube-api-access-n85d5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.859226 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.859153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.859226 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.859199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.859410 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.859225 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n85d5\" (UniqueName: \"kubernetes.io/projected/be4b6a1f-3654-4cf7-8974-c303a680cd82-kube-api-access-n85d5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.859620 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.859602 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.859665 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.859614 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.877095 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.877063 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85d5\" (UniqueName: \"kubernetes.io/projected/be4b6a1f-3654-4cf7-8974-c303a680cd82-kube-api-access-n85d5\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:12.981564 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:12.981505 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:13.191050 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:13.191026 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj"] Jun 12 18:52:13.192215 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:52:13.192180 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4b6a1f_3654_4cf7_8974_c303a680cd82.slice/crio-46ba36de0f0760fafbab2c28771ce8f19953a9724429b95e9c561bc5bd94589d WatchSource:0}: Error finding container 46ba36de0f0760fafbab2c28771ce8f19953a9724429b95e9c561bc5bd94589d: Status 404 returned error can't find the container with id 46ba36de0f0760fafbab2c28771ce8f19953a9724429b95e9c561bc5bd94589d Jun 12 18:52:13.594975 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:13.594934 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" event={"ID":"169d6904-ce01-402a-aa12-805f6fd8f925","Type":"ContainerStarted","Data":"2175e83999c48cebc3449e94564c85a50903860a733856cf4ccea609570d6a5b"} Jun 12 18:52:13.595423 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:13.595085 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:13.596630 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:13.596590 2559 generic.go:356] "Generic (PLEG): container finished" podID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerID="3de0e4e81ecdb4a0db91acd857ce414f663bd8c8adafecca8ad96d17dd146e3b" exitCode=0 Jun 12 18:52:13.596783 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:13.596650 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" event={"ID":"be4b6a1f-3654-4cf7-8974-c303a680cd82","Type":"ContainerDied","Data":"3de0e4e81ecdb4a0db91acd857ce414f663bd8c8adafecca8ad96d17dd146e3b"} Jun 12 18:52:13.596783 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:13.596687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" event={"ID":"be4b6a1f-3654-4cf7-8974-c303a680cd82","Type":"ContainerStarted","Data":"46ba36de0f0760fafbab2c28771ce8f19953a9724429b95e9c561bc5bd94589d"} Jun 12 18:52:13.672946 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:13.672894 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" podStartSLOduration=2.10659452 podStartE2EDuration="5.672878219s" totalImagesPullingTime="3.566283699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:13.64617449 +0000 UTC m=+585.602258568" watchObservedRunningTime="2026-06-12 18:52:13.672878219 +0000 UTC m=+585.628962377" Jun 12 18:52:15.552590 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:15.552561 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-zsdfh" Jun 12 18:52:15.554353 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:15.554337 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-gt92z" Jun 12 18:52:16.063434 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.063396 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv"] Jun 12 18:52:16.097886 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.097805 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv"] Jun 12 18:52:16.098041 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.097914 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:16.102113 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.102088 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 12 18:52:16.102113 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.102099 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 12 18:52:16.107646 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.107627 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7bfwv\"" Jun 12 18:52:16.187938 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.187905 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/54b15c44-3c73-4f9d-b8c5-c23831183371-operator-config\") pod \"servicemesh-operator3-57f65f65fb-jwmqv\" (UID: \"54b15c44-3c73-4f9d-b8c5-c23831183371\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:16.188105 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.187966 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bglvd\" (UniqueName: \"kubernetes.io/projected/54b15c44-3c73-4f9d-b8c5-c23831183371-kube-api-access-bglvd\") pod \"servicemesh-operator3-57f65f65fb-jwmqv\" (UID: \"54b15c44-3c73-4f9d-b8c5-c23831183371\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:16.289344 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.289308 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/54b15c44-3c73-4f9d-b8c5-c23831183371-operator-config\") pod \"servicemesh-operator3-57f65f65fb-jwmqv\" (UID: \"54b15c44-3c73-4f9d-b8c5-c23831183371\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:16.289502 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.289400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bglvd\" (UniqueName: \"kubernetes.io/projected/54b15c44-3c73-4f9d-b8c5-c23831183371-kube-api-access-bglvd\") pod \"servicemesh-operator3-57f65f65fb-jwmqv\" (UID: \"54b15c44-3c73-4f9d-b8c5-c23831183371\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:16.291928 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.291903 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/54b15c44-3c73-4f9d-b8c5-c23831183371-operator-config\") pod \"servicemesh-operator3-57f65f65fb-jwmqv\" (UID: \"54b15c44-3c73-4f9d-b8c5-c23831183371\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:16.304404 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.304378 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bglvd\" (UniqueName: \"kubernetes.io/projected/54b15c44-3c73-4f9d-b8c5-c23831183371-kube-api-access-bglvd\") pod \"servicemesh-operator3-57f65f65fb-jwmqv\" (UID: \"54b15c44-3c73-4f9d-b8c5-c23831183371\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:16.409601 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.409578 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:16.564450 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.564416 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv"] Jun 12 18:52:16.567987 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:52:16.567959 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b15c44_3c73_4f9d_b8c5_c23831183371.slice/crio-f3ee1cb427cd7a44929ad9a4747c6c6609bfc43951b63a1130752bf3a016c579 WatchSource:0}: Error finding container f3ee1cb427cd7a44929ad9a4747c6c6609bfc43951b63a1130752bf3a016c579: Status 404 returned error can't find the container with id f3ee1cb427cd7a44929ad9a4747c6c6609bfc43951b63a1130752bf3a016c579 Jun 12 18:52:16.613577 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:16.613545 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" event={"ID":"54b15c44-3c73-4f9d-b8c5-c23831183371","Type":"ContainerStarted","Data":"f3ee1cb427cd7a44929ad9a4747c6c6609bfc43951b63a1130752bf3a016c579"} Jun 12 18:52:18.628568 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:18.628533 2559 generic.go:356] "Generic (PLEG): container finished" podID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerID="4a25820834591431681c51ccef98dbd097d9be16fc35c1cc01376b9eb5ffa5bf" exitCode=0 Jun 12 18:52:18.629041 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:18.628600 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" event={"ID":"be4b6a1f-3654-4cf7-8974-c303a680cd82","Type":"ContainerDied","Data":"4a25820834591431681c51ccef98dbd097d9be16fc35c1cc01376b9eb5ffa5bf"} Jun 12 18:52:19.637202 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:19.637162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" event={"ID":"54b15c44-3c73-4f9d-b8c5-c23831183371","Type":"ContainerStarted","Data":"b72e72e694b3043ee4468dee197f2a118c42493f07a5718dcdcd3710d2c5cda7"} Jun 12 18:52:19.637913 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:19.637861 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:19.640952 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:19.640924 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" event={"ID":"be4b6a1f-3654-4cf7-8974-c303a680cd82","Type":"ContainerStarted","Data":"6c38a5cece90a9b1cf7a506f580d4496d8541ea68ff1eaf27af1924cc3b63715"} Jun 12 18:52:19.703405 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:19.703248 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" podStartSLOduration=0.777046736 podStartE2EDuration="3.703227124s" totalImagesPullingTime="2.926180388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:19.696415693 +0000 UTC m=+591.652499800" watchObservedRunningTime="2026-06-12 18:52:19.703227124 +0000 UTC m=+591.659311205" Jun 12 18:52:19.739995 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:19.739927 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" podStartSLOduration=3.593001589 podStartE2EDuration="7.739903013s" totalImagesPullingTime="4.146901424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:19.738623203 +0000 UTC m=+591.694707281" watchObservedRunningTime="2026-06-12 18:52:19.739903013 +0000 UTC m=+591.695987093" Jun 12 18:52:20.647160 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:20.647129 2559 generic.go:356] "Generic (PLEG): container finished" podID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerID="6c38a5cece90a9b1cf7a506f580d4496d8541ea68ff1eaf27af1924cc3b63715" exitCode=0 Jun 12 18:52:20.647547 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:20.647197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" event={"ID":"be4b6a1f-3654-4cf7-8974-c303a680cd82","Type":"ContainerDied","Data":"6c38a5cece90a9b1cf7a506f580d4496d8541ea68ff1eaf27af1924cc3b63715"} Jun 12 18:52:21.774153 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:21.774130 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:21.938705 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:21.938678 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-bundle\") pod \"be4b6a1f-3654-4cf7-8974-c303a680cd82\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " Jun 12 18:52:21.938907 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:21.938750 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-util\") pod \"be4b6a1f-3654-4cf7-8974-c303a680cd82\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " Jun 12 18:52:21.938907 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:21.938795 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n85d5\" (UniqueName: \"kubernetes.io/projected/be4b6a1f-3654-4cf7-8974-c303a680cd82-kube-api-access-n85d5\") pod \"be4b6a1f-3654-4cf7-8974-c303a680cd82\" (UID: \"be4b6a1f-3654-4cf7-8974-c303a680cd82\") " Jun 12 18:52:21.939645 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:21.939618 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-bundle" (OuterVolumeSpecName: "bundle") pod "be4b6a1f-3654-4cf7-8974-c303a680cd82" (UID: "be4b6a1f-3654-4cf7-8974-c303a680cd82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:52:21.940992 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:21.940964 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4b6a1f-3654-4cf7-8974-c303a680cd82-kube-api-access-n85d5" (OuterVolumeSpecName: "kube-api-access-n85d5") pod "be4b6a1f-3654-4cf7-8974-c303a680cd82" (UID: "be4b6a1f-3654-4cf7-8974-c303a680cd82"). InnerVolumeSpecName "kube-api-access-n85d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:52:21.944612 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:21.944585 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-util" (OuterVolumeSpecName: "util") pod "be4b6a1f-3654-4cf7-8974-c303a680cd82" (UID: "be4b6a1f-3654-4cf7-8974-c303a680cd82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:52:22.039939 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:22.039905 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n85d5\" (UniqueName: \"kubernetes.io/projected/be4b6a1f-3654-4cf7-8974-c303a680cd82-kube-api-access-n85d5\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:52:22.039939 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:22.039934 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:52:22.039939 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:22.039945 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4b6a1f-3654-4cf7-8974-c303a680cd82-util\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:52:22.657872 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:22.657839 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" event={"ID":"be4b6a1f-3654-4cf7-8974-c303a680cd82","Type":"ContainerDied","Data":"46ba36de0f0760fafbab2c28771ce8f19953a9724429b95e9c561bc5bd94589d"} Jun 12 18:52:22.657872 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:22.657865 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac5bsj" Jun 12 18:52:22.658069 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:22.657888 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46ba36de0f0760fafbab2c28771ce8f19953a9724429b95e9c561bc5bd94589d" Jun 12 18:52:28.424494 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:28.424463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:52:28.425009 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:28.424857 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:52:31.653733 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:31.653697 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jwmqv" Jun 12 18:52:32.958839 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.958804 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn"] Jun 12 18:52:32.959214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.959112 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerName="pull" Jun 12 18:52:32.959214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.959122 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerName="pull" Jun 12 18:52:32.959214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.959131 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerName="util" Jun 12 18:52:32.959214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.959136 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerName="util" Jun 12 18:52:32.959214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.959147 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerName="extract" Jun 12 18:52:32.959214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.959153 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerName="extract" Jun 12 18:52:32.959214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.959203 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4b6a1f-3654-4cf7-8974-c303a680cd82" containerName="extract" Jun 12 18:52:32.961894 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.961879 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:32.964858 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.964836 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 12 18:52:32.965018 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.964903 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 18:52:32.965018 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.964945 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 12 18:52:32.965214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.965198 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gl9lx\"" Jun 12 18:52:32.965270 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.965260 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 12 18:52:32.978713 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:32.978692 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn"] Jun 12 18:52:33.032573 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.032506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.032734 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.032582 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.032734 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.032611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.032734 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.032626 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.032734 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.032702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.032734 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.032732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.032896 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.032775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d252\" (UniqueName: \"kubernetes.io/projected/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-kube-api-access-6d252\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.134041 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.134003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d252\" (UniqueName: \"kubernetes.io/projected/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-kube-api-access-6d252\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.134212 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.134062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.134212 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.134162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.134212 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.134197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.134378 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.134216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.134378 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.134261 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.134481 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.134415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.135159 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.135136 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.136687 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.136661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.136951 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.136931 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.137084 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.137041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.137149 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.137134 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.147157 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.147132 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d252\" (UniqueName: \"kubernetes.io/projected/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-kube-api-access-6d252\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.147803 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.147781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-2ppgn\" (UID: \"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.271639 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.271547 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:33.420717 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.420693 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn"] Jun 12 18:52:33.422002 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:52:33.421970 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ff815c_bbb7_4092_9c2f_ee966d4f2bb9.slice/crio-bd4bb57e439a41938ab9b9ba9e3daa31e72b960bb067f5e88a73e61638937788 WatchSource:0}: Error finding container bd4bb57e439a41938ab9b9ba9e3daa31e72b960bb067f5e88a73e61638937788: Status 404 returned error can't find the container with id bd4bb57e439a41938ab9b9ba9e3daa31e72b960bb067f5e88a73e61638937788 Jun 12 18:52:33.713490 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:33.713456 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" event={"ID":"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9","Type":"ContainerStarted","Data":"bd4bb57e439a41938ab9b9ba9e3daa31e72b960bb067f5e88a73e61638937788"} Jun 12 18:52:36.503679 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:36.503633 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 12 18:52:36.503982 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:36.503704 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 12 18:52:36.730085 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:36.730044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" event={"ID":"f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9","Type":"ContainerStarted","Data":"8fcc65baa891ec1879b17def2865c9c2b21f59c8d58e3796894daa1e7861a59f"} Jun 12 18:52:36.730250 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:36.730128 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:36.755973 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:36.755859 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" podStartSLOduration=1.6764532760000002 podStartE2EDuration="4.75582607s" totalImagesPullingTime="3.079372794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:36.752889379 +0000 UTC m=+608.708973458" watchObservedRunningTime="2026-06-12 18:52:36.75582607 +0000 UTC m=+608.711910152" Jun 12 18:52:37.736322 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:37.736289 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-2ppgn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 12 18:52:37.736702 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:37.736349 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" podUID="f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:52:40.735283 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:40.735249 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-2ppgn" Jun 12 18:52:42.718775 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.718736 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-84cbf9-jwm2g"] Jun 12 18:52:42.722687 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.722663 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" Jun 12 18:52:42.725623 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.725603 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pfbgh\"" Jun 12 18:52:42.725878 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.725865 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 18:52:42.733491 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.733461 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84cbf9-jwm2g"] Jun 12 18:52:42.832032 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.831997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tdcl\" (UniqueName: \"kubernetes.io/projected/ea8f3694-c8fe-4afa-87a5-5573b109e84c-kube-api-access-8tdcl\") pod \"dashboard-redirect-84cbf9-jwm2g\" (UID: \"ea8f3694-c8fe-4afa-87a5-5573b109e84c\") " pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" Jun 12 18:52:42.832032 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.832040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ea8f3694-c8fe-4afa-87a5-5573b109e84c-redirect-config\") pod \"dashboard-redirect-84cbf9-jwm2g\" (UID: \"ea8f3694-c8fe-4afa-87a5-5573b109e84c\") " pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" Jun 12 18:52:42.932841 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.932798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tdcl\" (UniqueName: \"kubernetes.io/projected/ea8f3694-c8fe-4afa-87a5-5573b109e84c-kube-api-access-8tdcl\") pod \"dashboard-redirect-84cbf9-jwm2g\" (UID: \"ea8f3694-c8fe-4afa-87a5-5573b109e84c\") " pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" Jun 12 18:52:42.932841 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.932846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ea8f3694-c8fe-4afa-87a5-5573b109e84c-redirect-config\") pod \"dashboard-redirect-84cbf9-jwm2g\" (UID: \"ea8f3694-c8fe-4afa-87a5-5573b109e84c\") " pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" Jun 12 18:52:42.933607 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.933584 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ea8f3694-c8fe-4afa-87a5-5573b109e84c-redirect-config\") pod \"dashboard-redirect-84cbf9-jwm2g\" (UID: \"ea8f3694-c8fe-4afa-87a5-5573b109e84c\") " pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" Jun 12 18:52:42.942168 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:42.942150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tdcl\" (UniqueName: \"kubernetes.io/projected/ea8f3694-c8fe-4afa-87a5-5573b109e84c-kube-api-access-8tdcl\") pod \"dashboard-redirect-84cbf9-jwm2g\" (UID: \"ea8f3694-c8fe-4afa-87a5-5573b109e84c\") " pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" Jun 12 18:52:43.034084 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:43.034002 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" Jun 12 18:52:43.169498 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:43.169469 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84cbf9-jwm2g"] Jun 12 18:52:43.171380 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:52:43.171350 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8f3694_c8fe_4afa_87a5_5573b109e84c.slice/crio-0ce2ec270c1c89b21678cac36c3ca8eb49e067e9e0497fe554e548e33e1e9db7 WatchSource:0}: Error finding container 0ce2ec270c1c89b21678cac36c3ca8eb49e067e9e0497fe554e548e33e1e9db7: Status 404 returned error can't find the container with id 0ce2ec270c1c89b21678cac36c3ca8eb49e067e9e0497fe554e548e33e1e9db7 Jun 12 18:52:43.602292 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:43.602267 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-299s9" Jun 12 18:52:43.766022 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:43.765984 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" event={"ID":"ea8f3694-c8fe-4afa-87a5-5573b109e84c","Type":"ContainerStarted","Data":"0ce2ec270c1c89b21678cac36c3ca8eb49e067e9e0497fe554e548e33e1e9db7"} Jun 12 18:52:44.603528 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:44.603481 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-n9jh8" Jun 12 18:52:45.781099 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:45.781016 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" event={"ID":"ea8f3694-c8fe-4afa-87a5-5573b109e84c","Type":"ContainerStarted","Data":"5747db09a367b150f1a26669c6304f6a914ef3473e4a9b769d9ad859c0661bd0"} Jun 12 18:52:45.798384 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:52:45.798327 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-84cbf9-jwm2g" podStartSLOduration=1.5138610909999999 podStartE2EDuration="3.798312259s" totalImagesPullingTime="2.284451168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:45.797292172 +0000 UTC m=+617.753376251" watchObservedRunningTime="2026-06-12 18:52:45.798312259 +0000 UTC m=+617.754396337" Jun 12 18:53:14.360803 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.360767 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf"] Jun 12 18:53:14.373176 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.373152 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.376423 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.376399 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5pxfj\"" Jun 12 18:53:14.376766 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.376744 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:53:14.377712 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.377692 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:53:14.378001 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.377981 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf"] Jun 12 18:53:14.404379 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.404355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.404535 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.404406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.404535 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.404438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6bmm\" (UniqueName: \"kubernetes.io/projected/e91cc664-3504-49ca-af58-66279580cfc3-kube-api-access-k6bmm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.505698 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.505665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.505880 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.505708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.505880 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.505727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6bmm\" (UniqueName: \"kubernetes.io/projected/e91cc664-3504-49ca-af58-66279580cfc3-kube-api-access-k6bmm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.506037 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.506018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.506112 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.506091 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.514975 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.514952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6bmm\" (UniqueName: \"kubernetes.io/projected/e91cc664-3504-49ca-af58-66279580cfc3-kube-api-access-k6bmm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.684658 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.684624 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:14.817475 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.817450 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf"] Jun 12 18:53:14.894126 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.894103 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq"] Jun 12 18:53:14.897579 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.897561 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:14.907478 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.907450 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq"] Jun 12 18:53:14.910800 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.910777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:14.910910 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.910808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlf9k\" (UniqueName: \"kubernetes.io/projected/23723515-e851-4cff-83a9-3839cb7fa88f-kube-api-access-hlf9k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:14.910974 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.910909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:14.920380 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.920343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" event={"ID":"e91cc664-3504-49ca-af58-66279580cfc3","Type":"ContainerStarted","Data":"2f7a9d0f48a30b9c0fdc882fea79a2772051a64dc3ddf837e6457f072a1ffd19"} Jun 12 18:53:14.920580 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:14.920400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" event={"ID":"e91cc664-3504-49ca-af58-66279580cfc3","Type":"ContainerStarted","Data":"c5225d85572d1f9541f1d74aa235a7d87edef4b4046292858def63549b9b6527"} Jun 12 18:53:15.011470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.011437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:15.011470 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.011470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlf9k\" (UniqueName: \"kubernetes.io/projected/23723515-e851-4cff-83a9-3839cb7fa88f-kube-api-access-hlf9k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:15.011710 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.011551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:15.011895 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.011872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:15.011956 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.011900 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:15.019717 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.019696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlf9k\" (UniqueName: \"kubernetes.io/projected/23723515-e851-4cff-83a9-3839cb7fa88f-kube-api-access-hlf9k\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:15.207261 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.207178 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:15.293394 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.293364 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s"] Jun 12 18:53:15.297243 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.297222 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.305325 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.305299 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s"] Jun 12 18:53:15.313841 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.313811 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.313952 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.313923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b7hc\" (UniqueName: \"kubernetes.io/projected/06f09de0-03f8-4be0-8a95-5827a7eddb3a-kube-api-access-7b7hc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.313993 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.313956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.343062 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.343038 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq"] Jun 12 18:53:15.344700 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:53:15.344672 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23723515_e851_4cff_83a9_3839cb7fa88f.slice/crio-1adad78df81f7460b9077d1a388048d2f05c342442fba8a4d4f1f3f709855ea5 WatchSource:0}: Error finding container 1adad78df81f7460b9077d1a388048d2f05c342442fba8a4d4f1f3f709855ea5: Status 404 returned error can't find the container with id 1adad78df81f7460b9077d1a388048d2f05c342442fba8a4d4f1f3f709855ea5 Jun 12 18:53:15.414982 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.414959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b7hc\" (UniqueName: \"kubernetes.io/projected/06f09de0-03f8-4be0-8a95-5827a7eddb3a-kube-api-access-7b7hc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.415370 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.414995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.415370 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.415111 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.415455 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.415440 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.415492 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.415476 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.425208 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.425183 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b7hc\" (UniqueName: \"kubernetes.io/projected/06f09de0-03f8-4be0-8a95-5827a7eddb3a-kube-api-access-7b7hc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.608424 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.608377 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:15.752949 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.752917 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s"] Jun 12 18:53:15.756286 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:53:15.756260 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f09de0_03f8_4be0_8a95_5827a7eddb3a.slice/crio-35090948f881e38e9fbee4fa96d9b743e31096fde007e25c4ace43781f2403e4 WatchSource:0}: Error finding container 35090948f881e38e9fbee4fa96d9b743e31096fde007e25c4ace43781f2403e4: Status 404 returned error can't find the container with id 35090948f881e38e9fbee4fa96d9b743e31096fde007e25c4ace43781f2403e4 Jun 12 18:53:15.926649 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.926617 2559 generic.go:356] "Generic (PLEG): container finished" podID="23723515-e851-4cff-83a9-3839cb7fa88f" containerID="cb1888a4858d93c56c2c4355e9cb4251d37fe44e383e6097e3b0e6d6b1b16e84" exitCode=0 Jun 12 18:53:15.926800 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.926698 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" event={"ID":"23723515-e851-4cff-83a9-3839cb7fa88f","Type":"ContainerDied","Data":"cb1888a4858d93c56c2c4355e9cb4251d37fe44e383e6097e3b0e6d6b1b16e84"} Jun 12 18:53:15.926800 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.926753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" event={"ID":"23723515-e851-4cff-83a9-3839cb7fa88f","Type":"ContainerStarted","Data":"1adad78df81f7460b9077d1a388048d2f05c342442fba8a4d4f1f3f709855ea5"} Jun 12 18:53:15.928245 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.928222 2559 generic.go:356] "Generic (PLEG): container finished" podID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerID="c772cbf83c4c359c5c95e738dc0cfe12fd6ebb2179cbcbb3af79667bd8f9f1a6" exitCode=0 Jun 12 18:53:15.928356 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.928302 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" event={"ID":"06f09de0-03f8-4be0-8a95-5827a7eddb3a","Type":"ContainerDied","Data":"c772cbf83c4c359c5c95e738dc0cfe12fd6ebb2179cbcbb3af79667bd8f9f1a6"} Jun 12 18:53:15.928405 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.928352 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" event={"ID":"06f09de0-03f8-4be0-8a95-5827a7eddb3a","Type":"ContainerStarted","Data":"35090948f881e38e9fbee4fa96d9b743e31096fde007e25c4ace43781f2403e4"} Jun 12 18:53:15.930111 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.929959 2559 generic.go:356] "Generic (PLEG): container finished" podID="e91cc664-3504-49ca-af58-66279580cfc3" containerID="2f7a9d0f48a30b9c0fdc882fea79a2772051a64dc3ddf837e6457f072a1ffd19" exitCode=0 Jun 12 18:53:15.930111 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:15.930022 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" event={"ID":"e91cc664-3504-49ca-af58-66279580cfc3","Type":"ContainerDied","Data":"2f7a9d0f48a30b9c0fdc882fea79a2772051a64dc3ddf837e6457f072a1ffd19"} Jun 12 18:53:16.936023 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:16.935997 2559 generic.go:356] "Generic (PLEG): container finished" podID="23723515-e851-4cff-83a9-3839cb7fa88f" containerID="22991cf465f051b8740a22abde3199818b07042fc105c5367453ae4a22d19663" exitCode=0 Jun 12 18:53:16.936419 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:16.936058 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" event={"ID":"23723515-e851-4cff-83a9-3839cb7fa88f","Type":"ContainerDied","Data":"22991cf465f051b8740a22abde3199818b07042fc105c5367453ae4a22d19663"} Jun 12 18:53:16.937876 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:16.937854 2559 generic.go:356] "Generic (PLEG): container finished" podID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerID="50f59f874fc44782a7748f9976b1e333b04cb3e30a10d86bfaeb59dabc83b4e2" exitCode=0 Jun 12 18:53:16.937966 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:16.937942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" event={"ID":"06f09de0-03f8-4be0-8a95-5827a7eddb3a","Type":"ContainerDied","Data":"50f59f874fc44782a7748f9976b1e333b04cb3e30a10d86bfaeb59dabc83b4e2"} Jun 12 18:53:16.939782 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:16.939763 2559 generic.go:356] "Generic (PLEG): container finished" podID="e91cc664-3504-49ca-af58-66279580cfc3" containerID="6ab5ba8e58a43a192528bacc93a61407896629e0af5a31f58019889ed7a4c124" exitCode=0 Jun 12 18:53:16.939886 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:16.939808 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" event={"ID":"e91cc664-3504-49ca-af58-66279580cfc3","Type":"ContainerDied","Data":"6ab5ba8e58a43a192528bacc93a61407896629e0af5a31f58019889ed7a4c124"} Jun 12 18:53:17.949167 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:17.949121 2559 generic.go:356] "Generic (PLEG): container finished" podID="23723515-e851-4cff-83a9-3839cb7fa88f" containerID="9ba01fd98bb5b3f19b4ccb853682f56ab66088d784042ffeb930df172356ab2f" exitCode=0 Jun 12 18:53:17.949643 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:17.949204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" event={"ID":"23723515-e851-4cff-83a9-3839cb7fa88f","Type":"ContainerDied","Data":"9ba01fd98bb5b3f19b4ccb853682f56ab66088d784042ffeb930df172356ab2f"} Jun 12 18:53:17.951468 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:17.951443 2559 generic.go:356] "Generic (PLEG): container finished" podID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerID="f55176e876001b3453f60610e8dc584b7f53723a8a1ffe12d9a5f42fe53371e8" exitCode=0 Jun 12 18:53:17.951608 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:17.951540 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" event={"ID":"06f09de0-03f8-4be0-8a95-5827a7eddb3a","Type":"ContainerDied","Data":"f55176e876001b3453f60610e8dc584b7f53723a8a1ffe12d9a5f42fe53371e8"} Jun 12 18:53:17.953608 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:17.953585 2559 generic.go:356] "Generic (PLEG): container finished" podID="e91cc664-3504-49ca-af58-66279580cfc3" containerID="d8127c993b691931cd4160f3cbf999e6b7b2b2968d83e4bac7fd970811165324" exitCode=0 Jun 12 18:53:17.953706 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:17.953659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" event={"ID":"e91cc664-3504-49ca-af58-66279580cfc3","Type":"ContainerDied","Data":"d8127c993b691931cd4160f3cbf999e6b7b2b2968d83e4bac7fd970811165324"} Jun 12 18:53:19.100413 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.100390 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:19.144464 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.144441 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-bundle\") pod \"23723515-e851-4cff-83a9-3839cb7fa88f\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " Jun 12 18:53:19.144746 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.144503 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlf9k\" (UniqueName: \"kubernetes.io/projected/23723515-e851-4cff-83a9-3839cb7fa88f-kube-api-access-hlf9k\") pod \"23723515-e851-4cff-83a9-3839cb7fa88f\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " Jun 12 18:53:19.144746 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.144563 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-util\") pod \"23723515-e851-4cff-83a9-3839cb7fa88f\" (UID: \"23723515-e851-4cff-83a9-3839cb7fa88f\") " Jun 12 18:53:19.145042 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.145022 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:19.145129 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.145052 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-bundle" (OuterVolumeSpecName: "bundle") pod "23723515-e851-4cff-83a9-3839cb7fa88f" (UID: "23723515-e851-4cff-83a9-3839cb7fa88f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:53:19.147046 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.147025 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23723515-e851-4cff-83a9-3839cb7fa88f-kube-api-access-hlf9k" (OuterVolumeSpecName: "kube-api-access-hlf9k") pod "23723515-e851-4cff-83a9-3839cb7fa88f" (UID: "23723515-e851-4cff-83a9-3839cb7fa88f"). InnerVolumeSpecName "kube-api-access-hlf9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:53:19.148687 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.148668 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:19.150412 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.150367 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-util" (OuterVolumeSpecName: "util") pod "23723515-e851-4cff-83a9-3839cb7fa88f" (UID: "23723515-e851-4cff-83a9-3839cb7fa88f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:53:19.245449 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245364 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-util\") pod \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " Jun 12 18:53:19.245449 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245426 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6bmm\" (UniqueName: \"kubernetes.io/projected/e91cc664-3504-49ca-af58-66279580cfc3-kube-api-access-k6bmm\") pod \"e91cc664-3504-49ca-af58-66279580cfc3\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " Jun 12 18:53:19.245676 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245466 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-bundle\") pod \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " Jun 12 18:53:19.245676 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245492 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-util\") pod \"e91cc664-3504-49ca-af58-66279580cfc3\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " Jun 12 18:53:19.245676 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245558 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b7hc\" (UniqueName: \"kubernetes.io/projected/06f09de0-03f8-4be0-8a95-5827a7eddb3a-kube-api-access-7b7hc\") pod \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\" (UID: \"06f09de0-03f8-4be0-8a95-5827a7eddb3a\") " Jun 12 18:53:19.245676 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245590 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-bundle\") pod \"e91cc664-3504-49ca-af58-66279580cfc3\" (UID: \"e91cc664-3504-49ca-af58-66279580cfc3\") " Jun 12 18:53:19.245879 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245833 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlf9k\" (UniqueName: \"kubernetes.io/projected/23723515-e851-4cff-83a9-3839cb7fa88f-kube-api-access-hlf9k\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.245879 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245850 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-util\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.245879 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.245864 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23723515-e851-4cff-83a9-3839cb7fa88f-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.246122 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.246077 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-bundle" (OuterVolumeSpecName: "bundle") pod "06f09de0-03f8-4be0-8a95-5827a7eddb3a" (UID: "06f09de0-03f8-4be0-8a95-5827a7eddb3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:53:19.246122 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.246115 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-bundle" (OuterVolumeSpecName: "bundle") pod "e91cc664-3504-49ca-af58-66279580cfc3" (UID: "e91cc664-3504-49ca-af58-66279580cfc3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:53:19.247722 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.247698 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f09de0-03f8-4be0-8a95-5827a7eddb3a-kube-api-access-7b7hc" (OuterVolumeSpecName: "kube-api-access-7b7hc") pod "06f09de0-03f8-4be0-8a95-5827a7eddb3a" (UID: "06f09de0-03f8-4be0-8a95-5827a7eddb3a"). InnerVolumeSpecName "kube-api-access-7b7hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:53:19.247873 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.247857 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91cc664-3504-49ca-af58-66279580cfc3-kube-api-access-k6bmm" (OuterVolumeSpecName: "kube-api-access-k6bmm") pod "e91cc664-3504-49ca-af58-66279580cfc3" (UID: "e91cc664-3504-49ca-af58-66279580cfc3"). InnerVolumeSpecName "kube-api-access-k6bmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:53:19.251573 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.251541 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-util" (OuterVolumeSpecName: "util") pod "06f09de0-03f8-4be0-8a95-5827a7eddb3a" (UID: "06f09de0-03f8-4be0-8a95-5827a7eddb3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:53:19.251939 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.251920 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-util" (OuterVolumeSpecName: "util") pod "e91cc664-3504-49ca-af58-66279580cfc3" (UID: "e91cc664-3504-49ca-af58-66279580cfc3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:53:19.346455 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.346421 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-util\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.346455 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.346447 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6bmm\" (UniqueName: \"kubernetes.io/projected/e91cc664-3504-49ca-af58-66279580cfc3-kube-api-access-k6bmm\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.346455 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.346457 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06f09de0-03f8-4be0-8a95-5827a7eddb3a-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.346678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.346465 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-util\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.346678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.346474 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b7hc\" (UniqueName: \"kubernetes.io/projected/06f09de0-03f8-4be0-8a95-5827a7eddb3a-kube-api-access-7b7hc\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.346678 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.346482 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91cc664-3504-49ca-af58-66279580cfc3-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:19.964845 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.964814 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" Jun 12 18:53:19.965143 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.964814 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq" event={"ID":"23723515-e851-4cff-83a9-3839cb7fa88f","Type":"ContainerDied","Data":"1adad78df81f7460b9077d1a388048d2f05c342442fba8a4d4f1f3f709855ea5"} Jun 12 18:53:19.965143 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.964945 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1adad78df81f7460b9077d1a388048d2f05c342442fba8a4d4f1f3f709855ea5" Jun 12 18:53:19.966646 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.966628 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" Jun 12 18:53:19.966646 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.966636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s" event={"ID":"06f09de0-03f8-4be0-8a95-5827a7eddb3a","Type":"ContainerDied","Data":"35090948f881e38e9fbee4fa96d9b743e31096fde007e25c4ace43781f2403e4"} Jun 12 18:53:19.966834 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.966669 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35090948f881e38e9fbee4fa96d9b743e31096fde007e25c4ace43781f2403e4" Jun 12 18:53:19.968611 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.968584 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" event={"ID":"e91cc664-3504-49ca-af58-66279580cfc3","Type":"ContainerDied","Data":"c5225d85572d1f9541f1d74aa235a7d87edef4b4046292858def63549b9b6527"} Jun 12 18:53:19.968787 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.968619 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf" Jun 12 18:53:19.968787 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:19.968663 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5225d85572d1f9541f1d74aa235a7d87edef4b4046292858def63549b9b6527" Jun 12 18:53:38.115291 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115251 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd"] Jun 12 18:53:38.115818 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115788 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerName="util" Jun 12 18:53:38.115818 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115806 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerName="util" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115820 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91cc664-3504-49ca-af58-66279580cfc3" containerName="extract" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115829 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91cc664-3504-49ca-af58-66279580cfc3" containerName="extract" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115841 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23723515-e851-4cff-83a9-3839cb7fa88f" containerName="util" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115849 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23723515-e851-4cff-83a9-3839cb7fa88f" containerName="util" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115862 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23723515-e851-4cff-83a9-3839cb7fa88f" containerName="pull" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115870 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23723515-e851-4cff-83a9-3839cb7fa88f" containerName="pull" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115882 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerName="extract" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115890 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerName="extract" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115902 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91cc664-3504-49ca-af58-66279580cfc3" containerName="util" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115910 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91cc664-3504-49ca-af58-66279580cfc3" containerName="util" Jun 12 18:53:38.115933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115932 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91cc664-3504-49ca-af58-66279580cfc3" containerName="pull" Jun 12 18:53:38.116447 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115939 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91cc664-3504-49ca-af58-66279580cfc3" containerName="pull" Jun 12 18:53:38.116447 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115948 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23723515-e851-4cff-83a9-3839cb7fa88f" containerName="extract" Jun 12 18:53:38.116447 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115956 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23723515-e851-4cff-83a9-3839cb7fa88f" containerName="extract" Jun 12 18:53:38.116447 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115968 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerName="pull" Jun 12 18:53:38.116447 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.115976 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerName="pull" Jun 12 18:53:38.116447 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.116058 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="23723515-e851-4cff-83a9-3839cb7fa88f" containerName="extract" Jun 12 18:53:38.116447 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.116068 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91cc664-3504-49ca-af58-66279580cfc3" containerName="extract" Jun 12 18:53:38.116447 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.116079 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="06f09de0-03f8-4be0-8a95-5827a7eddb3a" containerName="extract" Jun 12 18:53:38.119430 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.119411 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" Jun 12 18:53:38.123465 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.123448 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pvnwj\"" Jun 12 18:53:38.123790 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.123766 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:53:38.149171 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.149146 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 12 18:53:38.149171 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.149168 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:53:38.197373 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.197343 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd"] Jun 12 18:53:38.205307 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.205283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fptz2\" (UniqueName: \"kubernetes.io/projected/36306bf9-9cb7-433b-be1f-bdf78dad3aaa-kube-api-access-fptz2\") pod \"dns-operator-controller-manager-864dd78c4c-zgdgd\" (UID: \"36306bf9-9cb7-433b-be1f-bdf78dad3aaa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" Jun 12 18:53:38.305731 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.305691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fptz2\" (UniqueName: \"kubernetes.io/projected/36306bf9-9cb7-433b-be1f-bdf78dad3aaa-kube-api-access-fptz2\") pod \"dns-operator-controller-manager-864dd78c4c-zgdgd\" (UID: \"36306bf9-9cb7-433b-be1f-bdf78dad3aaa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" Jun 12 18:53:38.325114 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.325080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fptz2\" (UniqueName: \"kubernetes.io/projected/36306bf9-9cb7-433b-be1f-bdf78dad3aaa-kube-api-access-fptz2\") pod \"dns-operator-controller-manager-864dd78c4c-zgdgd\" (UID: \"36306bf9-9cb7-433b-be1f-bdf78dad3aaa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" Jun 12 18:53:38.429642 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.429607 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" Jun 12 18:53:38.571451 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:38.571428 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd"] Jun 12 18:53:38.574000 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:53:38.573971 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36306bf9_9cb7_433b_be1f_bdf78dad3aaa.slice/crio-78da89165db87f2d92a7c1d11573daef3a95c9f07775e1fe24aa39e5901a3f93 WatchSource:0}: Error finding container 78da89165db87f2d92a7c1d11573daef3a95c9f07775e1fe24aa39e5901a3f93: Status 404 returned error can't find the container with id 78da89165db87f2d92a7c1d11573daef3a95c9f07775e1fe24aa39e5901a3f93 Jun 12 18:53:39.060940 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:39.060896 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" event={"ID":"36306bf9-9cb7-433b-be1f-bdf78dad3aaa","Type":"ContainerStarted","Data":"78da89165db87f2d92a7c1d11573daef3a95c9f07775e1fe24aa39e5901a3f93"} Jun 12 18:53:40.808555 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:40.808523 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb"] Jun 12 18:53:40.811932 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:40.811918 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:40.814901 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:40.814881 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rclnx\"" Jun 12 18:53:40.845730 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:40.845697 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb"] Jun 12 18:53:40.929361 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:40.929327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg4gk\" (UniqueName: \"kubernetes.io/projected/465c42b2-8412-4189-b8f6-c57d57abd880-kube-api-access-cg4gk\") pod \"limitador-operator-controller-manager-859d7b78bd-7gzgb\" (UID: \"465c42b2-8412-4189-b8f6-c57d57abd880\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:41.029783 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:41.029748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg4gk\" (UniqueName: \"kubernetes.io/projected/465c42b2-8412-4189-b8f6-c57d57abd880-kube-api-access-cg4gk\") pod \"limitador-operator-controller-manager-859d7b78bd-7gzgb\" (UID: \"465c42b2-8412-4189-b8f6-c57d57abd880\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:41.059085 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:41.059050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg4gk\" (UniqueName: \"kubernetes.io/projected/465c42b2-8412-4189-b8f6-c57d57abd880-kube-api-access-cg4gk\") pod \"limitador-operator-controller-manager-859d7b78bd-7gzgb\" (UID: \"465c42b2-8412-4189-b8f6-c57d57abd880\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:41.072507 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:41.072478 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" event={"ID":"36306bf9-9cb7-433b-be1f-bdf78dad3aaa","Type":"ContainerStarted","Data":"6715b0923cbf6b75fdfa92a426dbe5dfa087a947ae47345826bcc71f78e382b1"} Jun 12 18:53:41.072704 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:41.072683 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" Jun 12 18:53:41.113135 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:41.113086 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" podStartSLOduration=1.056272938 podStartE2EDuration="3.113071654s" totalImagesPullingTime="2.056798716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:53:41.111479518 +0000 UTC m=+673.067563597" watchObservedRunningTime="2026-06-12 18:53:41.113071654 +0000 UTC m=+673.069155732" Jun 12 18:53:41.122295 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:41.122269 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:41.271216 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:41.271189 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb"] Jun 12 18:53:41.272072 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:53:41.272044 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465c42b2_8412_4189_b8f6_c57d57abd880.slice/crio-103aaeb4c0ac0a64967b328f4031613f2dbd5375153bfcb7821ea32a92ed4801 WatchSource:0}: Error finding container 103aaeb4c0ac0a64967b328f4031613f2dbd5375153bfcb7821ea32a92ed4801: Status 404 returned error can't find the container with id 103aaeb4c0ac0a64967b328f4031613f2dbd5375153bfcb7821ea32a92ed4801 Jun 12 18:53:42.080887 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:42.080851 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" event={"ID":"465c42b2-8412-4189-b8f6-c57d57abd880","Type":"ContainerStarted","Data":"103aaeb4c0ac0a64967b328f4031613f2dbd5375153bfcb7821ea32a92ed4801"} Jun 12 18:53:44.093861 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:44.093819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" event={"ID":"465c42b2-8412-4189-b8f6-c57d57abd880","Type":"ContainerStarted","Data":"91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f"} Jun 12 18:53:44.094267 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:44.093908 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:44.113687 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:44.113636 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" podStartSLOduration=1.7677708239999999 podStartE2EDuration="4.11362064s" totalImagesPullingTime="2.345849816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:53:44.113194723 +0000 UTC m=+676.069278822" watchObservedRunningTime="2026-06-12 18:53:44.11362064 +0000 UTC m=+676.069704718" Jun 12 18:53:52.083278 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:52.083242 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zgdgd" Jun 12 18:53:55.100624 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:55.100587 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:56.365906 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.365875 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb"] Jun 12 18:53:56.366394 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.366088 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" podUID="465c42b2-8412-4189-b8f6-c57d57abd880" containerName="manager" containerID="cri-o://91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f" gracePeriod=2 Jun 12 18:53:56.384655 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.384627 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb"] Jun 12 18:53:56.400119 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.400090 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq"] Jun 12 18:53:56.400427 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.400415 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="465c42b2-8412-4189-b8f6-c57d57abd880" containerName="manager" Jun 12 18:53:56.400471 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.400429 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="465c42b2-8412-4189-b8f6-c57d57abd880" containerName="manager" Jun 12 18:53:56.400522 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.400501 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="465c42b2-8412-4189-b8f6-c57d57abd880" containerName="manager" Jun 12 18:53:56.403485 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.403470 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" Jun 12 18:53:56.426206 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.426170 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq"] Jun 12 18:53:56.445896 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:53:56.445867 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gzgb\" is forbidden: User \"system:node:ip-10-0-132-81.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-81.ec2.internal' and this object" podUID="465c42b2-8412-4189-b8f6-c57d57abd880" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:56.572143 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.572108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjthd\" (UniqueName: \"kubernetes.io/projected/4e553e85-20ce-413e-ad63-85a1ac723cb6-kube-api-access-cjthd\") pod \"limitador-operator-controller-manager-859d7b78bd-4d5mq\" (UID: \"4e553e85-20ce-413e-ad63-85a1ac723cb6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" Jun 12 18:53:56.607521 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.607486 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:56.672776 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.672744 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjthd\" (UniqueName: \"kubernetes.io/projected/4e553e85-20ce-413e-ad63-85a1ac723cb6-kube-api-access-cjthd\") pod \"limitador-operator-controller-manager-859d7b78bd-4d5mq\" (UID: \"4e553e85-20ce-413e-ad63-85a1ac723cb6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" Jun 12 18:53:56.682784 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.682752 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjthd\" (UniqueName: \"kubernetes.io/projected/4e553e85-20ce-413e-ad63-85a1ac723cb6-kube-api-access-cjthd\") pod \"limitador-operator-controller-manager-859d7b78bd-4d5mq\" (UID: \"4e553e85-20ce-413e-ad63-85a1ac723cb6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" Jun 12 18:53:56.748733 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.748694 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" Jun 12 18:53:56.773363 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.773336 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg4gk\" (UniqueName: \"kubernetes.io/projected/465c42b2-8412-4189-b8f6-c57d57abd880-kube-api-access-cg4gk\") pod \"465c42b2-8412-4189-b8f6-c57d57abd880\" (UID: \"465c42b2-8412-4189-b8f6-c57d57abd880\") " Jun 12 18:53:56.775350 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.775312 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/465c42b2-8412-4189-b8f6-c57d57abd880-kube-api-access-cg4gk" (OuterVolumeSpecName: "kube-api-access-cg4gk") pod "465c42b2-8412-4189-b8f6-c57d57abd880" (UID: "465c42b2-8412-4189-b8f6-c57d57abd880"). InnerVolumeSpecName "kube-api-access-cg4gk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:53:56.874542 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.874489 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg4gk\" (UniqueName: \"kubernetes.io/projected/465c42b2-8412-4189-b8f6-c57d57abd880-kube-api-access-cg4gk\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:53:56.893571 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:56.893544 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq"] Jun 12 18:53:56.895256 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:53:56.895225 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e553e85_20ce_413e_ad63_85a1ac723cb6.slice/crio-a66c43f936ebf8c3b11391126125099744bbe830130ec263f0fb2931b858517e WatchSource:0}: Error finding container a66c43f936ebf8c3b11391126125099744bbe830130ec263f0fb2931b858517e: Status 404 returned error can't find the container with id a66c43f936ebf8c3b11391126125099744bbe830130ec263f0fb2931b858517e Jun 12 18:53:57.161200 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:57.161163 2559 generic.go:356] "Generic (PLEG): container finished" podID="465c42b2-8412-4189-b8f6-c57d57abd880" containerID="91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f" exitCode=0 Jun 12 18:53:57.161384 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:57.161210 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gzgb" Jun 12 18:53:57.161384 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:57.161264 2559 scope.go:117] "RemoveContainer" containerID="91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f" Jun 12 18:53:57.163146 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:57.163119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" event={"ID":"4e553e85-20ce-413e-ad63-85a1ac723cb6","Type":"ContainerStarted","Data":"11cdafe964f70ff7c98c34d424b28f4348b6ae9592d272b71dc2aed823819122"} Jun 12 18:53:57.163269 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:57.163173 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" event={"ID":"4e553e85-20ce-413e-ad63-85a1ac723cb6","Type":"ContainerStarted","Data":"a66c43f936ebf8c3b11391126125099744bbe830130ec263f0fb2931b858517e"} Jun 12 18:53:57.163269 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:57.163208 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" Jun 12 18:53:57.171332 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:57.171315 2559 scope.go:117] "RemoveContainer" containerID="91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f" Jun 12 18:53:57.171617 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:53:57.171599 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f\": container with ID starting with 91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f not found: ID does not exist" containerID="91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f" Jun 12 18:53:57.171666 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:57.171626 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f"} err="failed to get container status \"91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f\": rpc error: code = NotFound desc = could not find container \"91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f\": container with ID starting with 91d13af81137685701a5fd51ab74ed8d0c51bf4e9f94e1bef61737b6a711d62f not found: ID does not exist" Jun 12 18:53:58.440211 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:53:58.440178 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="465c42b2-8412-4189-b8f6-c57d57abd880" path="/var/lib/kubelet/pods/465c42b2-8412-4189-b8f6-c57d57abd880/volumes" Jun 12 18:54:08.171885 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:08.171854 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" Jun 12 18:54:08.196129 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:08.196083 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d5mq" podStartSLOduration=12.196066891 podStartE2EDuration="12.196066891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:53:57.203399733 +0000 UTC m=+689.159483813" watchObservedRunningTime="2026-06-12 18:54:08.196066891 +0000 UTC m=+700.152150969" Jun 12 18:54:27.059386 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.059304 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5xb9b"] Jun 12 18:54:27.062717 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.062702 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:27.066092 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.066068 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 18:54:27.066301 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.066288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5pxfj\"" Jun 12 18:54:27.135959 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.135925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/64a4d813-c270-4389-aa46-b69f727a6c7d-config-file\") pod \"limitador-limitador-64c94fd64f-5xb9b\" (UID: \"64a4d813-c270-4389-aa46-b69f727a6c7d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:27.135959 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.135959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrff5\" (UniqueName: \"kubernetes.io/projected/64a4d813-c270-4389-aa46-b69f727a6c7d-kube-api-access-mrff5\") pod \"limitador-limitador-64c94fd64f-5xb9b\" (UID: \"64a4d813-c270-4389-aa46-b69f727a6c7d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:27.150682 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.150650 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5xb9b"] Jun 12 18:54:27.179053 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.179022 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5xb9b"] Jun 12 18:54:27.237292 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.237257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/64a4d813-c270-4389-aa46-b69f727a6c7d-config-file\") pod \"limitador-limitador-64c94fd64f-5xb9b\" (UID: \"64a4d813-c270-4389-aa46-b69f727a6c7d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:27.237451 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.237295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrff5\" (UniqueName: \"kubernetes.io/projected/64a4d813-c270-4389-aa46-b69f727a6c7d-kube-api-access-mrff5\") pod \"limitador-limitador-64c94fd64f-5xb9b\" (UID: \"64a4d813-c270-4389-aa46-b69f727a6c7d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:27.237927 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.237907 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/64a4d813-c270-4389-aa46-b69f727a6c7d-config-file\") pod \"limitador-limitador-64c94fd64f-5xb9b\" (UID: \"64a4d813-c270-4389-aa46-b69f727a6c7d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:27.253503 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.253477 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrff5\" (UniqueName: \"kubernetes.io/projected/64a4d813-c270-4389-aa46-b69f727a6c7d-kube-api-access-mrff5\") pod \"limitador-limitador-64c94fd64f-5xb9b\" (UID: \"64a4d813-c270-4389-aa46-b69f727a6c7d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:27.374285 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.374190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:27.519944 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:27.519867 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5xb9b"] Jun 12 18:54:27.522171 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:54:27.522145 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a4d813_c270_4389_aa46_b69f727a6c7d.slice/crio-675039e16342b7c605ad4ef810bd8bf9b8fee2900d6468fbab6f0e2b962efef7 WatchSource:0}: Error finding container 675039e16342b7c605ad4ef810bd8bf9b8fee2900d6468fbab6f0e2b962efef7: Status 404 returned error can't find the container with id 675039e16342b7c605ad4ef810bd8bf9b8fee2900d6468fbab6f0e2b962efef7 Jun 12 18:54:28.328963 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:28.328925 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" event={"ID":"64a4d813-c270-4389-aa46-b69f727a6c7d","Type":"ContainerStarted","Data":"675039e16342b7c605ad4ef810bd8bf9b8fee2900d6468fbab6f0e2b962efef7"} Jun 12 18:54:31.348569 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:31.348526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" event={"ID":"64a4d813-c270-4389-aa46-b69f727a6c7d","Type":"ContainerStarted","Data":"8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8"} Jun 12 18:54:31.348945 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:31.348686 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:31.367157 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:31.367098 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" podStartSLOduration=1.395594139 podStartE2EDuration="4.367084379s" totalImagesPullingTime="2.97149024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:31.366927609 +0000 UTC m=+723.323011716" watchObservedRunningTime="2026-06-12 18:54:31.367084379 +0000 UTC m=+723.323168458" Jun 12 18:54:42.355920 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:42.355887 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:44.269437 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:44.269405 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5xb9b"] Jun 12 18:54:44.269948 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:44.269711 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" podUID="64a4d813-c270-4389-aa46-b69f727a6c7d" containerName="limitador" containerID="cri-o://8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8" gracePeriod=30 Jun 12 18:54:44.812803 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:44.812779 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:44.898421 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:44.898338 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/64a4d813-c270-4389-aa46-b69f727a6c7d-config-file\") pod \"64a4d813-c270-4389-aa46-b69f727a6c7d\" (UID: \"64a4d813-c270-4389-aa46-b69f727a6c7d\") " Jun 12 18:54:44.898421 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:44.898405 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrff5\" (UniqueName: \"kubernetes.io/projected/64a4d813-c270-4389-aa46-b69f727a6c7d-kube-api-access-mrff5\") pod \"64a4d813-c270-4389-aa46-b69f727a6c7d\" (UID: \"64a4d813-c270-4389-aa46-b69f727a6c7d\") " Jun 12 18:54:44.898802 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:44.898781 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a4d813-c270-4389-aa46-b69f727a6c7d-config-file" (OuterVolumeSpecName: "config-file") pod "64a4d813-c270-4389-aa46-b69f727a6c7d" (UID: "64a4d813-c270-4389-aa46-b69f727a6c7d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:54:44.900399 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:44.900378 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a4d813-c270-4389-aa46-b69f727a6c7d-kube-api-access-mrff5" (OuterVolumeSpecName: "kube-api-access-mrff5") pod "64a4d813-c270-4389-aa46-b69f727a6c7d" (UID: "64a4d813-c270-4389-aa46-b69f727a6c7d"). InnerVolumeSpecName "kube-api-access-mrff5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:54:45.000039 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.000004 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrff5\" (UniqueName: \"kubernetes.io/projected/64a4d813-c270-4389-aa46-b69f727a6c7d-kube-api-access-mrff5\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:54:45.000039 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.000032 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/64a4d813-c270-4389-aa46-b69f727a6c7d-config-file\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:54:45.422994 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.422962 2559 generic.go:356] "Generic (PLEG): container finished" podID="64a4d813-c270-4389-aa46-b69f727a6c7d" containerID="8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8" exitCode=0 Jun 12 18:54:45.423435 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.423011 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" Jun 12 18:54:45.423435 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.423045 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" event={"ID":"64a4d813-c270-4389-aa46-b69f727a6c7d","Type":"ContainerDied","Data":"8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8"} Jun 12 18:54:45.423435 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.423102 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5xb9b" event={"ID":"64a4d813-c270-4389-aa46-b69f727a6c7d","Type":"ContainerDied","Data":"675039e16342b7c605ad4ef810bd8bf9b8fee2900d6468fbab6f0e2b962efef7"} Jun 12 18:54:45.423435 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.423133 2559 scope.go:117] "RemoveContainer" containerID="8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8" Jun 12 18:54:45.432055 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.432038 2559 scope.go:117] "RemoveContainer" containerID="8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8" Jun 12 18:54:45.432322 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:54:45.432305 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8\": container with ID starting with 8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8 not found: ID does not exist" containerID="8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8" Jun 12 18:54:45.432378 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.432331 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8"} err="failed to get container status \"8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8\": rpc error: code = NotFound desc = could not find container \"8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8\": container with ID starting with 8d92a4472d6648c0ba6391e0a6e072568be515ab5e3cdf3daf0aedf6a6abe6c8 not found: ID does not exist" Jun 12 18:54:45.449251 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.449211 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5xb9b"] Jun 12 18:54:45.466575 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:45.466547 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5xb9b"] Jun 12 18:54:46.440847 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:46.440814 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a4d813-c270-4389-aa46-b69f727a6c7d" path="/var/lib/kubelet/pods/64a4d813-c270-4389-aa46-b69f727a6c7d/volumes" Jun 12 18:54:48.130222 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.130189 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-s75tx"] Jun 12 18:54:48.130760 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.130743 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a4d813-c270-4389-aa46-b69f727a6c7d" containerName="limitador" Jun 12 18:54:48.130849 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.130764 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a4d813-c270-4389-aa46-b69f727a6c7d" containerName="limitador" Jun 12 18:54:48.130895 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.130856 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a4d813-c270-4389-aa46-b69f727a6c7d" containerName="limitador" Jun 12 18:54:48.135724 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.135705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:48.138668 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.138647 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 12 18:54:48.143090 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.143066 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s75tx"] Jun 12 18:54:48.237119 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.237086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j65v2\" (UniqueName: \"kubernetes.io/projected/4e910ba4-2520-4397-aa48-2d9e9fddeebc-kube-api-access-j65v2\") pod \"postgres-69fb4594cf-s75tx\" (UID: \"4e910ba4-2520-4397-aa48-2d9e9fddeebc\") " pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:48.237320 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.237149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4e910ba4-2520-4397-aa48-2d9e9fddeebc-data\") pod \"postgres-69fb4594cf-s75tx\" (UID: \"4e910ba4-2520-4397-aa48-2d9e9fddeebc\") " pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:48.337752 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.337713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4e910ba4-2520-4397-aa48-2d9e9fddeebc-data\") pod \"postgres-69fb4594cf-s75tx\" (UID: \"4e910ba4-2520-4397-aa48-2d9e9fddeebc\") " pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:48.337898 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.337806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j65v2\" (UniqueName: \"kubernetes.io/projected/4e910ba4-2520-4397-aa48-2d9e9fddeebc-kube-api-access-j65v2\") pod \"postgres-69fb4594cf-s75tx\" (UID: \"4e910ba4-2520-4397-aa48-2d9e9fddeebc\") " pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:48.338128 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.338112 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4e910ba4-2520-4397-aa48-2d9e9fddeebc-data\") pod \"postgres-69fb4594cf-s75tx\" (UID: \"4e910ba4-2520-4397-aa48-2d9e9fddeebc\") " pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:48.347290 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.347259 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j65v2\" (UniqueName: \"kubernetes.io/projected/4e910ba4-2520-4397-aa48-2d9e9fddeebc-kube-api-access-j65v2\") pod \"postgres-69fb4594cf-s75tx\" (UID: \"4e910ba4-2520-4397-aa48-2d9e9fddeebc\") " pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:48.449239 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.449213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:48.577434 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:48.577410 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s75tx"] Jun 12 18:54:48.579186 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:54:48.579157 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e910ba4_2520_4397_aa48_2d9e9fddeebc.slice/crio-518f31ae567fe344344280e803ae0d2baec7d51b86becf69106be6f0165a8aec WatchSource:0}: Error finding container 518f31ae567fe344344280e803ae0d2baec7d51b86becf69106be6f0165a8aec: Status 404 returned error can't find the container with id 518f31ae567fe344344280e803ae0d2baec7d51b86becf69106be6f0165a8aec Jun 12 18:54:49.447734 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:49.447685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s75tx" event={"ID":"4e910ba4-2520-4397-aa48-2d9e9fddeebc","Type":"ContainerStarted","Data":"518f31ae567fe344344280e803ae0d2baec7d51b86becf69106be6f0165a8aec"} Jun 12 18:54:51.459642 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:51.459604 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s75tx" event={"ID":"4e910ba4-2520-4397-aa48-2d9e9fddeebc","Type":"ContainerStarted","Data":"48d3073b1807d21b899b716b8c78ff6c2c10f325c683e0fed39f2f62f819854b"} Jun 12 18:54:51.460074 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:51.459746 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:51.476398 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:51.476348 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-s75tx" podStartSLOduration=1.281336969 podStartE2EDuration="3.47633316s" totalImagesPullingTime="2.194996191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:51.475313014 +0000 UTC m=+743.431397093" watchObservedRunningTime="2026-06-12 18:54:51.47633316 +0000 UTC m=+743.432417249" Jun 12 18:54:57.497401 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:57.497371 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-s75tx" Jun 12 18:54:59.232542 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.232494 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx"] Jun 12 18:54:59.237594 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.237575 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.241114 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.241093 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 18:54:59.241329 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.241316 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 18:54:59.242473 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.242458 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x9fn8\"" Jun 12 18:54:59.248119 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.248098 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx"] Jun 12 18:54:59.336720 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.336685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7r95\" (UniqueName: \"kubernetes.io/projected/7b9d60d2-1a1d-4818-8844-c59cc328ec76-kube-api-access-h7r95\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.336904 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.336741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.336904 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.336806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.437215 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.437177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7r95\" (UniqueName: \"kubernetes.io/projected/7b9d60d2-1a1d-4818-8844-c59cc328ec76-kube-api-access-h7r95\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.437401 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.437233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.437401 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.437268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.437621 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.437599 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.437705 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.437651 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.449589 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.449562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7r95\" (UniqueName: \"kubernetes.io/projected/7b9d60d2-1a1d-4818-8844-c59cc328ec76-kube-api-access-h7r95\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.547128 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.547045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:54:59.691175 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:54:59.691150 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx"] Jun 12 18:54:59.693600 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:54:59.693575 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9d60d2_1a1d_4818_8844_c59cc328ec76.slice/crio-7f9eed039b22782edb45dedce2e554a422004f821743604d65d0171ba13f7331 WatchSource:0}: Error finding container 7f9eed039b22782edb45dedce2e554a422004f821743604d65d0171ba13f7331: Status 404 returned error can't find the container with id 7f9eed039b22782edb45dedce2e554a422004f821743604d65d0171ba13f7331 Jun 12 18:55:00.506851 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:00.506816 2559 generic.go:356] "Generic (PLEG): container finished" podID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerID="e21abea40ac90ec4521cf3449069dd150df757a152f5087cdc3e0943f1154509" exitCode=0 Jun 12 18:55:00.507223 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:00.506908 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" event={"ID":"7b9d60d2-1a1d-4818-8844-c59cc328ec76","Type":"ContainerDied","Data":"e21abea40ac90ec4521cf3449069dd150df757a152f5087cdc3e0943f1154509"} Jun 12 18:55:00.507223 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:00.506942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" event={"ID":"7b9d60d2-1a1d-4818-8844-c59cc328ec76","Type":"ContainerStarted","Data":"7f9eed039b22782edb45dedce2e554a422004f821743604d65d0171ba13f7331"} Jun 12 18:55:01.514221 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:01.514191 2559 generic.go:356] "Generic (PLEG): container finished" podID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerID="549a660d57cdafeac87bf3cc8fb440ec842fb5b03963c647736d657859b0b5e1" exitCode=0 Jun 12 18:55:01.514635 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:01.514254 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" event={"ID":"7b9d60d2-1a1d-4818-8844-c59cc328ec76","Type":"ContainerDied","Data":"549a660d57cdafeac87bf3cc8fb440ec842fb5b03963c647736d657859b0b5e1"} Jun 12 18:55:02.521313 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:02.521275 2559 generic.go:356] "Generic (PLEG): container finished" podID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerID="b1b43d5e87bab6d837e58e1fc33c1e07f6170135385821fc4edf04206b07fb4c" exitCode=0 Jun 12 18:55:02.521697 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:02.521356 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" event={"ID":"7b9d60d2-1a1d-4818-8844-c59cc328ec76","Type":"ContainerDied","Data":"b1b43d5e87bab6d837e58e1fc33c1e07f6170135385821fc4edf04206b07fb4c"} Jun 12 18:55:03.655284 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.655260 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:55:03.780840 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.780749 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-util\") pod \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " Jun 12 18:55:03.780840 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.780834 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7r95\" (UniqueName: \"kubernetes.io/projected/7b9d60d2-1a1d-4818-8844-c59cc328ec76-kube-api-access-h7r95\") pod \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " Jun 12 18:55:03.781060 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.780869 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-bundle\") pod \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\" (UID: \"7b9d60d2-1a1d-4818-8844-c59cc328ec76\") " Jun 12 18:55:03.781413 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.781388 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-bundle" (OuterVolumeSpecName: "bundle") pod "7b9d60d2-1a1d-4818-8844-c59cc328ec76" (UID: "7b9d60d2-1a1d-4818-8844-c59cc328ec76"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:55:03.782947 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.782920 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9d60d2-1a1d-4818-8844-c59cc328ec76-kube-api-access-h7r95" (OuterVolumeSpecName: "kube-api-access-h7r95") pod "7b9d60d2-1a1d-4818-8844-c59cc328ec76" (UID: "7b9d60d2-1a1d-4818-8844-c59cc328ec76"). InnerVolumeSpecName "kube-api-access-h7r95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:55:03.785877 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.785851 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-util" (OuterVolumeSpecName: "util") pod "7b9d60d2-1a1d-4818-8844-c59cc328ec76" (UID: "7b9d60d2-1a1d-4818-8844-c59cc328ec76"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:55:03.881874 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.881841 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:55:03.881874 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.881867 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b9d60d2-1a1d-4818-8844-c59cc328ec76-util\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:55:03.881874 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:03.881879 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7r95\" (UniqueName: \"kubernetes.io/projected/7b9d60d2-1a1d-4818-8844-c59cc328ec76-kube-api-access-h7r95\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:55:04.534283 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:04.534253 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" Jun 12 18:55:04.534453 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:04.534259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74889srx" event={"ID":"7b9d60d2-1a1d-4818-8844-c59cc328ec76","Type":"ContainerDied","Data":"7f9eed039b22782edb45dedce2e554a422004f821743604d65d0171ba13f7331"} Jun 12 18:55:04.534453 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:04.534390 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f9eed039b22782edb45dedce2e554a422004f821743604d65d0171ba13f7331" Jun 12 18:55:59.295050 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.294971 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d69d9d8bd-h99rx"] Jun 12 18:55:59.295505 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.295462 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerName="util" Jun 12 18:55:59.295505 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.295477 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerName="util" Jun 12 18:55:59.295597 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.295529 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerName="pull" Jun 12 18:55:59.295597 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.295538 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerName="pull" Jun 12 18:55:59.295597 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.295547 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerName="extract" Jun 12 18:55:59.295597 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.295556 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerName="extract" Jun 12 18:55:59.295720 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.295654 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b9d60d2-1a1d-4818-8844-c59cc328ec76" containerName="extract" Jun 12 18:55:59.298922 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.298902 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.304070 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.304045 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 18:55:59.304209 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.304082 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 18:55:59.304209 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.304129 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lpw5q\"" Jun 12 18:55:59.310365 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.310346 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Jun 12 18:55:59.315637 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.315615 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d69d9d8bd-h99rx"] Jun 12 18:55:59.468825 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.468791 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24461f8a-40d0-444d-833e-e65f65263d2b-webhook-cert\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.468825 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.468825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqzr6\" (UniqueName: \"kubernetes.io/projected/24461f8a-40d0-444d-833e-e65f65263d2b-kube-api-access-pqzr6\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.469068 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.468854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24461f8a-40d0-444d-833e-e65f65263d2b-odh-trusted-ca-bundle\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.506341 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.506310 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67d6c9848c-knx45"] Jun 12 18:55:59.509645 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.509629 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.520078 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.520057 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67d6c9848c-knx45"] Jun 12 18:55:59.570241 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.570167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24461f8a-40d0-444d-833e-e65f65263d2b-webhook-cert\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.570486 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.570466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqzr6\" (UniqueName: \"kubernetes.io/projected/24461f8a-40d0-444d-833e-e65f65263d2b-kube-api-access-pqzr6\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.570597 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.570578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24461f8a-40d0-444d-833e-e65f65263d2b-odh-trusted-ca-bundle\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.571335 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.571316 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24461f8a-40d0-444d-833e-e65f65263d2b-odh-trusted-ca-bundle\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.572676 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.572659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24461f8a-40d0-444d-833e-e65f65263d2b-webhook-cert\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.578834 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.578808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqzr6\" (UniqueName: \"kubernetes.io/projected/24461f8a-40d0-444d-833e-e65f65263d2b-kube-api-access-pqzr6\") pod \"maas-controller-7d69d9d8bd-h99rx\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.611117 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.611096 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:55:59.671261 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.671230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c4b5\" (UniqueName: \"kubernetes.io/projected/e186218c-30fe-4205-9c40-5997c5211a09-kube-api-access-8c4b5\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.671415 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.671306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e186218c-30fe-4205-9c40-5997c5211a09-odh-trusted-ca-bundle\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.671415 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.671337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e186218c-30fe-4205-9c40-5997c5211a09-webhook-cert\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.741397 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.741373 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d69d9d8bd-h99rx"] Jun 12 18:55:59.743489 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:55:59.743458 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24461f8a_40d0_444d_833e_e65f65263d2b.slice/crio-a542bc8a83fbc4c56a863e8ba3c8e7ee72ab44e61293a9891108db72e73ce3db WatchSource:0}: Error finding container a542bc8a83fbc4c56a863e8ba3c8e7ee72ab44e61293a9891108db72e73ce3db: Status 404 returned error can't find the container with id a542bc8a83fbc4c56a863e8ba3c8e7ee72ab44e61293a9891108db72e73ce3db Jun 12 18:55:59.744888 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.744869 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:55:59.771950 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.771927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c4b5\" (UniqueName: \"kubernetes.io/projected/e186218c-30fe-4205-9c40-5997c5211a09-kube-api-access-8c4b5\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.772061 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.771970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e186218c-30fe-4205-9c40-5997c5211a09-odh-trusted-ca-bundle\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.772061 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.771991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e186218c-30fe-4205-9c40-5997c5211a09-webhook-cert\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.772798 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.772776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e186218c-30fe-4205-9c40-5997c5211a09-odh-trusted-ca-bundle\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.774240 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.774223 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e186218c-30fe-4205-9c40-5997c5211a09-webhook-cert\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.780849 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.780831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c4b5\" (UniqueName: \"kubernetes.io/projected/e186218c-30fe-4205-9c40-5997c5211a09-kube-api-access-8c4b5\") pod \"maas-controller-67d6c9848c-knx45\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.819933 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.819903 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:55:59.835803 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.835768 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" event={"ID":"24461f8a-40d0-444d-833e-e65f65263d2b","Type":"ContainerStarted","Data":"a542bc8a83fbc4c56a863e8ba3c8e7ee72ab44e61293a9891108db72e73ce3db"} Jun 12 18:55:59.957200 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:55:59.957173 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67d6c9848c-knx45"] Jun 12 18:55:59.959000 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:55:59.958975 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode186218c_30fe_4205_9c40_5997c5211a09.slice/crio-0b235614daf4ef7ef1d4cb76fb156343aa7348cac109082b26bccc801e2ecac5 WatchSource:0}: Error finding container 0b235614daf4ef7ef1d4cb76fb156343aa7348cac109082b26bccc801e2ecac5: Status 404 returned error can't find the container with id 0b235614daf4ef7ef1d4cb76fb156343aa7348cac109082b26bccc801e2ecac5 Jun 12 18:56:00.844650 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:00.844610 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d6c9848c-knx45" event={"ID":"e186218c-30fe-4205-9c40-5997c5211a09","Type":"ContainerStarted","Data":"0b235614daf4ef7ef1d4cb76fb156343aa7348cac109082b26bccc801e2ecac5"} Jun 12 18:56:02.856201 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:02.856162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" event={"ID":"24461f8a-40d0-444d-833e-e65f65263d2b","Type":"ContainerStarted","Data":"6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1"} Jun 12 18:56:02.856703 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:02.856228 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:56:02.857671 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:02.857647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d6c9848c-knx45" event={"ID":"e186218c-30fe-4205-9c40-5997c5211a09","Type":"ContainerStarted","Data":"6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e"} Jun 12 18:56:02.857788 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:02.857774 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:56:02.873610 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:02.873556 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" podStartSLOduration=1.805266007 podStartE2EDuration="3.873542855s" totalImagesPullingTime="2.068276848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:56:02.872900502 +0000 UTC m=+814.828984632" watchObservedRunningTime="2026-06-12 18:56:02.873542855 +0000 UTC m=+814.829626925" Jun 12 18:56:02.891885 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:02.891839 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67d6c9848c-knx45" podStartSLOduration=2.042236201 podStartE2EDuration="3.891825474s" totalImagesPullingTime="1.849589273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:56:02.890371072 +0000 UTC m=+814.846455155" watchObservedRunningTime="2026-06-12 18:56:02.891825474 +0000 UTC m=+814.847909556" Jun 12 18:56:13.869214 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:13.869176 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 18:56:13.869685 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:13.869341 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:56:13.934603 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:13.934566 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d69d9d8bd-h99rx"] Jun 12 18:56:13.934816 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:13.934790 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" podUID="24461f8a-40d0-444d-833e-e65f65263d2b" containerName="manager" containerID="cri-o://6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1" gracePeriod=30 Jun 12 18:56:14.178104 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.178081 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:56:14.192422 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.192396 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqzr6\" (UniqueName: \"kubernetes.io/projected/24461f8a-40d0-444d-833e-e65f65263d2b-kube-api-access-pqzr6\") pod \"24461f8a-40d0-444d-833e-e65f65263d2b\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " Jun 12 18:56:14.192565 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.192434 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24461f8a-40d0-444d-833e-e65f65263d2b-webhook-cert\") pod \"24461f8a-40d0-444d-833e-e65f65263d2b\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " Jun 12 18:56:14.192565 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.192471 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24461f8a-40d0-444d-833e-e65f65263d2b-odh-trusted-ca-bundle\") pod \"24461f8a-40d0-444d-833e-e65f65263d2b\" (UID: \"24461f8a-40d0-444d-833e-e65f65263d2b\") " Jun 12 18:56:14.192866 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.192841 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24461f8a-40d0-444d-833e-e65f65263d2b-odh-trusted-ca-bundle" (OuterVolumeSpecName: "odh-trusted-ca-bundle") pod "24461f8a-40d0-444d-833e-e65f65263d2b" (UID: "24461f8a-40d0-444d-833e-e65f65263d2b"). InnerVolumeSpecName "odh-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:56:14.194652 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.194630 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24461f8a-40d0-444d-833e-e65f65263d2b-kube-api-access-pqzr6" (OuterVolumeSpecName: "kube-api-access-pqzr6") pod "24461f8a-40d0-444d-833e-e65f65263d2b" (UID: "24461f8a-40d0-444d-833e-e65f65263d2b"). InnerVolumeSpecName "kube-api-access-pqzr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:56:14.194743 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.194651 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24461f8a-40d0-444d-833e-e65f65263d2b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "24461f8a-40d0-444d-833e-e65f65263d2b" (UID: "24461f8a-40d0-444d-833e-e65f65263d2b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:56:14.293553 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.293502 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqzr6\" (UniqueName: \"kubernetes.io/projected/24461f8a-40d0-444d-833e-e65f65263d2b-kube-api-access-pqzr6\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:56:14.293553 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.293547 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24461f8a-40d0-444d-833e-e65f65263d2b-webhook-cert\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:56:14.293553 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.293557 2559 reconciler_common.go:299] "Volume detached for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24461f8a-40d0-444d-833e-e65f65263d2b-odh-trusted-ca-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 18:56:14.922959 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.922928 2559 generic.go:356] "Generic (PLEG): container finished" podID="24461f8a-40d0-444d-833e-e65f65263d2b" containerID="6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1" exitCode=0 Jun 12 18:56:14.923363 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.922972 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" Jun 12 18:56:14.923363 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.923009 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" event={"ID":"24461f8a-40d0-444d-833e-e65f65263d2b","Type":"ContainerDied","Data":"6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1"} Jun 12 18:56:14.923363 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.923056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d69d9d8bd-h99rx" event={"ID":"24461f8a-40d0-444d-833e-e65f65263d2b","Type":"ContainerDied","Data":"a542bc8a83fbc4c56a863e8ba3c8e7ee72ab44e61293a9891108db72e73ce3db"} Jun 12 18:56:14.923363 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.923078 2559 scope.go:117] "RemoveContainer" containerID="6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1" Jun 12 18:56:14.932839 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.932817 2559 scope.go:117] "RemoveContainer" containerID="6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1" Jun 12 18:56:14.933859 ip-10-0-132-81 kubenswrapper[2559]: E0612 18:56:14.933825 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1\": container with ID starting with 6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1 not found: ID does not exist" containerID="6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1" Jun 12 18:56:14.933968 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.933869 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1"} err="failed to get container status \"6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1\": rpc error: code = NotFound desc = could not find container \"6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1\": container with ID starting with 6e0b2298c4baa2fbcfec7c8036f474d5fe2c42c3e43139ab5543b4148f0abfa1 not found: ID does not exist" Jun 12 18:56:14.942692 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.942670 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d69d9d8bd-h99rx"] Jun 12 18:56:14.948669 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:14.948645 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d69d9d8bd-h99rx"] Jun 12 18:56:16.440806 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:16.440774 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24461f8a-40d0-444d-833e-e65f65263d2b" path="/var/lib/kubelet/pods/24461f8a-40d0-444d-833e-e65f65263d2b/volumes" Jun 12 18:56:32.143903 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.143863 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6c6d95c874-wtczf"] Jun 12 18:56:32.144472 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.144450 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24461f8a-40d0-444d-833e-e65f65263d2b" containerName="manager" Jun 12 18:56:32.144472 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.144470 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24461f8a-40d0-444d-833e-e65f65263d2b" containerName="manager" Jun 12 18:56:32.144667 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.144570 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24461f8a-40d0-444d-833e-e65f65263d2b" containerName="manager" Jun 12 18:56:32.149203 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.149185 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.152299 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.152284 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rf6th\"" Jun 12 18:56:32.152407 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.152319 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 12 18:56:32.161177 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.161152 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6c6d95c874-wtczf"] Jun 12 18:56:32.253008 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.252977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65ffe343-3117-4636-84e4-94740257997f-maas-api-tls\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.253180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.253026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9tt9\" (UniqueName: \"kubernetes.io/projected/65ffe343-3117-4636-84e4-94740257997f-kube-api-access-l9tt9\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.253180 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.253160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65ffe343-3117-4636-84e4-94740257997f-openshift-service-ca\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.354579 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.354550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65ffe343-3117-4636-84e4-94740257997f-openshift-service-ca\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.354747 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.354593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65ffe343-3117-4636-84e4-94740257997f-maas-api-tls\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.354747 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.354640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9tt9\" (UniqueName: \"kubernetes.io/projected/65ffe343-3117-4636-84e4-94740257997f-kube-api-access-l9tt9\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.355279 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.355259 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65ffe343-3117-4636-84e4-94740257997f-openshift-service-ca\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.357020 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.356999 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65ffe343-3117-4636-84e4-94740257997f-maas-api-tls\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.364117 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.364089 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9tt9\" (UniqueName: \"kubernetes.io/projected/65ffe343-3117-4636-84e4-94740257997f-kube-api-access-l9tt9\") pod \"maas-api-6c6d95c874-wtczf\" (UID: \"65ffe343-3117-4636-84e4-94740257997f\") " pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.458915 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.458887 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:32.575648 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.575620 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8ssmw"] Jun 12 18:56:32.580463 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.580440 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" Jun 12 18:56:32.583300 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.583279 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 18:56:32.593479 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.593287 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8ssmw"] Jun 12 18:56:32.607705 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.607684 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-vvfrc"] Jun 12 18:56:32.609771 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:56:32.609740 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ffe343_3117_4636_84e4_94740257997f.slice/crio-a7f34e3ceac2818ffb09daa28cf7e92dace515c144276337fd0ece5b429e54f7 WatchSource:0}: Error finding container a7f34e3ceac2818ffb09daa28cf7e92dace515c144276337fd0ece5b429e54f7: Status 404 returned error can't find the container with id a7f34e3ceac2818ffb09daa28cf7e92dace515c144276337fd0ece5b429e54f7 Jun 12 18:56:32.617902 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.617881 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6c6d95c874-wtczf"] Jun 12 18:56:32.618022 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.617969 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" Jun 12 18:56:32.620731 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.620708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-vvfrc"] Jun 12 18:56:32.620832 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.620716 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dhzpm\"" Jun 12 18:56:32.657648 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.657617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts88d\" (UniqueName: \"kubernetes.io/projected/2b18fa25-d6b0-42d6-b296-98473aa6200e-kube-api-access-ts88d\") pod \"payload-pre-processing-579785bc64-8ssmw\" (UID: \"2b18fa25-d6b0-42d6-b296-98473aa6200e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" Jun 12 18:56:32.758856 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.758750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts88d\" (UniqueName: \"kubernetes.io/projected/2b18fa25-d6b0-42d6-b296-98473aa6200e-kube-api-access-ts88d\") pod \"payload-pre-processing-579785bc64-8ssmw\" (UID: \"2b18fa25-d6b0-42d6-b296-98473aa6200e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" Jun 12 18:56:32.758856 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.758814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5lr4\" (UniqueName: \"kubernetes.io/projected/87046e7b-c44d-4cef-9222-aba1713a497c-kube-api-access-c5lr4\") pod \"payload-processing-699b6cd6c-vvfrc\" (UID: \"87046e7b-c44d-4cef-9222-aba1713a497c\") " pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" Jun 12 18:56:32.768055 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.768029 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts88d\" (UniqueName: \"kubernetes.io/projected/2b18fa25-d6b0-42d6-b296-98473aa6200e-kube-api-access-ts88d\") pod \"payload-pre-processing-579785bc64-8ssmw\" (UID: \"2b18fa25-d6b0-42d6-b296-98473aa6200e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" Jun 12 18:56:32.860053 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.860002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5lr4\" (UniqueName: \"kubernetes.io/projected/87046e7b-c44d-4cef-9222-aba1713a497c-kube-api-access-c5lr4\") pod \"payload-processing-699b6cd6c-vvfrc\" (UID: \"87046e7b-c44d-4cef-9222-aba1713a497c\") " pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" Jun 12 18:56:32.868150 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.868118 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5lr4\" (UniqueName: \"kubernetes.io/projected/87046e7b-c44d-4cef-9222-aba1713a497c-kube-api-access-c5lr4\") pod \"payload-processing-699b6cd6c-vvfrc\" (UID: \"87046e7b-c44d-4cef-9222-aba1713a497c\") " pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" Jun 12 18:56:32.903147 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.903115 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" Jun 12 18:56:32.930726 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:32.930702 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" Jun 12 18:56:33.024976 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:33.024834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6c6d95c874-wtczf" event={"ID":"65ffe343-3117-4636-84e4-94740257997f","Type":"ContainerStarted","Data":"a7f34e3ceac2818ffb09daa28cf7e92dace515c144276337fd0ece5b429e54f7"} Jun 12 18:56:33.055811 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:33.055789 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8ssmw"] Jun 12 18:56:33.058479 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:56:33.058451 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b18fa25_d6b0_42d6_b296_98473aa6200e.slice/crio-2497ed86b335c0448201a1cca3a334638fa374b761efdfb9f98c941e1a5d5048 WatchSource:0}: Error finding container 2497ed86b335c0448201a1cca3a334638fa374b761efdfb9f98c941e1a5d5048: Status 404 returned error can't find the container with id 2497ed86b335c0448201a1cca3a334638fa374b761efdfb9f98c941e1a5d5048 Jun 12 18:56:33.080455 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:33.080430 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-vvfrc"] Jun 12 18:56:33.082182 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:56:33.082160 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87046e7b_c44d_4cef_9222_aba1713a497c.slice/crio-7d9f8ee977dc75a7513212a9099cc1effbd1f9c3a2410ae308d1b9923c34b351 WatchSource:0}: Error finding container 7d9f8ee977dc75a7513212a9099cc1effbd1f9c3a2410ae308d1b9923c34b351: Status 404 returned error can't find the container with id 7d9f8ee977dc75a7513212a9099cc1effbd1f9c3a2410ae308d1b9923c34b351 Jun 12 18:56:34.035092 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:34.035036 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" event={"ID":"87046e7b-c44d-4cef-9222-aba1713a497c","Type":"ContainerStarted","Data":"7d9f8ee977dc75a7513212a9099cc1effbd1f9c3a2410ae308d1b9923c34b351"} Jun 12 18:56:34.037672 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:34.037603 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" event={"ID":"2b18fa25-d6b0-42d6-b296-98473aa6200e","Type":"ContainerStarted","Data":"2497ed86b335c0448201a1cca3a334638fa374b761efdfb9f98c941e1a5d5048"} Jun 12 18:56:36.051126 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.051087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" event={"ID":"87046e7b-c44d-4cef-9222-aba1713a497c","Type":"ContainerStarted","Data":"f304c5e348da0ea011f910462d3ad41a73839c4cbc1cec6c7d5d3c2671a2cc37"} Jun 12 18:56:36.051648 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.051282 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" Jun 12 18:56:36.052789 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.052762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" event={"ID":"2b18fa25-d6b0-42d6-b296-98473aa6200e","Type":"ContainerStarted","Data":"39b0ba145800c4e139aa7ecbd56bc6bc8d1a95f29a4167414fdb9d6d0b166837"} Jun 12 18:56:36.052902 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.052849 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" Jun 12 18:56:36.054336 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.054316 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6c6d95c874-wtczf" event={"ID":"65ffe343-3117-4636-84e4-94740257997f","Type":"ContainerStarted","Data":"35a6f54aff5ba833d9682ea5d73140ef3fc5401faf475182267babd668d46876"} Jun 12 18:56:36.054463 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.054450 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:36.069205 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.069165 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" podStartSLOduration=1.565208532 podStartE2EDuration="4.069152086s" totalImagesPullingTime="2.503943554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:56:36.067816741 +0000 UTC m=+848.023900822" watchObservedRunningTime="2026-06-12 18:56:36.069152086 +0000 UTC m=+848.025236162" Jun 12 18:56:36.085576 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.085538 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6c6d95c874-wtczf" podStartSLOduration=1.177694255 podStartE2EDuration="4.085525988s" totalImagesPullingTime="2.907831733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:56:36.083982489 +0000 UTC m=+848.040066568" watchObservedRunningTime="2026-06-12 18:56:36.085525988 +0000 UTC m=+848.041610057" Jun 12 18:56:36.101254 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:36.101210 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" podStartSLOduration=1.5800535 podStartE2EDuration="4.101194773s" totalImagesPullingTime="2.521141273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:56:36.099250692 +0000 UTC m=+848.055334773" watchObservedRunningTime="2026-06-12 18:56:36.101194773 +0000 UTC m=+848.057278853" Jun 12 18:56:42.064368 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:42.064340 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6c6d95c874-wtczf" Jun 12 18:56:47.061440 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:47.061407 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-8ssmw" Jun 12 18:56:47.062179 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:56:47.061479 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-vvfrc" Jun 12 18:57:28.459045 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:57:28.458970 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:57:28.466746 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:57:28.466727 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 18:59:41.645609 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.645573 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx"] Jun 12 18:59:41.650036 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.650017 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.652961 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.652935 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 18:59:41.654125 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.654109 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 18:59:41.654220 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.654128 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9q6dj\"" Jun 12 18:59:41.654220 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.654128 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 12 18:59:41.659791 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.659297 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx"] Jun 12 18:59:41.781727 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.781686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p82t\" (UniqueName: \"kubernetes.io/projected/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-kube-api-access-9p82t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.781897 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.781737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.781897 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.781765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.781897 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.781804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.781897 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.781820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.781897 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.781872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.882625 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.882595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p82t\" (UniqueName: \"kubernetes.io/projected/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-kube-api-access-9p82t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.882625 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.882635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.882881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.882671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.882881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.882704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.882881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.882727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.882881 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.882851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.883149 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.883071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.883149 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.883135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.883232 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.883150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.885130 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.885111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.885245 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.885230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.890724 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.890702 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p82t\" (UniqueName: \"kubernetes.io/projected/f47ab23f-799e-477e-8f0c-d1fa84ff6d4b-kube-api-access-9p82t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx\" (UID: \"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:41.963681 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:41.963650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:42.102833 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:42.102805 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx"] Jun 12 18:59:42.104602 ip-10-0-132-81 kubenswrapper[2559]: W0612 18:59:42.104576 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47ab23f_799e_477e_8f0c_d1fa84ff6d4b.slice/crio-e8ebe6b0e5d4acb1e22621750ccfcce7f5d8298b9cdd1f2a583c6544cd112f0d WatchSource:0}: Error finding container e8ebe6b0e5d4acb1e22621750ccfcce7f5d8298b9cdd1f2a583c6544cd112f0d: Status 404 returned error can't find the container with id e8ebe6b0e5d4acb1e22621750ccfcce7f5d8298b9cdd1f2a583c6544cd112f0d Jun 12 18:59:43.056718 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:43.056677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" event={"ID":"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b","Type":"ContainerStarted","Data":"e8ebe6b0e5d4acb1e22621750ccfcce7f5d8298b9cdd1f2a583c6544cd112f0d"} Jun 12 18:59:46.080351 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:46.080313 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" event={"ID":"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b","Type":"ContainerStarted","Data":"81384ee98297ecbd33b1aa484b3b474d904d93d24dbeef9cb9771d8f9794e7c7"} Jun 12 18:59:47.088199 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:47.088115 2559 generic.go:356] "Generic (PLEG): container finished" podID="f47ab23f-799e-477e-8f0c-d1fa84ff6d4b" containerID="81384ee98297ecbd33b1aa484b3b474d904d93d24dbeef9cb9771d8f9794e7c7" exitCode=0 Jun 12 18:59:47.088199 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:47.088156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" event={"ID":"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b","Type":"ContainerDied","Data":"81384ee98297ecbd33b1aa484b3b474d904d93d24dbeef9cb9771d8f9794e7c7"} Jun 12 18:59:49.101338 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:49.101306 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" event={"ID":"f47ab23f-799e-477e-8f0c-d1fa84ff6d4b","Type":"ContainerStarted","Data":"650240dd9d82425359677c79960530c8120ed196e3ba3bc2d7f022a94e004acf"} Jun 12 18:59:49.119947 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:49.119900 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" podStartSLOduration=2.404424607 podStartE2EDuration="8.119884353s" totalImagesPullingTime="4.410491264s" totalInitContainerRuntime="1.304968482s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:59:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:59:49.118196122 +0000 UTC m=+1041.074280203" watchObservedRunningTime="2026-06-12 18:59:49.119884353 +0000 UTC m=+1041.075968433" Jun 12 18:59:51.964279 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:51.964241 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:51.964691 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:51.964538 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:51.976712 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:51.976685 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 18:59:52.128950 ip-10-0-132-81 kubenswrapper[2559]: I0612 18:59:52.128921 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx" Jun 12 19:00:03.960874 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:03.960834 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97"] Jun 12 19:00:03.973056 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:03.973029 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:03.975339 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:03.975300 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97"] Jun 12 19:00:03.975843 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:03.975824 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 12 19:00:04.083110 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.083074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.083298 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.083119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.083298 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.083228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.083298 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.083265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82ttk\" (UniqueName: \"kubernetes.io/projected/a0a9a648-a7b9-4923-bb65-66175f910c5a-kube-api-access-82ttk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.083480 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.083335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.083480 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.083385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0a9a648-a7b9-4923-bb65-66175f910c5a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184052 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184052 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82ttk\" (UniqueName: \"kubernetes.io/projected/a0a9a648-a7b9-4923-bb65-66175f910c5a-kube-api-access-82ttk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184305 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184305 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0a9a648-a7b9-4923-bb65-66175f910c5a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184305 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184305 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184536 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184536 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184506 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.184619 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.184602 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.186335 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.186310 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0a9a648-a7b9-4923-bb65-66175f910c5a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.186795 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.186776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0a9a648-a7b9-4923-bb65-66175f910c5a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.192408 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.192383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82ttk\" (UniqueName: \"kubernetes.io/projected/a0a9a648-a7b9-4923-bb65-66175f910c5a-kube-api-access-82ttk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97\" (UID: \"a0a9a648-a7b9-4923-bb65-66175f910c5a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.284714 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.284632 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:00:04.422750 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:04.422723 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97"] Jun 12 19:00:04.425313 ip-10-0-132-81 kubenswrapper[2559]: W0612 19:00:04.425287 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a9a648_a7b9_4923_bb65_66175f910c5a.slice/crio-ce16ce37d3edf2666b4be384782d138a6261214fbf52725a7700baf320a4aa08 WatchSource:0}: Error finding container ce16ce37d3edf2666b4be384782d138a6261214fbf52725a7700baf320a4aa08: Status 404 returned error can't find the container with id ce16ce37d3edf2666b4be384782d138a6261214fbf52725a7700baf320a4aa08 Jun 12 19:00:05.193162 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:05.193124 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" event={"ID":"a0a9a648-a7b9-4923-bb65-66175f910c5a","Type":"ContainerStarted","Data":"46f2492ac7976e45118338a2a016473900d14137a78bb266c4591346f24f7911"} Jun 12 19:00:05.193641 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:05.193181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" event={"ID":"a0a9a648-a7b9-4923-bb65-66175f910c5a","Type":"ContainerStarted","Data":"ce16ce37d3edf2666b4be384782d138a6261214fbf52725a7700baf320a4aa08"} Jun 12 19:00:16.454242 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.454203 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf"] Jun 12 19:00:16.457745 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.457722 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.460405 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.460387 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 19:00:16.469422 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.469400 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf"] Jun 12 19:00:16.594216 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.594189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.594216 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.594219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.594464 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.594244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.594464 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.594393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca30a21-6819-496d-8b13-6b2f727d8852-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.594600 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.594461 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.594600 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.594489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx845\" (UniqueName: \"kubernetes.io/projected/1ca30a21-6819-496d-8b13-6b2f727d8852-kube-api-access-dx845\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.695416 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.695376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.695416 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.695413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx845\" (UniqueName: \"kubernetes.io/projected/1ca30a21-6819-496d-8b13-6b2f727d8852-kube-api-access-dx845\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.695677 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.695463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.695677 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.695489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.695677 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.695537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.695677 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.695617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca30a21-6819-496d-8b13-6b2f727d8852-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.695874 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.695851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.695956 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.695932 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.696050 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.696018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.697961 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.697936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca30a21-6819-496d-8b13-6b2f727d8852-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.698135 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.698118 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca30a21-6819-496d-8b13-6b2f727d8852-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.703045 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.703027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx845\" (UniqueName: \"kubernetes.io/projected/1ca30a21-6819-496d-8b13-6b2f727d8852-kube-api-access-dx845\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf\" (UID: \"1ca30a21-6819-496d-8b13-6b2f727d8852\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.769294 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.769205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:16.901846 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:16.901820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf"] Jun 12 19:00:16.903670 ip-10-0-132-81 kubenswrapper[2559]: W0612 19:00:16.903642 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca30a21_6819_496d_8b13_6b2f727d8852.slice/crio-0e32989d6d1477303bb80599fce07f849cea5a3ac6bdc409ea8e2e91079d27c2 WatchSource:0}: Error finding container 0e32989d6d1477303bb80599fce07f849cea5a3ac6bdc409ea8e2e91079d27c2: Status 404 returned error can't find the container with id 0e32989d6d1477303bb80599fce07f849cea5a3ac6bdc409ea8e2e91079d27c2 Jun 12 19:00:17.270277 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:17.270199 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" event={"ID":"1ca30a21-6819-496d-8b13-6b2f727d8852","Type":"ContainerStarted","Data":"28785c11c0bd8e9cd7bbb88c4ca082c9738029cdf8c2288d3d527649b4e51642"} Jun 12 19:00:17.270277 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:17.270252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" event={"ID":"1ca30a21-6819-496d-8b13-6b2f727d8852","Type":"ContainerStarted","Data":"0e32989d6d1477303bb80599fce07f849cea5a3ac6bdc409ea8e2e91079d27c2"} Jun 12 19:00:18.282605 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:18.282573 2559 generic.go:356] "Generic (PLEG): container finished" podID="1ca30a21-6819-496d-8b13-6b2f727d8852" containerID="28785c11c0bd8e9cd7bbb88c4ca082c9738029cdf8c2288d3d527649b4e51642" exitCode=0 Jun 12 19:00:18.283036 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:18.282656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" event={"ID":"1ca30a21-6819-496d-8b13-6b2f727d8852","Type":"ContainerDied","Data":"28785c11c0bd8e9cd7bbb88c4ca082c9738029cdf8c2288d3d527649b4e51642"} Jun 12 19:00:26.337000 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:26.336965 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" event={"ID":"1ca30a21-6819-496d-8b13-6b2f727d8852","Type":"ContainerStarted","Data":"53fec7357c104b8eaafe9c8306977f7bc959e1f25c4e4f14914494008e9d04ca"} Jun 12 19:00:26.358198 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:26.358148 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" podStartSLOduration=1.693357304 podStartE2EDuration="10.358133039s" totalImagesPullingTime="7.396933902s" totalInitContainerRuntime="1.267841833s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:00:26.356574414 +0000 UTC m=+1078.312658520" watchObservedRunningTime="2026-06-12 19:00:26.358133039 +0000 UTC m=+1078.314217127" Jun 12 19:00:26.769950 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:26.769918 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:26.770124 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:26.769982 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:26.782285 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:26.782259 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:00:27.353154 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:00:27.353123 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf" Jun 12 19:01:56.827087 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:01:56.827047 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0a9a648-a7b9-4923-bb65-66175f910c5a" containerID="46f2492ac7976e45118338a2a016473900d14137a78bb266c4591346f24f7911" exitCode=0 Jun 12 19:01:56.827543 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:01:56.827118 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" event={"ID":"a0a9a648-a7b9-4923-bb65-66175f910c5a","Type":"ContainerDied","Data":"46f2492ac7976e45118338a2a016473900d14137a78bb266c4591346f24f7911"} Jun 12 19:01:56.827774 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:01:56.827758 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:01:57.834574 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:01:57.834534 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" event={"ID":"a0a9a648-a7b9-4923-bb65-66175f910c5a","Type":"ContainerStarted","Data":"ec9e093b6d56771d5e50890481ae1fb57888577396d5cbe60fa276808d63d4c4"} Jun 12 19:01:57.854988 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:01:57.854935 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" podStartSLOduration=3.267545918 podStartE2EDuration="1m54.854919826s" totalImagesPullingTime="212.709675ms" totalInitContainerRuntime="1m51.374664233s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:01:57.852414208 +0000 UTC m=+1169.808498313" watchObservedRunningTime="2026-06-12 19:01:57.854919826 +0000 UTC m=+1169.811003905" Jun 12 19:02:04.285236 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:02:04.285202 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:02:04.285648 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:02:04.285271 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:02:04.297977 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:02:04.297954 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:02:04.887344 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:02:04.887311 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97" Jun 12 19:02:28.500140 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:02:28.500111 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:02:28.508158 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:02:28.508135 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:03:34.720462 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:34.720374 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67d6c9848c-knx45"] Jun 12 19:03:34.721023 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:34.720687 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-67d6c9848c-knx45" podUID="e186218c-30fe-4205-9c40-5997c5211a09" containerName="manager" containerID="cri-o://6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e" gracePeriod=30 Jun 12 19:03:34.977386 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:34.977324 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 19:03:35.054398 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.054366 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e186218c-30fe-4205-9c40-5997c5211a09-odh-trusted-ca-bundle\") pod \"e186218c-30fe-4205-9c40-5997c5211a09\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " Jun 12 19:03:35.054586 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.054407 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e186218c-30fe-4205-9c40-5997c5211a09-webhook-cert\") pod \"e186218c-30fe-4205-9c40-5997c5211a09\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " Jun 12 19:03:35.054586 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.054444 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c4b5\" (UniqueName: \"kubernetes.io/projected/e186218c-30fe-4205-9c40-5997c5211a09-kube-api-access-8c4b5\") pod \"e186218c-30fe-4205-9c40-5997c5211a09\" (UID: \"e186218c-30fe-4205-9c40-5997c5211a09\") " Jun 12 19:03:35.054767 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.054741 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e186218c-30fe-4205-9c40-5997c5211a09-odh-trusted-ca-bundle" (OuterVolumeSpecName: "odh-trusted-ca-bundle") pod "e186218c-30fe-4205-9c40-5997c5211a09" (UID: "e186218c-30fe-4205-9c40-5997c5211a09"). InnerVolumeSpecName "odh-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:03:35.056387 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.056356 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e186218c-30fe-4205-9c40-5997c5211a09-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e186218c-30fe-4205-9c40-5997c5211a09" (UID: "e186218c-30fe-4205-9c40-5997c5211a09"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:03:35.056489 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.056442 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e186218c-30fe-4205-9c40-5997c5211a09-kube-api-access-8c4b5" (OuterVolumeSpecName: "kube-api-access-8c4b5") pod "e186218c-30fe-4205-9c40-5997c5211a09" (UID: "e186218c-30fe-4205-9c40-5997c5211a09"). InnerVolumeSpecName "kube-api-access-8c4b5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:03:35.155820 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.155783 2559 reconciler_common.go:299] "Volume detached for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e186218c-30fe-4205-9c40-5997c5211a09-odh-trusted-ca-bundle\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 19:03:35.155820 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.155812 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e186218c-30fe-4205-9c40-5997c5211a09-webhook-cert\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 19:03:35.155820 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.155824 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c4b5\" (UniqueName: \"kubernetes.io/projected/e186218c-30fe-4205-9c40-5997c5211a09-kube-api-access-8c4b5\") on node \"ip-10-0-132-81.ec2.internal\" DevicePath \"\"" Jun 12 19:03:35.382890 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.382800 2559 generic.go:356] "Generic (PLEG): container finished" podID="e186218c-30fe-4205-9c40-5997c5211a09" containerID="6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e" exitCode=0 Jun 12 19:03:35.382890 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.382840 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d6c9848c-knx45" Jun 12 19:03:35.383082 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.382895 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d6c9848c-knx45" event={"ID":"e186218c-30fe-4205-9c40-5997c5211a09","Type":"ContainerDied","Data":"6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e"} Jun 12 19:03:35.383082 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.382949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d6c9848c-knx45" event={"ID":"e186218c-30fe-4205-9c40-5997c5211a09","Type":"ContainerDied","Data":"0b235614daf4ef7ef1d4cb76fb156343aa7348cac109082b26bccc801e2ecac5"} Jun 12 19:03:35.383082 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.382971 2559 scope.go:117] "RemoveContainer" containerID="6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e" Jun 12 19:03:35.392397 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.392378 2559 scope.go:117] "RemoveContainer" containerID="6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e" Jun 12 19:03:35.392662 ip-10-0-132-81 kubenswrapper[2559]: E0612 19:03:35.392644 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e\": container with ID starting with 6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e not found: ID does not exist" containerID="6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e" Jun 12 19:03:35.392727 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.392670 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e"} err="failed to get container status \"6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e\": rpc error: code = NotFound desc = could not find container \"6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e\": container with ID starting with 6fa8b5a7a199db245b9b90a1958e16839aed3612630e0d1f46ab36670746ca1e not found: ID does not exist" Jun 12 19:03:35.407344 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.407317 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67d6c9848c-knx45"] Jun 12 19:03:35.409551 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:35.409495 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67d6c9848c-knx45"] Jun 12 19:03:36.193642 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.193609 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67d6c9848c-879z2"] Jun 12 19:03:36.194021 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.194006 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e186218c-30fe-4205-9c40-5997c5211a09" containerName="manager" Jun 12 19:03:36.194021 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.194017 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e186218c-30fe-4205-9c40-5997c5211a09" containerName="manager" Jun 12 19:03:36.194096 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.194089 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e186218c-30fe-4205-9c40-5997c5211a09" containerName="manager" Jun 12 19:03:36.198403 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.198385 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.201564 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.201535 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 19:03:36.202967 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.202945 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 19:03:36.203073 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.202950 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lpw5q\"" Jun 12 19:03:36.208569 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.208544 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Jun 12 19:03:36.210279 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.210258 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67d6c9848c-879z2"] Jun 12 19:03:36.265461 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.265425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-odh-trusted-ca-bundle\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.265461 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.265460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-769r5\" (UniqueName: \"kubernetes.io/projected/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-kube-api-access-769r5\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.265708 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.265576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-webhook-cert\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.366930 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.366895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-webhook-cert\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.367117 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.367009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-odh-trusted-ca-bundle\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.367117 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.367033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769r5\" (UniqueName: \"kubernetes.io/projected/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-kube-api-access-769r5\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.367892 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.367871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"odh-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-odh-trusted-ca-bundle\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.369153 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.369136 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-webhook-cert\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.375914 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.375890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-769r5\" (UniqueName: \"kubernetes.io/projected/5943b75f-4b7c-4d71-be7d-f85b02bfc3c7-kube-api-access-769r5\") pod \"maas-controller-67d6c9848c-879z2\" (UID: \"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7\") " pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.441496 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.441465 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e186218c-30fe-4205-9c40-5997c5211a09" path="/var/lib/kubelet/pods/e186218c-30fe-4205-9c40-5997c5211a09/volumes" Jun 12 19:03:36.509916 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.509831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:36.644213 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:36.644186 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67d6c9848c-879z2"] Jun 12 19:03:36.646322 ip-10-0-132-81 kubenswrapper[2559]: W0612 19:03:36.646292 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5943b75f_4b7c_4d71_be7d_f85b02bfc3c7.slice/crio-4bbd0e057a7b8dfce3b53c642f892c899a919a4bb943148e54a879e6642fc777 WatchSource:0}: Error finding container 4bbd0e057a7b8dfce3b53c642f892c899a919a4bb943148e54a879e6642fc777: Status 404 returned error can't find the container with id 4bbd0e057a7b8dfce3b53c642f892c899a919a4bb943148e54a879e6642fc777 Jun 12 19:03:37.397070 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:37.396977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d6c9848c-879z2" event={"ID":"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7","Type":"ContainerStarted","Data":"768694b60b131eb12b08c7fccbd344abe777ee86f57f8571d8f00d7cfe5f4c50"} Jun 12 19:03:37.397070 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:37.397035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d6c9848c-879z2" event={"ID":"5943b75f-4b7c-4d71-be7d-f85b02bfc3c7","Type":"ContainerStarted","Data":"4bbd0e057a7b8dfce3b53c642f892c899a919a4bb943148e54a879e6642fc777"} Jun 12 19:03:37.397448 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:37.397152 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:03:37.419740 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:37.419691 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67d6c9848c-879z2" podStartSLOduration=1.036534246 podStartE2EDuration="1.419677078s" totalImagesPullingTime="383.142832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:03:37.417101435 +0000 UTC m=+1269.373185515" watchObservedRunningTime="2026-06-12 19:03:37.419677078 +0000 UTC m=+1269.375761156" Jun 12 19:03:48.408127 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:03:48.408097 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67d6c9848c-879z2" Jun 12 19:07:28.536804 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:07:28.536775 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:07:28.545945 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:07:28.545920 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:12:28.574579 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:12:28.574555 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:12:28.585635 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:12:28.585613 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:17:28.611194 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:17:28.611152 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:17:28.622633 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:17:28.622612 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:22:28.657285 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:22:28.657256 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:22:28.671047 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:22:28.671024 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8rzwn_d3134413-987f-49fb-990f-68dce93609ac/ovn-acl-logging/0.log" Jun 12 19:24:49.918954 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:49.918925 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84cbf9-jwm2g_ea8f3694-c8fe-4afa-87a5-5573b109e84c/nginx/0.log" Jun 12 19:24:50.038915 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:50.038887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-299s9_c94a910d-35d8-41e5-8ca7-235b5f09fb55/manager/0.log" Jun 12 19:24:50.164573 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:50.164527 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-n9jh8_169d6904-ce01-402a-aa12-805f6fd8f925/manager/0.log" Jun 12 19:24:50.286354 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:50.286270 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6c6d95c874-wtczf_65ffe343-3117-4636-84e4-94740257997f/maas-api/0.log" Jun 12 19:24:50.636961 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:50.636873 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67d6c9848c-879z2_5943b75f-4b7c-4d71-be7d-f85b02bfc3c7/manager/0.log" Jun 12 19:24:50.759045 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:50.759021 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-gt92z_35b39694-e96b-4138-b880-cbfc43174d14/server/0.log" Jun 12 19:24:50.885557 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:50.885526 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zsdfh_63abac2d-6ddb-4446-9d40-1235a6833218/manager/0.log" Jun 12 19:24:51.161732 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:51.161708 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ffbc465cb-g4spf_f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76/copy-manifests/0.log" Jun 12 19:24:51.170036 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:51.170008 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ffbc465cb-g4spf_f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76/manager/0.log" Jun 12 19:24:51.406433 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:51.406404 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s75tx_4e910ba4-2520-4397-aa48-2d9e9fddeebc/postgres/0.log" Jun 12 19:24:52.184797 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.184766 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf_e91cc664-3504-49ca-af58-66279580cfc3/util/0.log" Jun 12 19:24:52.191806 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.191778 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf_e91cc664-3504-49ca-af58-66279580cfc3/pull/0.log" Jun 12 19:24:52.199412 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.199387 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf_e91cc664-3504-49ca-af58-66279580cfc3/extract/0.log" Jun 12 19:24:52.314805 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.314777 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq_23723515-e851-4cff-83a9-3839cb7fa88f/util/0.log" Jun 12 19:24:52.321494 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.321453 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq_23723515-e851-4cff-83a9-3839cb7fa88f/pull/0.log" Jun 12 19:24:52.328060 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.328036 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq_23723515-e851-4cff-83a9-3839cb7fa88f/extract/0.log" Jun 12 19:24:52.557578 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.557482 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s_06f09de0-03f8-4be0-8a95-5827a7eddb3a/util/0.log" Jun 12 19:24:52.564303 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.564277 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s_06f09de0-03f8-4be0-8a95-5827a7eddb3a/pull/0.log" Jun 12 19:24:52.570723 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.570700 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s_06f09de0-03f8-4be0-8a95-5827a7eddb3a/extract/0.log" Jun 12 19:24:52.931235 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:52.931207 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zgdgd_36306bf9-9cb7-433b-be1f-bdf78dad3aaa/manager/0.log" Jun 12 19:24:53.577498 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:53.577471 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4d5mq_4e553e85-20ce-413e-ad63-85a1ac723cb6/manager/0.log" Jun 12 19:24:54.053854 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:54.053828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2ppgn_f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9/discovery/0.log" Jun 12 19:24:54.161135 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:54.161110 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-f79ft_b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79/kube-auth-proxy/0.log" Jun 12 19:24:54.523577 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:54.523549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8ssmw_2b18fa25-d6b0-42d6-b296-98473aa6200e/payload-pre-processing/0.log" Jun 12 19:24:54.649442 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:54.649412 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-vvfrc_87046e7b-c44d-4cef-9222-aba1713a497c/payload-processing/0.log" Jun 12 19:24:55.134413 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:55.134387 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx_f47ab23f-799e-477e-8f0c-d1fa84ff6d4b/storage-initializer/0.log" Jun 12 19:24:55.144763 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:55.144723 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-hjkxx_f47ab23f-799e-477e-8f0c-d1fa84ff6d4b/main/0.log" Jun 12 19:24:55.527000 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:55.526970 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97_a0a9a648-a7b9-4923-bb65-66175f910c5a/storage-initializer/0.log" Jun 12 19:24:55.535690 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:55.535667 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6lr97_a0a9a648-a7b9-4923-bb65-66175f910c5a/main/0.log" Jun 12 19:24:55.651790 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:55.651756 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf_1ca30a21-6819-496d-8b13-6b2f727d8852/storage-initializer/0.log" Jun 12 19:24:55.660603 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:24:55.660577 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-ms8qf_1ca30a21-6819-496d-8b13-6b2f727d8852/main/0.log" Jun 12 19:25:02.793324 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:02.793292 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c9dvj_767bbb80-13c3-40bd-a9f4-cb65eddd3f6e/global-pull-secret-syncer/0.log" Jun 12 19:25:02.979167 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:02.979138 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5t29d_85f5ac9f-073a-4ced-a359-aa15eff4a649/konnectivity-agent/0.log" Jun 12 19:25:03.083781 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:03.083697 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-81.ec2.internal_2e680533310e632942124d5904acb29e/haproxy/0.log" Jun 12 19:25:05.730596 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:05.730569 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-jwmqv_54b15c44-3c73-4f9d-b8c5-c23831183371/sail-operator/0.log" Jun 12 19:25:06.843961 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:06.843930 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf_e91cc664-3504-49ca-af58-66279580cfc3/extract/0.log" Jun 12 19:25:06.909990 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:06.909959 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf_e91cc664-3504-49ca-af58-66279580cfc3/util/0.log" Jun 12 19:25:06.966420 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:06.966383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgwnf_e91cc664-3504-49ca-af58-66279580cfc3/pull/0.log" Jun 12 19:25:07.035479 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:07.035448 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq_23723515-e851-4cff-83a9-3839cb7fa88f/extract/0.log" Jun 12 19:25:07.090925 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:07.090898 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq_23723515-e851-4cff-83a9-3839cb7fa88f/util/0.log" Jun 12 19:25:07.121860 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:07.121775 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qqqsq_23723515-e851-4cff-83a9-3839cb7fa88f/pull/0.log" Jun 12 19:25:07.240783 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:07.240745 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s_06f09de0-03f8-4be0-8a95-5827a7eddb3a/extract/0.log" Jun 12 19:25:07.266139 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:07.266109 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s_06f09de0-03f8-4be0-8a95-5827a7eddb3a/util/0.log" Jun 12 19:25:07.290765 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:07.290737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17vp4s_06f09de0-03f8-4be0-8a95-5827a7eddb3a/pull/0.log" Jun 12 19:25:07.586420 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:07.586386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zgdgd_36306bf9-9cb7-433b-be1f-bdf78dad3aaa/manager/0.log" Jun 12 19:25:07.980980 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:07.980944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4d5mq_4e553e85-20ce-413e-ad63-85a1ac723cb6/manager/0.log" Jun 12 19:25:09.955187 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:09.955154 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c6f58749c-nc4z9_b5030eaa-d5e1-4b34-b5a5-f5b4bb6a0b91/metrics-server/0.log" Jun 12 19:25:10.039376 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.039339 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sdh7_a1ff73da-ae44-4a71-b76e-e680f8e1f1f7/node-exporter/0.log" Jun 12 19:25:10.068334 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.068310 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sdh7_a1ff73da-ae44-4a71-b76e-e680f8e1f1f7/kube-rbac-proxy/0.log" Jun 12 19:25:10.095360 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.095338 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2sdh7_a1ff73da-ae44-4a71-b76e-e680f8e1f1f7/init-textfile/0.log" Jun 12 19:25:10.667186 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.667149 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-ndg9x_58f02022-93f0-449a-b645-c538b42ade99/prometheus-operator/0.log" Jun 12 19:25:10.692626 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.692592 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-ndg9x_58f02022-93f0-449a-b645-c538b42ade99/kube-rbac-proxy/0.log" Jun 12 19:25:10.838768 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.838734 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/thanos-query/0.log" Jun 12 19:25:10.871379 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.871330 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/kube-rbac-proxy-web/0.log" Jun 12 19:25:10.895925 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.895896 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/kube-rbac-proxy/0.log" Jun 12 19:25:10.924324 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.924252 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/prom-label-proxy/0.log" Jun 12 19:25:10.947961 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.947932 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/kube-rbac-proxy-rules/0.log" Jun 12 19:25:10.984729 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:10.984700 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf9b8d46-552s4_48fe0e72-5494-4902-8f6c-4d23cabcf27b/kube-rbac-proxy-metrics/0.log" Jun 12 19:25:13.799809 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:13.799780 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-b7b9w_9a70aab3-2a5e-484d-a56b-08f10c93eaa4/download-server/0.log" Jun 12 19:25:14.516235 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.516197 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7"] Jun 12 19:25:14.519873 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.519853 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.522664 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.522640 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87vbw\"/\"openshift-service-ca.crt\"" Jun 12 19:25:14.522815 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.522742 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87vbw\"/\"kube-root-ca.crt\"" Jun 12 19:25:14.523962 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.523944 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-87vbw\"/\"default-dockercfg-9jh5s\"" Jun 12 19:25:14.526488 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.526464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-podres\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.526663 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.526538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-lib-modules\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.526663 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.526577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-sys\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.526829 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.526750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g28g6\" (UniqueName: \"kubernetes.io/projected/6ce606b5-80ee-495d-a3b6-9858894266b7-kube-api-access-g28g6\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.526829 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.526777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-proc\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.528505 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.528482 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7"] Jun 12 19:25:14.627462 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g28g6\" (UniqueName: \"kubernetes.io/projected/6ce606b5-80ee-495d-a3b6-9858894266b7-kube-api-access-g28g6\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.627462 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-proc\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.627730 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627493 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-podres\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.627730 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-lib-modules\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.627730 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-sys\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.627730 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627604 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-proc\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.627730 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-sys\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.627730 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627682 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-podres\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.627730 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.627687 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ce606b5-80ee-495d-a3b6-9858894266b7-lib-modules\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.636208 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.636184 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g28g6\" (UniqueName: \"kubernetes.io/projected/6ce606b5-80ee-495d-a3b6-9858894266b7-kube-api-access-g28g6\") pod \"perf-node-gather-daemonset-t8wx7\" (UID: \"6ce606b5-80ee-495d-a3b6-9858894266b7\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.831879 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.831783 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:14.970775 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:14.970749 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7"] Jun 12 19:25:14.972495 ip-10-0-132-81 kubenswrapper[2559]: W0612 19:25:14.972468 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6ce606b5_80ee_495d_a3b6_9858894266b7.slice/crio-25755cb2b4626dd483c94d33daf8155692d59351942d1c05e126230adfd9e5b6 WatchSource:0}: Error finding container 25755cb2b4626dd483c94d33daf8155692d59351942d1c05e126230adfd9e5b6: Status 404 returned error can't find the container with id 25755cb2b4626dd483c94d33daf8155692d59351942d1c05e126230adfd9e5b6 Jun 12 19:25:15.646602 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:15.646567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" event={"ID":"6ce606b5-80ee-495d-a3b6-9858894266b7","Type":"ContainerStarted","Data":"fe5adc202fe510c67cc3b094afaa171df177d0be93614f85046d14647ebf3f9e"} Jun 12 19:25:15.646780 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:15.646622 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" event={"ID":"6ce606b5-80ee-495d-a3b6-9858894266b7","Type":"ContainerStarted","Data":"25755cb2b4626dd483c94d33daf8155692d59351942d1c05e126230adfd9e5b6"} Jun 12 19:25:15.646780 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:15.646647 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:15.664968 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:15.664918 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" podStartSLOduration=1.664900711 podStartE2EDuration="1.664900711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:25:15.662170565 +0000 UTC m=+2567.618254649" watchObservedRunningTime="2026-06-12 19:25:15.664900711 +0000 UTC m=+2567.620984790" Jun 12 19:25:15.813876 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:15.813849 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zsflt_3276bc51-9677-4b76-a756-af3ea2b6e648/dns/0.log" Jun 12 19:25:15.836773 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:15.836741 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zsflt_3276bc51-9677-4b76-a756-af3ea2b6e648/kube-rbac-proxy/0.log" Jun 12 19:25:15.886390 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:15.886365 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-72px9_ea99fb9a-6275-4e18-9fb5-37accb14df31/dns-node-resolver/0.log" Jun 12 19:25:16.490468 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:16.490442 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bhlgq_a1b4c353-dfe3-42a7-8d3b-556fe4e6e758/node-ca/0.log" Jun 12 19:25:17.693384 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:17.693353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2ppgn_f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9/discovery/0.log" Jun 12 19:25:17.715034 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:17.715004 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-f79ft_b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79/kube-auth-proxy/0.log" Jun 12 19:25:17.881948 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:17.881914 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8ssmw_2b18fa25-d6b0-42d6-b296-98473aa6200e/payload-pre-processing/0.log" Jun 12 19:25:17.983360 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:17.983274 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-vvfrc_87046e7b-c44d-4cef-9222-aba1713a497c/payload-processing/0.log" Jun 12 19:25:18.664923 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:18.664891 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nd44b_28edbe43-9f3a-47f9-ba58-78d9c98ef1d4/serve-healthcheck-canary/0.log" Jun 12 19:25:19.412303 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:19.412271 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc5wp_89dd6b03-ffb3-4c94-95d6-49a88430211f/kube-rbac-proxy/0.log" Jun 12 19:25:19.434887 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:19.434866 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc5wp_89dd6b03-ffb3-4c94-95d6-49a88430211f/exporter/0.log" Jun 12 19:25:19.474754 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:19.474729 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc5wp_89dd6b03-ffb3-4c94-95d6-49a88430211f/extractor/0.log" Jun 12 19:25:21.661894 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:21.661867 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-t8wx7" Jun 12 19:25:21.743471 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:21.743441 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84cbf9-jwm2g_ea8f3694-c8fe-4afa-87a5-5573b109e84c/nginx/0.log" Jun 12 19:25:21.767734 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:21.767698 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-299s9_c94a910d-35d8-41e5-8ca7-235b5f09fb55/manager/0.log" Jun 12 19:25:21.896387 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:21.896353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-n9jh8_169d6904-ce01-402a-aa12-805f6fd8f925/manager/0.log" Jun 12 19:25:21.949878 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:21.949763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6c6d95c874-wtczf_65ffe343-3117-4636-84e4-94740257997f/maas-api/0.log" Jun 12 19:25:22.121669 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:22.121638 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67d6c9848c-879z2_5943b75f-4b7c-4d71-be7d-f85b02bfc3c7/manager/0.log" Jun 12 19:25:22.141301 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:22.141273 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-gt92z_35b39694-e96b-4138-b880-cbfc43174d14/server/0.log" Jun 12 19:25:22.222992 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:22.222890 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zsdfh_63abac2d-6ddb-4446-9d40-1235a6833218/manager/0.log" Jun 12 19:25:22.420899 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:22.420867 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ffbc465cb-g4spf_f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76/manager/0.log" Jun 12 19:25:22.443887 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:22.443862 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ffbc465cb-g4spf_f13a20ce-e1d0-4cb9-b206-ffc77b0cbc76/copy-manifests/0.log" Jun 12 19:25:22.519773 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:22.519689 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s75tx_4e910ba4-2520-4397-aa48-2d9e9fddeebc/postgres/0.log" Jun 12 19:25:24.340001 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:24.339916 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q6vzp_e934e707-648e-4102-ab3d-b1aecba059b4/openshift-lws-operator/0.log" Jun 12 19:25:27.489495 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:27.489463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2ppgn_f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9/discovery/0.log" Jun 12 19:25:27.503848 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:27.503823 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-f79ft_b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79/kube-auth-proxy/0.log" Jun 12 19:25:27.633454 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:27.633422 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8ssmw_2b18fa25-d6b0-42d6-b296-98473aa6200e/payload-pre-processing/0.log" Jun 12 19:25:27.728732 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:27.728704 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-vvfrc_87046e7b-c44d-4cef-9222-aba1713a497c/payload-processing/0.log" Jun 12 19:25:29.034258 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:29.034219 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2ppgn_f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9/discovery/0.log" Jun 12 19:25:29.049471 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:29.049418 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-f79ft_b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79/kube-auth-proxy/0.log" Jun 12 19:25:29.184268 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:29.184235 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8ssmw_2b18fa25-d6b0-42d6-b296-98473aa6200e/payload-pre-processing/0.log" Jun 12 19:25:29.273708 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:29.273678 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-vvfrc_87046e7b-c44d-4cef-9222-aba1713a497c/payload-processing/0.log" Jun 12 19:25:31.091803 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.091767 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-2ppgn_f3ff815c-bbb7-4092-9c2f-ee966d4f2bb9/discovery/0.log" Jun 12 19:25:31.140555 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.140528 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-f79ft_b5a7d148-a8c5-46e8-9e46-e76dfb3a6f79/kube-auth-proxy/0.log" Jun 12 19:25:31.250131 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.250102 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6q8dn_6e225712-648e-4818-b391-ad52555e9cb6/kube-multus/0.log" Jun 12 19:25:31.279353 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.279328 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-55dzb_51ccac4d-e403-42e2-9cfd-feb86d13ced2/kube-multus-additional-cni-plugins/0.log" Jun 12 19:25:31.297846 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.297822 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8ssmw_2b18fa25-d6b0-42d6-b296-98473aa6200e/payload-pre-processing/0.log" Jun 12 19:25:31.309477 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.309452 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-55dzb_51ccac4d-e403-42e2-9cfd-feb86d13ced2/egress-router-binary-copy/0.log" Jun 12 19:25:31.348038 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.347967 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-55dzb_51ccac4d-e403-42e2-9cfd-feb86d13ced2/cni-plugins/0.log" Jun 12 19:25:31.379674 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.379646 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-55dzb_51ccac4d-e403-42e2-9cfd-feb86d13ced2/bond-cni-plugin/0.log" Jun 12 19:25:31.388225 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.388198 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-vvfrc_87046e7b-c44d-4cef-9222-aba1713a497c/payload-processing/0.log" Jun 12 19:25:31.404357 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.404333 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-55dzb_51ccac4d-e403-42e2-9cfd-feb86d13ced2/routeoverride-cni/0.log" Jun 12 19:25:31.428639 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.428616 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-55dzb_51ccac4d-e403-42e2-9cfd-feb86d13ced2/whereabouts-cni-bincopy/0.log" Jun 12 19:25:31.452414 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.452387 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-55dzb_51ccac4d-e403-42e2-9cfd-feb86d13ced2/whereabouts-cni/0.log" Jun 12 19:25:31.959484 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.959455 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w9jgg_0d94de43-46c3-46b0-a2a0-5fad08021d00/network-metrics-daemon/0.log" Jun 12 19:25:31.979348 ip-10-0-132-81 kubenswrapper[2559]: I0612 19:25:31.979319 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w9jgg_0d94de43-46c3-46b0-a2a0-5fad08021d00/kube-rbac-proxy/0.log"